2024-09-12T16:57:49.458 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:57:49.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:57:49.569 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709 branch: wip-rgw-meta-handlers description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: null first_in_suite: false job_id: '7902709' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZ1ybRrb5hFtspgOjvhgGXn/O1GtTRgw6Ay0heuUhHMFsXR7Y1SVWge5axPOiEbrqm+7cWJWz5HWhSmySg9RpM= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYCdYnzTskWUTRcetTY8oKIwp4i59nPDFh0eLcI+n4SVWrc+Evp1LqXYetY9EosZFAs2Ab2WDLwunv7a2T7fD8= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:57:49.570 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:57:49.570 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:57:49.571 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:57:49.572 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:57:49.602 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:57:49.602 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:57:49.602 INFO:teuthology.packaging:ref: None 2024-09-12T16:57:49.602 INFO:teuthology.packaging:tag: None 2024-09-12T16:57:49.602 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:57:49.602 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:57:49.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:57:49.757 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:57:49.759 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:57:49.765 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:57:49.765 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:57:49.810 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:57:49.826 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:57:49.845 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:57:49.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:52:18.274137', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOviZ+phJ3j3kcgfFv3PQhdgF9ckqMJM6rg5PtRrRkre'} 2024-09-12T16:57:49.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:52:18.275851', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEkPyXPDNSXkXuQVpTY+CiSu6mp+Dk2RC/pQguaA9B7i'} 2024-09-12T16:57:49.897 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:57:49.904 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-12T16:57:49.904 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-12T16:57:49.904 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:57:49.991 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6e8308fac0>, signals=[15]) 2024-09-12T16:57:49.991 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:57:49.997 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:57:49.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T16:57:49.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:57:50.093 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T16:57:50.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:57:50.191 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:57:50.197 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-12T16:57:50.202 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-12T16:57:50.202 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-12T16:57:50.248 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:57:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:57:50.250 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:57:50.250 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:57:50.250 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-12T16:57:50.276 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-12T16:57:50.282 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-12T16:57:50.282 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-12T16:57:50.328 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Ubuntu" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="22.04" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_CODENAME=jammy 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:ID=ubuntu 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE=debian 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:57:50.329 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:57:50.330 INFO:teuthology.orchestra.run.smithi193.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:57:50.330 INFO:teuthology.orchestra.run.smithi193.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:57:50.330 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-12T16:57:50.351 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:57:50.361 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:57:50.395 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:57:50.396 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:57:50.398 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:57:50.404 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:57:50.427 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:57:50.427 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:57:50.445 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:57:50.466 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:57:50.525 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:57:50.538 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:57:50.539 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:57:50.539 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:57:50.539 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:57:50.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:50.544 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T16:57:50.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:57:50.545 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-09-12T16:57:50.592 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-56-generic 2024-09-12T16:57:50.592 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.15.0-56-generic 2024-09-12T16:57:50.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-12T16:57:50.594 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-56-generic 2024-09-12T16:57:50.594 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.15.0-56-generic 2024-09-12T16:57:50.594 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-09-12T16:57:50.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T16:57:50.733 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-09-12T16:57:50.868 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:57:50.982 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:57:51.003 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:57:51.014 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:57:51.063 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:57:51.070 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:57:51.097 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:57:51.168 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:57:51.204 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:57:51.207 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:57:51.207 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:57:51.207 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:57:51.227 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:57:51.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:57:51.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:57:51.236 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:57:51.240 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:57:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:57:51.248 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:57:51.249 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:57:51.275 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:57:51.276 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:57:51.423 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:57:51.428 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:57:51.449 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:57:51.564 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:57:51.570 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:57:51.745 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:57:51.882 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:57:51.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:57:51.917 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:57:51.918 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:57:51.921 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:57:51.930 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:57:51.932 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:57:51.933 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:57:51.934 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:57:51.934 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:57:51.934 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:57:51.936 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:57:51.937 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:57:51.939 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:57:52.007 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:57:52.036 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:57:52.048 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:57:52.049 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:57:52.049 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:57:52.049 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:57:52.049 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:57:52.058 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:57:52.058 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:57:52.066 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:57:52.071 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:57:52.077 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:57:52.089 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:57:52.089 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:57:52.092 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:57:52.092 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:57:52.092 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:57:52.093 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:57:52.094 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:57:52.094 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:57:52.094 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:57:52.095 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:57:52.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:57:52.109 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:57:52.110 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:57:52.110 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:57:52.111 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:57:52.128 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:57:52.132 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:57:52.165 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:57:52.176 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:57:52.177 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:57:52.178 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:57:52.179 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:57:52.179 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:57:52.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:57:52.194 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:57:52.196 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:57:52.196 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:57:52.196 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:57:52.209 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:57:52.210 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:57:52.211 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:57:52.213 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:57:52.214 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:57:52.215 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:57:57.905 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 15.8 MB in 2s (7,270 kB/s) 2024-09-12T16:57:58.384 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 15.8 MB in 3s (5,735 kB/s) 2024-09-12T16:57:59.398 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T16:57:59.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:57:59.482 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T16:57:59.697 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T16:57:59.697 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T16:57:59.809 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T16:57:59.826 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:57:59.882 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T16:57:59.893 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:57:59.893 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:57:59.893 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:57:59.894 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:57:59.894 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:57:59.894 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-09-12T16:57:59.894 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:57:59.895 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-12T16:57:59.895 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:57:59.895 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:57:59.896 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:57:59.897 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-12T16:57:59.897 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:57:59.897 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-12T16:57:59.898 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2024-09-12T16:57:59.953 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-12T16:57:59.953 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:57:59.953 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:57:59.953 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:57:59.955 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-09-12T16:57:59.955 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:58:00.008 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:58:00.008 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 113 MB of archives. 2024-09-12T16:58:00.008 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:58:00.008 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:58:00.067 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-09-12T16:58:00.067 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-09-12T16:58:00.233 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:58:00.233 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:58:00.233 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:58:00.234 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:58:00.234 INFO:teuthology.orchestra.run.smithi193.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:58:00.234 INFO:teuthology.orchestra.run.smithi193.stdout: python2.7-minimal 2024-09-12T16:58:00.234 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:58:00.235 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-09-12T16:58:00.235 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:58:00.235 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:58:00.236 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:58:00.237 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-09-12T16:58:00.237 INFO:teuthology.orchestra.run.smithi193.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:58:00.237 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-09-12T16:58:00.237 INFO:teuthology.orchestra.run.smithi193.stdout: thermald 2024-09-12T16:58:00.286 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-09-12T16:58:00.286 INFO:teuthology.orchestra.run.smithi193.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:58:00.286 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:58:00.287 INFO:teuthology.orchestra.run.smithi193.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:58:00.287 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages will be upgraded: 2024-09-12T16:58:00.288 INFO:teuthology.orchestra.run.smithi193.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:58:00.402 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:58:00.469 INFO:teuthology.orchestra.run.smithi193.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:58:00.469 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 113 MB of archives. 2024-09-12T16:58:00.469 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:58:00.469 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:58:00.492 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:58:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:58:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:58:01.298 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:58:01.423 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:58:01.444 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:58:01.862 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:58:01.933 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 113 MB in 2s (73.3 MB/s) 2024-09-12T16:58:02.124 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:58:02.214 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:58:04.085 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:58:04.089 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:04.197 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:04.423 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:58:04.462 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:58:04.467 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:58:04.838 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:58:04.921 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:58:05.305 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 113 MB in 5s (24.5 MB/s) 2024-09-12T16:58:05.480 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:58:06.432 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:58:06.455 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:06.565 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:07.010 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:58:07.031 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:07.068 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:07.500 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:58:07.504 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:07.652 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:09.961 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:58:09.982 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:10.079 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:10.631 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:58:10.652 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:10.815 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:14.113 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:14.239 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:14.557 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:14.726 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:15.037 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:58:15.061 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:58:15.104 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:58:17.558 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:17.683 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:18.015 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:18.145 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:18.447 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:58:18.470 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:58:18.564 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:58:21.321 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:58:21.359 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:21.403 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:24.110 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:24.258 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:24.455 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:58:24.492 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:58:24.537 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:24.608 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:58:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:24.881 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:58:25.010 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:26.513 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:26.513 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:26.513 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:26.513 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:27.303 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:28.968 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:58:29.116 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:58:29.516 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:58:29.662 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:29.789 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:58:29.934 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:30.215 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:58:30.358 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:58:30.483 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:30.549 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:58:30.549 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:31.246 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:31.246 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:31.247 INFO:teuthology.orchestra.run.smithi193.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:31.247 INFO:teuthology.orchestra.run.smithi193.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:31.428 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:33.255 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:35.089 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:58:35.224 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:58:35.325 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:58:35.377 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:58:35.377 INFO:teuthology.orchestra.run.smithi193.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:44.804 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:58:44.804 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:58:44.838 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:58:44.856 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2024-09-12T16:58:45.134 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:45.152 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:45.452 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:45.458 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:45.526 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:58:45.531 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:58:45.716 INFO:teuthology.orchestra.run.smithi062.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:58:45.717 INFO:teuthology.orchestra.run.smithi062.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:58:45.717 INFO:teuthology.orchestra.run.smithi062.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:58:45.765 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-09-12T16:58:46.221 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-12T16:58:46.242 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-12T16:58:46.243 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-12T16:58:46.244 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:58:46.244 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-12T16:58:46.244 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:58:46.244 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:58:46.244 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:58:46.244 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:58:46.244 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:58:46.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-09-12T16:58:46.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T16:58:46.541 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:58:46.672 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:58:46.744 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:58:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:58:48.046 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T16:58:48.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:58:48.130 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T16:58:48.343 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T16:58:48.343 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T16:58:48.545 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:58:48.545 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:58:48.546 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:58:48.592 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:58:48.594 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-09-12T16:58:48.610 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.119.119 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:58:48.611 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-09-12T16:58:48.611 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T16:58:48.656 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.BFLnT2YYNN 2024-09-12T16:58:48.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.BFLnT2YYNN 2024-09-12T16:58:48.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.BFLnT2YYNN 2024-09-12T16:58:48.832 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.BFLnT2YYNN is 10KB 2024-09-12T16:58:48.845 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.BFLnT2YYNN 2024-09-12T16:58:48.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:58:48.903 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T16:58:48.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:58:48.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:58:48.970 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:58:48.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2024-09-12T16:58:49.620 INFO:teuthology.orchestra.run.smithi193.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:58:49.621 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:58:49.654 INFO:teuthology.orchestra.run.smithi193.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:58:49.674 INFO:teuthology.orchestra.run.smithi193.stdout:Generating grub configuration file ... 2024-09-12T16:58:49.968 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:49.985 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:58:50.288 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:58:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-09-12T16:58:50.353 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:50.359 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:50.426 INFO:teuthology.orchestra.run.smithi193.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:58:50.431 INFO:teuthology.orchestra.run.smithi193.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:58:50.473 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:50.479 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:50.614 INFO:teuthology.orchestra.run.smithi193.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:58:50.614 INFO:teuthology.orchestra.run.smithi193.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:58:50.614 INFO:teuthology.orchestra.run.smithi193.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:58:50.656 INFO:teuthology.orchestra.run.smithi193.stdout:done 2024-09-12T16:58:50.711 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:50.716 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:58:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:58:50.887 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:58:50.887 INFO:teuthology.orchestra.run.smithi062.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:58:50.887 INFO:teuthology.orchestra.run.smithi062.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:58:50.911 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-09-12T16:58:50.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-09-12T16:58:51.145 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-09-12T16:58:51.167 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-09-12T16:58:51.167 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-09-12T16:58:51.167 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.119.119 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:58:51.168 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-09-12T16:58:51.169 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:58:51.169 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:58:51.169 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:58:51.169 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-12T16:58:51.169 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi193.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:58:51.169 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get clean 2024-09-12T16:58:51.348 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-09-12T16:58:51.606 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:58:51.606 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:58:51.667 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:58:51.748 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:58:52.989 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T16:58:53.008 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:58:53.069 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T16:58:53.289 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-09-12T16:58:53.289 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-09-12T16:58:53.479 INFO:teuthology.orchestra.run.smithi193.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:58:53.479 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:58:53.479 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:58:53.479 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:58:53.480 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:58:53.480 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:58:53.480 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:58:53.480 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:58:53.522 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:58:53.524 DEBUG:teuthology.orchestra.run.smithi193:> dpkg -s linux-image-generic 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Package: linux-image-generic 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Status: install ok installed 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Priority: optional 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Section: kernel 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Installed-Size: 21 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:58:53.539 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: amd64 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Source: linux-meta 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Version: 5.15.0.119.119 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Recommends: thermald 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout:Description: Generic Linux kernel image 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:58:53.540 INFO:teuthology.orchestra.run.smithi193.stdout: available. 2024-09-12T16:58:53.540 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-09-12T16:58:53.584 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.iSNpUrA0OX 2024-09-12T16:58:53.584 DEBUG:teuthology.orchestra.run.smithi193:> sudo cp /boot/grub/grub.cfg /tmp/tmp.iSNpUrA0OX 2024-09-12T16:58:53.640 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.iSNpUrA0OX 2024-09-12T16:58:53.767 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.iSNpUrA0OX is 10KB 2024-09-12T16:58:53.779 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.iSNpUrA0OX 2024-09-12T16:58:53.785 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:58:53.840 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T16:58:53.840 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:58:53.840 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:58:53.923 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:58:53.923 DEBUG:teuthology.orchestra.run.smithi193:> sudo update-grub 2024-09-12T16:58:55.301 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:58:55.303 INFO:teuthology.orchestra.run.smithi193.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:58:55.320 INFO:teuthology.orchestra.run.smithi193.stderr:Generating grub configuration file ... 2024-09-12T16:58:55.527 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:58:55.533 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:58:55.805 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:58:55.810 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:58:55.854 INFO:teuthology.orchestra.run.smithi193.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:58:55.859 INFO:teuthology.orchestra.run.smithi193.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:58:55.974 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:58:55.974 INFO:teuthology.orchestra.run.smithi193.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:58:55.974 INFO:teuthology.orchestra.run.smithi193.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:58:56.003 INFO:teuthology.orchestra.run.smithi193.stderr:done 2024-09-12T16:58:56.012 DEBUG:teuthology.orchestra.run.smithi193:> sudo shutdown -r now 2024-09-12T16:59:20.930 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:59:20.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T16:59:20.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:26.017 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-12T16:59:26.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T16:59:26.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:39.457 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T16:59:44.573 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-09-12T16:59:48.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T16:59:48.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:51.517 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T16:59:53.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T16:59:53.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:59:56.637 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-09-12T17:00:03.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T17:00:03.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:00:08.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T17:00:08.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:00:35.221 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T17:00:35.817 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T17:00:35.817 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T17:00:35.818 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T17:00:35.865 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-119-generic 2024-09-12T17:00:35.865 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:00:35.865 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:00:35.865 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:00:36.867 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T17:00:36.867 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:00:36.951 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-09-12T17:00:36.983 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:40.747 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-12T17:00:41.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T17:00:41.363 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-12T17:00:41.364 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-09-12T17:00:41.408 INFO:teuthology.orchestra.run.smithi193.stdout:5.15.0-119-generic 2024-09-12T17:00:41.408 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T17:00:41.408 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T17:00:41.409 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T17:00:42.409 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-12T17:00:42.410 DEBUG:teuthology.orchestra.run.smithi193:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T17:00:42.468 INFO:teuthology.orchestra.run.smithi193.stdout:ttyS1 2024-09-12T17:00:42.490 DEBUG:teuthology.parallel:result is None 2024-09-12T17:00:42.490 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T17:00:42.497 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T17:00:42.497 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:00:42.499 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T17:00:42.504 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T17:00:42.542 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T17:00:42.592 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T17:00:42.592 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:00:42.595 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T17:00:42.617 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T17:00:42.642 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T17:00:42.643 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:00:42.654 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T17:00:42.671 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:00:42.679 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:00:42.679 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:00:42.688 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T17:00:42.689 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T17:00:42.696 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T17:00:42.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:00:42.726 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T17:00:42.760 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T17:00:42.769 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T17:00:42.769 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:00:42.790 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T17:00:42.809 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:00:42.841 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:00:42.889 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:00:42.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:00:42.951 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T17:00:42.957 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T17:00:43.005 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:00:43.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T17:00:43.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-12T17:00:43.074 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-12T17:00:43.141 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T17:00:43.148 INFO:teuthology.task.internal:Starting timer... 2024-09-12T17:00:43.148 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T17:00:43.221 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T17:00:43.278 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2024-09-12T17:00:43.278 DEBUG:teuthology.task.selinux:Excluding smithi193: OS 'ubuntu' does not support SELinux 2024-09-12T17:00:43.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T17:00:43.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T17:00:43.278 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T17:00:43.278 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T17:00:43.327 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T17:00:43.330 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T17:00:43.466 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T17:00:43.477 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T17:00:43.478 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:08:20.690 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-12T17:08:20.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T17:08:20.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:08:20.793 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T17:08:20.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T17:08:20.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T17:08:20.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:08:20.954 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-12T17:08:21.028 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-12T17:08:21.029 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:08:21.039 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:08:21.039 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:08:21.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:08:21.042 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:08:21.042 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:08:21.070 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:08:21.070 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Command line: ntpd -gq 2024-09-12T17:08:21.070 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: ---------------------------------------------------- 2024-09-12T17:08:21.070 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:08:21.070 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:08:21.071 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: corporation. Support and training for ntp-4 are 2024-09-12T17:08:21.071 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: available at https://www.nwtime.org/support 2024-09-12T17:08:21.071 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: ---------------------------------------------------- 2024-09-12T17:08:21.071 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: proto: precision = 0.067 usec (-24) 2024-09-12T17:08:21.072 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: basedate set to 2022-02-04 2024-09-12T17:08:21.072 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:08:21.072 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:08:21.073 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:08:21.073 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:08:21.073 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen normally on 4 lo [::1]:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2024-09-12T17:08:21.074 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:21 ntpd[18487]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:08:21.099 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Command line: ntpd -gq 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: ---------------------------------------------------- 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: corporation. Support and training for ntp-4 are 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: available at https://www.nwtime.org/support 2024-09-12T17:08:21.100 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: ---------------------------------------------------- 2024-09-12T17:08:21.101 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: proto: precision = 0.096 usec (-23) 2024-09-12T17:08:21.101 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: basedate set to 2022-02-04 2024-09-12T17:08:21.101 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:08:21.101 INFO:teuthology.orchestra.run.smithi193.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:08:21.102 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:08:21.102 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:08:21.102 INFO:teuthology.orchestra.run.smithi193.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen normally on 3 enp3s0f1 172.21.15.193:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen normally on 4 lo [::1]:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7253%5]:123 2024-09-12T17:08:21.103 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:21 ntpd[18516]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:22.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:22 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:23.070 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:23.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:23 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:23.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:23.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:23.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:23 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:24.070 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:24 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:25.070 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:25.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:25 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:25.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:25.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:25.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:25.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:25.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:25.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:25 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:26.072 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:26 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:26.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:26.102 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:26 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:27.070 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:27.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:27.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:27.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:27.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:27.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:27 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:27.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:27.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:27 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:28.071 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:28.072 INFO:teuthology.orchestra.run.smithi062.stdout:12 Sep 17:08:28 ntpd[18487]: ntpd: time slew -0.000006 s 2024-09-12T17:08:28.072 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.000006s 2024-09-12T17:08:28.072 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:08:28.072 INFO:teuthology.orchestra.run.smithi062.stderr:12 Sep 17:08:28 ntpd[18487]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:28.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:28.102 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:28.102 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:28.102 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:28 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:28.135 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:08:28.135 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-12T17:08:28.136 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:28.136 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:28.136 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:28.136 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:29.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:29.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:29.100 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stdout:12 Sep 17:08:29 ntpd[18516]: ntpd: time slew -0.000615 s 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stdout:ntpd: time slew -0.000615s 2024-09-12T17:08:29.101 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:08:29.102 INFO:teuthology.orchestra.run.smithi193.stderr:12 Sep 17:08:29 ntpd[18516]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:29.233 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:08:29.234 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:08:29.242 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:08:29.242 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:08:29.242 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:08:29.243 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:08:29.249 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:08:29.249 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:08:29.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2024-09-12T17:08:29.250 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-key list | grep Ceph 2024-09-12T17:08:29.314 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:08:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:08:29.343 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:08:29.343 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:08:29.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:08:29.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:08:29.366 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:08:29.366 INFO:teuthology.orchestra.run.smithi193.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:08:29.366 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:08:29.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:08:29.491 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:08:29.492 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:08:29.506 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:08:29.507 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:08:29.618 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:08:29.619 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:08:29.622 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:08:29.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:08:29.636 DEBUG:teuthology.orchestra.run.smithi193:> sudo apt-get update 2024-09-12T17:08:29.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-09-12T17:08:29.810 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:08:29.820 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:08:29.837 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:08:29.863 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:08:29.864 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:08:29.884 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:08:29.885 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:08:29.906 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:08:29.908 INFO:teuthology.orchestra.run.smithi193.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:08:29.927 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:08:29.933 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:08:29.938 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:08:29.938 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:08:29.947 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:08:29.955 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:08:29.969 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:08:30.011 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:08:30.092 INFO:teuthology.orchestra.run.smithi193.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:08:30.182 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 28.6 kB in 0s (79.7 kB/s) 2024-09-12T17:08:30.312 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 28.6 kB in 0s (57.9 kB/s) 2024-09-12T17:08:31.212 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T17:08:31.230 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:08:31.286 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-09-12T17:08:31.346 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T17:08:31.363 DEBUG:teuthology.orchestra.run.smithi193:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:08:31.428 INFO:teuthology.orchestra.run.smithi193.stdout:Reading package lists... 2024-09-12T17:08:31.475 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-09-12T17:08:31.476 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-09-12T17:08:31.637 INFO:teuthology.orchestra.run.smithi193.stdout:Building dependency tree... 2024-09-12T17:08:31.637 INFO:teuthology.orchestra.run.smithi193.stdout:Reading state information... 2024-09-12T17:08:31.669 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:08:31.669 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:08:31.669 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:08:31.669 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:08:31.669 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:08:31.670 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:08:31.670 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:08:31.670 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-09-12T17:08:31.670 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:08:31.670 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:08:31.671 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:08:31.672 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet zip 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:08:31.673 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-09-12T17:08:31.674 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:08:31.781 INFO:teuthology.orchestra.run.smithi062.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:08:31.782 INFO:teuthology.orchestra.run.smithi062.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:08:31.783 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:08:31.784 INFO:teuthology.orchestra.run.smithi062.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:08:31.843 INFO:teuthology.orchestra.run.smithi193.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:08:31.843 INFO:teuthology.orchestra.run.smithi193.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:08:31.843 INFO:teuthology.orchestra.run.smithi193.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:08:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:08:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 243 MB of archives. 2024-09-12T17:08:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:08:31.844 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout:The following additional packages will be installed: 2024-09-12T17:08:31.845 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:08:31.846 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:08:31.848 INFO:teuthology.orchestra.run.smithi193.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:08:31.848 INFO:teuthology.orchestra.run.smithi193.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:08:31.849 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:08:31.849 INFO:teuthology.orchestra.run.smithi193.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:08:31.849 INFO:teuthology.orchestra.run.smithi193.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:08:31.850 INFO:teuthology.orchestra.run.smithi193.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet zip 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout:Suggested packages: 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout:Recommended packages: 2024-09-12T17:08:31.851 INFO:teuthology.orchestra.run.smithi193.stdout: btrfs-tools 2024-09-12T17:08:31.927 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:08:31.931 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:08:31.933 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:08:31.950 INFO:teuthology.orchestra.run.smithi193.stdout:The following NEW packages will be installed: 2024-09-12T17:08:31.950 INFO:teuthology.orchestra.run.smithi193.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:08:31.950 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:08:31.950 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:08:31.952 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:08:31.952 INFO:teuthology.orchestra.run.smithi193.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:08:31.953 INFO:teuthology.orchestra.run.smithi193.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi193.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:08:31.954 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:08:32.011 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:08:32.016 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:08:32.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:08:32.033 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:08:32.034 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:08:32.035 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:08:32.043 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:08:32.046 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:08:32.048 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:08:32.049 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:08:32.050 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:08:32.066 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:08:32.069 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:08:32.070 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:08:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:08:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:08:32.073 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:08:32.083 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:08:32.083 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:08:32.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:08:32.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:08:32.097 INFO:teuthology.orchestra.run.smithi193.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:08:32.098 INFO:teuthology.orchestra.run.smithi193.stdout:Need to get 243 MB of archives. 2024-09-12T17:08:32.098 INFO:teuthology.orchestra.run.smithi193.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:08:32.098 INFO:teuthology.orchestra.run.smithi193.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:08:32.100 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:08:32.100 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:08:32.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:08:32.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:08:32.104 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:08:32.104 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:08:32.117 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:08:32.117 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:08:32.118 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:08:32.119 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:08:32.133 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:08:32.134 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:08:32.140 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:08:32.140 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:08:32.140 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:08:32.140 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:08:32.141 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:08:32.141 INFO:teuthology.orchestra.run.smithi193.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:08:32.150 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:08:32.152 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:08:32.153 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:08:32.154 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:08:32.167 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:08:32.170 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:08:32.170 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:08:32.171 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:08:32.173 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:08:32.226 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:08:32.226 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:08:32.227 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:08:32.229 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:08:32.229 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:08:32.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:08:32.243 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:08:32.248 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:08:32.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:08:32.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:08:32.257 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:08:32.258 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:08:32.262 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:08:32.263 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:08:32.264 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:08:32.265 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:08:32.265 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:08:32.265 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:08:32.266 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:08:32.299 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:08:32.299 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:08:32.299 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:08:32.300 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:08:32.303 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:08:32.304 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:08:32.305 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:08:32.306 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:08:32.309 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:08:32.327 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:08:32.328 INFO:teuthology.orchestra.run.smithi193.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:08:32.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:08:32.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:08:32.333 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:08:32.333 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:08:32.336 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:08:32.336 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:08:32.337 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:08:32.348 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:08:32.350 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:08:32.365 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:08:32.373 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:08:32.374 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:08:32.374 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:08:32.377 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:08:32.377 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:08:32.463 INFO:teuthology.orchestra.run.smithi193.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:08:32.478 INFO:teuthology.orchestra.run.smithi193.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:08:32.499 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:08:32.501 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:08:32.502 INFO:teuthology.orchestra.run.smithi193.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:08:32.504 INFO:teuthology.orchestra.run.smithi193.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:08:32.508 INFO:teuthology.orchestra.run.smithi193.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:08:32.510 INFO:teuthology.orchestra.run.smithi193.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:08:32.516 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:08:32.518 INFO:teuthology.orchestra.run.smithi193.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:08:32.563 INFO:teuthology.orchestra.run.smithi193.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:08:32.576 INFO:teuthology.orchestra.run.smithi193.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:08:32.657 INFO:teuthology.orchestra.run.smithi193.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:08:32.838 INFO:teuthology.orchestra.run.smithi193.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:08:32.841 INFO:teuthology.orchestra.run.smithi193.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:08:32.875 INFO:teuthology.orchestra.run.smithi193.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:08:32.886 INFO:teuthology.orchestra.run.smithi193.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:08:32.898 INFO:teuthology.orchestra.run.smithi193.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:08:32.927 INFO:teuthology.orchestra.run.smithi193.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:08:32.936 INFO:teuthology.orchestra.run.smithi193.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:08:32.937 INFO:teuthology.orchestra.run.smithi193.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:08:32.938 INFO:teuthology.orchestra.run.smithi193.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:08:32.956 INFO:teuthology.orchestra.run.smithi193.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:08:32.960 INFO:teuthology.orchestra.run.smithi193.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:08:32.965 INFO:teuthology.orchestra.run.smithi193.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:08:32.968 INFO:teuthology.orchestra.run.smithi193.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:08:33.049 INFO:teuthology.orchestra.run.smithi193.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:08:33.053 INFO:teuthology.orchestra.run.smithi193.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:08:33.057 INFO:teuthology.orchestra.run.smithi193.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:08:33.060 INFO:teuthology.orchestra.run.smithi193.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:08:33.061 INFO:teuthology.orchestra.run.smithi193.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:08:33.062 INFO:teuthology.orchestra.run.smithi193.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:08:33.064 INFO:teuthology.orchestra.run.smithi193.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:08:33.064 INFO:teuthology.orchestra.run.smithi193.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:08:33.065 INFO:teuthology.orchestra.run.smithi193.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:08:33.131 INFO:teuthology.orchestra.run.smithi193.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:08:33.147 INFO:teuthology.orchestra.run.smithi193.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:08:33.148 INFO:teuthology.orchestra.run.smithi193.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:08:33.149 INFO:teuthology.orchestra.run.smithi193.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:08:33.154 INFO:teuthology.orchestra.run.smithi193.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:08:33.155 INFO:teuthology.orchestra.run.smithi193.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:08:33.213 INFO:teuthology.orchestra.run.smithi193.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:08:33.213 INFO:teuthology.orchestra.run.smithi193.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:08:33.215 INFO:teuthology.orchestra.run.smithi193.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:08:33.216 INFO:teuthology.orchestra.run.smithi193.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:08:33.294 INFO:teuthology.orchestra.run.smithi193.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:08:33.296 INFO:teuthology.orchestra.run.smithi193.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:08:33.297 INFO:teuthology.orchestra.run.smithi193.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:08:33.298 INFO:teuthology.orchestra.run.smithi193.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:08:33.309 INFO:teuthology.orchestra.run.smithi193.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:08:33.375 INFO:teuthology.orchestra.run.smithi193.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:08:33.376 INFO:teuthology.orchestra.run.smithi193.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:08:33.377 INFO:teuthology.orchestra.run.smithi193.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:08:33.380 INFO:teuthology.orchestra.run.smithi193.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:08:33.383 INFO:teuthology.orchestra.run.smithi193.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:08:33.407 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:08:33.457 INFO:teuthology.orchestra.run.smithi193.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:08:33.460 INFO:teuthology.orchestra.run.smithi193.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:08:33.464 INFO:teuthology.orchestra.run.smithi193.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:08:33.471 INFO:teuthology.orchestra.run.smithi193.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:08:33.474 INFO:teuthology.orchestra.run.smithi193.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:08:33.506 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:08:33.509 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:08:33.511 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:08:33.538 INFO:teuthology.orchestra.run.smithi193.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:08:33.542 INFO:teuthology.orchestra.run.smithi193.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:08:33.652 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:08:33.705 INFO:teuthology.orchestra.run.smithi193.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:08:33.707 INFO:teuthology.orchestra.run.smithi193.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:08:33.709 INFO:teuthology.orchestra.run.smithi193.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:08:33.710 INFO:teuthology.orchestra.run.smithi193.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:08:33.713 INFO:teuthology.orchestra.run.smithi193.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:08:33.749 INFO:teuthology.orchestra.run.smithi193.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:08:33.752 INFO:teuthology.orchestra.run.smithi193.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:08:33.752 INFO:teuthology.orchestra.run.smithi193.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:08:33.767 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:08:33.810 INFO:teuthology.orchestra.run.smithi193.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:08:33.810 INFO:teuthology.orchestra.run.smithi193.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:08:33.872 INFO:teuthology.orchestra.run.smithi193.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:08:33.940 INFO:teuthology.orchestra.run.smithi193.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:08:33.941 INFO:teuthology.orchestra.run.smithi193.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:08:34.000 INFO:teuthology.orchestra.run.smithi193.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:08:34.001 INFO:teuthology.orchestra.run.smithi193.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:08:34.001 INFO:teuthology.orchestra.run.smithi193.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:08:34.002 INFO:teuthology.orchestra.run.smithi193.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:08:34.010 INFO:teuthology.orchestra.run.smithi193.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:08:34.014 INFO:teuthology.orchestra.run.smithi193.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:08:34.018 INFO:teuthology.orchestra.run.smithi193.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:08:34.020 INFO:teuthology.orchestra.run.smithi193.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:08:34.034 INFO:teuthology.orchestra.run.smithi193.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:08:34.111 INFO:teuthology.orchestra.run.smithi193.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:08:34.113 INFO:teuthology.orchestra.run.smithi193.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:08:34.114 INFO:teuthology.orchestra.run.smithi193.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:08:34.122 INFO:teuthology.orchestra.run.smithi193.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:08:34.126 INFO:teuthology.orchestra.run.smithi193.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:08:34.128 INFO:teuthology.orchestra.run.smithi193.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:08:34.128 INFO:teuthology.orchestra.run.smithi193.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:08:34.135 INFO:teuthology.orchestra.run.smithi193.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:08:34.135 INFO:teuthology.orchestra.run.smithi193.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:08:34.137 INFO:teuthology.orchestra.run.smithi193.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:08:34.138 INFO:teuthology.orchestra.run.smithi193.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:08:34.138 INFO:teuthology.orchestra.run.smithi193.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:08:34.197 INFO:teuthology.orchestra.run.smithi193.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:08:34.208 INFO:teuthology.orchestra.run.smithi193.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:08:34.278 INFO:teuthology.orchestra.run.smithi193.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:08:34.296 INFO:teuthology.orchestra.run.smithi193.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:08:34.296 INFO:teuthology.orchestra.run.smithi193.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:08:34.297 INFO:teuthology.orchestra.run.smithi193.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:08:34.302 INFO:teuthology.orchestra.run.smithi193.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:08:34.304 INFO:teuthology.orchestra.run.smithi193.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:08:34.439 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:08:34.440 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:08:34.458 INFO:teuthology.orchestra.run.smithi193.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:08:34.459 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:08:34.501 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:08:34.511 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:08:34.513 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:08:35.438 INFO:teuthology.orchestra.run.smithi193.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:08:35.484 INFO:teuthology.orchestra.run.smithi193.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:08:35.501 INFO:teuthology.orchestra.run.smithi193.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:08:35.543 INFO:teuthology.orchestra.run.smithi193.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:08:35.553 INFO:teuthology.orchestra.run.smithi193.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:08:35.559 INFO:teuthology.orchestra.run.smithi193.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:08:36.515 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:08:36.696 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:08:36.697 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:08:37.936 INFO:teuthology.orchestra.run.smithi193.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:08:38.077 INFO:teuthology.orchestra.run.smithi193.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:08:38.077 INFO:teuthology.orchestra.run.smithi193.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:08:38.124 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:08:38.205 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:08:38.206 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:08:38.633 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:08:39.225 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 243 MB in 7s (35.6 MB/s) 2024-09-12T17:08:39.254 INFO:teuthology.orchestra.run.smithi193.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:08:39.333 INFO:teuthology.orchestra.run.smithi193.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:08:39.334 INFO:teuthology.orchestra.run.smithi193.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:08:39.414 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:08:39.517 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:08:39.523 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:08:39.643 INFO:teuthology.orchestra.run.smithi193.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:08:39.671 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:08:40.041 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:08:40.067 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:08:40.107 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:08:40.207 INFO:teuthology.orchestra.run.smithi193.stdout:Fetched 243 MB in 8s (31.7 MB/s) 2024-09-12T17:08:40.368 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:08:40.380 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:08:40.395 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:08:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:08:40.480 INFO:teuthology.orchestra.run.smithi193.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:08:40.486 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:08:40.570 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:08:40.874 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:08:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:08:40.900 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:08:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:40.932 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:08:40.963 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:41.268 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:08:41.294 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:08:41.335 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:08:41.375 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:08:41.402 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:41.441 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:41.780 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:08:41.803 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:08:41.806 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:41.830 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:41.855 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:41.869 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:42.172 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:08:42.199 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:08:42.208 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:08:42.232 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:08:42.235 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:42.266 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:42.558 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2024-09-12T17:08:42.585 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:42.636 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:08:42.650 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:42.662 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:08:42.702 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:08:43.064 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:08:43.090 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:08:43.128 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:08:43.130 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:08:43.155 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:43.194 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.400 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librados2. 2024-09-12T17:08:43.427 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:43.458 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.639 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:08:43.665 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:43.705 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:43.982 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:08:43.998 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:44.041 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.153 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:08:44.179 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:44.219 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.335 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:08:44.362 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:44.401 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.680 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:08:44.687 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:08:44.703 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:44.706 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:44.746 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:44.747 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.042 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:08:45.048 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:08:45.068 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:45.069 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:45.107 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.108 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.394 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:08:45.420 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:45.461 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.468 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:08:45.495 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:08:45.535 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:08:45.713 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:08:45.739 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:45.779 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:45.821 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:08:45.848 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:08:45.879 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:08:46.091 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:08:46.117 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:08:46.149 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:46.173 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:08:46.200 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:46.240 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:46.460 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:08:46.487 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:08:46.552 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:08:46.593 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:08:46.619 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:08:46.659 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:08:46.863 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:08:46.890 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:08:46.930 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:08:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:08:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:08:47.011 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:08:47.207 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:08:47.222 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:47.265 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:47.297 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:08:47.314 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:08:47.347 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:08:47.569 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:08:47.595 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:08:47.627 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:08:47.684 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:08:47.711 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:08:47.750 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:08:47.896 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:08:47.911 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:08:47.954 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:08:48.070 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:08:48.086 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:08:48.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:08:48.259 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:08:48.286 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:08:48.326 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:08:48.340 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package zip. 2024-09-12T17:08:48.355 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:08:48.398 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:08:48.629 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:08:48.644 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:08:48.679 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:08:48.726 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package unzip. 2024-09-12T17:08:48.753 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:08:48.792 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:08:49.007 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:08:49.034 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:08:49.221 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:08:49.241 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:08:49.248 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:08:49.509 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package zip. 2024-09-12T17:08:49.536 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:08:49.538 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:08:49.576 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:08:49.871 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package unzip. 2024-09-12T17:08:49.879 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:08:49.897 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:08:49.906 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:49.937 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:49.937 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:08:50.307 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:08:50.334 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:08:50.374 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:08:50.506 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:08:50.522 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:50.564 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:50.773 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:08:50.800 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:50.839 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:50.892 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:08:50.919 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:08:50.958 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:08:51.278 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:08:51.305 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:51.344 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.451 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:08:51.466 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:51.509 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.706 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:08:51.733 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:51.764 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:51.820 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:08:51.835 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:08:51.869 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:08:52.156 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:08:52.183 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:52.222 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:52.651 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:08:52.677 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:52.726 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:53.269 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:08:53.296 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:53.345 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:53.940 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:08:53.967 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:08:54.006 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:08:54.206 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:08:54.232 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:08:54.282 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:08:54.310 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:08:54.336 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:08:54.375 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:08:54.729 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:08:54.756 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:08:54.795 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:08:54.893 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:08:54.909 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:08:54.976 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:08:55.098 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:08:55.125 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:08:55.165 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:08:55.304 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:08:55.330 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:08:55.371 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:08:55.417 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:08:55.433 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:08:55.467 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:08:55.690 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:08:55.717 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:08:55.757 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:08:55.761 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:08:55.789 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:08:55.837 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:08:56.060 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:08:56.086 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:08:56.126 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:08:56.173 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:08:56.200 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:08:56.239 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:08:56.396 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:08:56.422 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:08:56.454 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:08:56.500 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:08:56.516 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:08:56.550 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:08:56.748 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:08:56.775 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:08:56.815 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:08:56.820 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:08:56.847 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:08:56.886 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:08:57.118 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:08:57.144 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:08:57.184 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:08:57.231 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:08:57.258 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:08:57.298 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:08:57.479 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:08:57.505 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:08:57.545 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:08:57.559 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:08:57.576 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:08:57.609 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:08:57.798 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:08:57.824 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:08:57.864 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:08:57.878 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:08:57.905 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:08:57.945 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:08:58.193 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:08:58.220 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:08:58.248 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:08:58.259 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:08:58.275 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:08:58.314 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:08:58.546 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:08:58.561 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:08:58.596 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:08:58.651 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:08:58.678 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:08:58.717 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:08:58.890 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:08:58.919 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:08:58.957 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:08:59.012 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:08:59.039 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:08:59.079 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:08:59.269 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:08:59.295 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:08:59.335 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:08:59.382 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:08:59.409 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:08:59.448 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:08:59.813 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:08:59.839 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:08:59.879 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:08:59.890 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:08:59.918 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:08:59.996 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:09:00.207 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:09:00.234 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:09:00.273 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:09:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:09:00.330 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:09:00.370 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:09:00.534 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:09:00.561 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:09:00.601 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:09:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:09:00.700 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:09:00.739 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:09:00.929 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:09:00.956 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:09:00.999 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:09:01.067 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:09:01.094 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:09:01.134 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:09:01.307 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:09:01.334 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:09:01.373 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:09:01.436 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:09:01.465 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:09:01.503 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:09:01.676 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:09:01.703 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:09:01.751 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:09:01.806 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:09:01.833 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:09:01.873 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:09:02.070 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:09:02.086 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:09:02.129 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:09:02.175 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:09:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:09:02.233 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:09:02.431 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:09:02.458 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:09:02.498 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:09:02.588 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:09:02.615 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:09:02.646 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:09:02.817 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:09:02.844 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:09:02.910 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:09:02.974 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:09:03.001 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:09:03.041 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:09:03.188 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:09:03.214 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:09:03.245 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:09:03.360 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:09:03.387 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:09:03.427 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:09:03.566 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:09:03.593 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:09:03.624 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:09:03.746 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:09:03.762 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:09:03.805 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:09:03.936 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:09:03.963 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:09:04.002 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:09:04.330 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:09:04.357 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:09:04.383 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:09:04.396 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:09:04.410 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:09:04.716 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:09:04.743 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:09:04.783 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:09:04.858 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:09:05.103 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:09:05.129 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:09:05.169 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:09:05.319 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:09:05.346 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:05.386 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:05.774 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:09:05.801 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:05.840 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:06.177 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:09:06.204 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:09:06.243 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:09:06.255 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:09:06.279 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:06.322 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:06.546 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:09:06.573 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:09:06.612 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:09:06.710 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:09:06.737 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:06.776 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:06.907 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:09:06.934 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:06.965 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:07.104 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:09:07.131 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:09:07.171 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:09:07.343 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:09:07.371 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:07.410 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:07.457 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:09:07.483 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:09:07.523 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:09:07.843 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:09:07.870 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:07.910 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:07.997 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:09:08.024 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:08.063 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:08.296 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:09:08.323 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:08.362 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:08.974 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:09:09.001 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:09.040 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:09.141 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2024-09-12T17:09:09.168 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:09.207 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:09.460 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:09:09.487 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:09.527 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:09.905 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:09:09.932 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:09.971 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:10.252 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph. 2024-09-12T17:09:10.268 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:10.311 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:10.383 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:09:10.410 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:10.449 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:10.580 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:09:10.607 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:10.638 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:10.735 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:09:10.762 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:09:10.793 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:09:10.999 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:09:11.026 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:11.109 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:11.112 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:09:11.129 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:09:11.179 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:11.502 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:09:11.529 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:11.568 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:11.888 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:09:11.916 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:09:11.954 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:09:12.101 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:09:12.128 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:09:12.158 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:12.282 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:09:12.309 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:09:12.348 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:12.428 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:09:12.455 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:09:12.486 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:09:12.875 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:09:12.902 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:12.945 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:13.245 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:09:13.272 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:09:13.311 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:09:13.395 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:09:13.422 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:09:13.470 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:13.614 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:09:13.641 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:09:13.680 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:09:13.848 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:09:13.874 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:09:13.922 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:09:14.033 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:09:14.061 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:14.100 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:14.359 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:09:14.386 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:14.433 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:14.782 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:09:14.806 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:09:14.846 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:09:15.148 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:09:15.175 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:09:15.223 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:09:15.568 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:09:15.597 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:15.634 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:17.246 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:09:17.276 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:09:17.329 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:09:17.808 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:09:17.836 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:09:17.874 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:09:18.211 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:09:18.227 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:09:18.261 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:09:18.463 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:09:18.481 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:09:18.513 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:09:18.513 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:09:18.530 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:09:18.571 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:09:19.008 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:09:19.036 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:09:19.075 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:09:19.321 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:09:19.350 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:19.478 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:09:19.481 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:19.507 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:09:19.545 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:09:19.822 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:09:19.850 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:09:19.880 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:09:20.377 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:09:20.406 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:09:20.443 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:09:20.754 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:09:20.783 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:09:20.814 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:09:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:09:20.830 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:20.949 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:21.108 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:09:21.124 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:09:21.157 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:09:21.418 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:09:21.435 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:09:21.468 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:09:21.772 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:09:21.800 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:09:21.838 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:09:21.936 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:09:21.964 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:09:22.003 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:09:22.158 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:09:22.187 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:09:22.225 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:09:22.289 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:09:22.317 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:09:22.357 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:09:22.562 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:09:22.589 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:09:22.627 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:09:22.708 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:09:22.736 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:09:22.775 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:09:22.939 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:09:22.969 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:09:23.005 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:09:23.103 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:09:23.130 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:09:23.169 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:09:23.456 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:09:23.484 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:09:23.523 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:09:23.720 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:09:23.746 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:23.786 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:23.851 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:09:23.879 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:09:23.917 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:09:24.122 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:09:24.150 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:09:24.187 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:09:24.188 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:09:24.215 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:09:24.245 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:09:24.515 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:09:24.543 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:09:24.566 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:09:24.581 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:09:24.595 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:09:24.641 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:09:24.953 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2024-09-12T17:09:25.397 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:09:25.397 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:25.397 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:25.398 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:09:25.398 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:09:25.398 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2024-09-12T17:09:25.398 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:09:25.398 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:09:25.758 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:09:25.764 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:09:25.774 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:09:25.793 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:09:25.816 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:09:25.822 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:09:26.153 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:09:26.167 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:09:26.170 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:26.195 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:09:26.203 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:26.234 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:09:26.495 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package jq. 2024-09-12T17:09:26.511 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:09:26.553 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:09:26.789 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package socat. 2024-09-12T17:09:26.805 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:09:26.839 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:09:27.100 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:09:27.116 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:09:27.158 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:09:27.573 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:09:27.589 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:27.631 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:28.575 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:09:28.603 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:28.641 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:28.970 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:09:28.998 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:29.036 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:29.380 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:09:29.409 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:09:29.446 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:09:29.793 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:09:29.821 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:09:29.868 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:09:29.885 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:09:29.913 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:09:29.951 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:30.264 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:09:30.280 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:30.314 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:09:30.322 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:30.342 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:09:30.388 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:09:30.625 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:09:30.652 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:09:30.691 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:09:30.902 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:09:30.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:09:30.976 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:09:31.021 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:09:31.049 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:09:31.112 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:09:31.254 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:09:31.271 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:09:31.312 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:09:31.407 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:09:31.423 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:09:31.466 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:09:31.757 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:09:31.786 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:09:31.823 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:09:31.887 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:09:31.915 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:09:31.954 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:09:32.135 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:09:32.164 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:09:32.201 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:09:32.215 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:09:32.231 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:09:32.273 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:09:32.563 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:09:32.591 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:09:32.629 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:09:32.668 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:09:32.696 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:09:32.734 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:09:32.924 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:09:32.952 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:09:32.990 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:09:33.045 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:09:33.073 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:09:33.112 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:09:33.327 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:09:33.355 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:09:33.401 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:09:33.407 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:09:33.435 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:09:33.465 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:09:33.701 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:09:33.717 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:09:33.721 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:09:33.750 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:09:33.751 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:09:33.788 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:09:34.062 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:09:34.079 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:09:34.112 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:09:34.242 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:09:34.259 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:09:34.292 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:09:34.441 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:09:34.469 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:09:34.507 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:09:34.578 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:09:34.606 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:09:34.644 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:09:34.947 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:09:34.961 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:09:34.976 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:09:34.989 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:09:35.013 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:09:35.027 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:09:35.325 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:09:35.354 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:09:35.355 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:09:35.383 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:09:35.391 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:09:35.421 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:09:35.653 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:09:35.681 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:09:35.708 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:09:35.719 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:09:35.736 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:09:35.765 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:09:36.369 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:09:36.397 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:09:36.435 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:09:36.548 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:09:36.577 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:36.623 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:36.722 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:09:36.750 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:09:36.788 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:09:37.542 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:09:37.570 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:37.608 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:37.609 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:09:37.638 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:37.684 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:37.997 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:09:38.255 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:09:38.381 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:09:38.544 INFO:teuthology.orchestra.run.smithi193.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:09:38.561 INFO:teuthology.orchestra.run.smithi193.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:09:38.602 INFO:teuthology.orchestra.run.smithi193.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:38.649 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:09:38.899 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:09:38.993 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:09:39.132 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:09:39.258 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:09:39.401 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:09:39.520 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:09:39.692 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:39.879 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:09:40.176 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2024-09-12T17:09:40.332 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:09:40.338 INFO:teuthology.orchestra.run.smithi193.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:09:40.444 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:09:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:09:40.960 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:09:41.253 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:09:41.352 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user cephadm....done 2024-09-12T17:09:41.517 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:09:41.520 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:09:41.647 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:09:41.802 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:09:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:09:42.045 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:09:42.179 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:09:42.447 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:09:42.559 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:09:42.715 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:09:42.818 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:09:42.849 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:09:43.094 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:09:43.159 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:09:43.354 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:09:43.519 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:09:43.622 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:09:43.762 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:09:43.906 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:09:44.073 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:09:44.141 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:44.331 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:09:44.383 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:09:44.509 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:09:44.582 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:09:44.635 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:09:44.761 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:09:45.009 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:09:45.020 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:09:45.259 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:45.395 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:09:45.419 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:09:45.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:09:45.513 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:09:45.600 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:09:45.620 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:09:45.721 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:09:45.847 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:09:45.959 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:46.085 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:09:46.106 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:09:46.369 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:09:46.514 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:09:46.563 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:09:46.626 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:09:46.646 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:09:46.752 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:09:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:09:47.097 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:09:47.103 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:47.204 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:09:47.455 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:09:47.714 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:09:47.808 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:09:48.049 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:09:48.076 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:09:48.175 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:09:48.202 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:09:48.328 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:09:48.637 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:09:48.877 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:09:49.038 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:09:49.111 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:09:49.221 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:09:49.272 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:09:49.347 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:09:49.639 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:09:49.674 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:09:49.967 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:09:50.032 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:09:50.291 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:09:50.310 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:09:50.561 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:09:50.684 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:09:50.687 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:50.969 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:09:50.997 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:09:51.314 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:09:51.329 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:09:51.880 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:09:52.006 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:09:52.332 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:09:52.553 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:09:52.658 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:09:52.804 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:09:52.939 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:09:53.215 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:09:53.316 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:09:53.417 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:09:53.701 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:09:53.863 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:09:53.969 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:09:54.106 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:09:54.220 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:09:54.241 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:09:54.346 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:09:54.509 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:09:54.634 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:09:54.681 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:09:54.745 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:09:54.940 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:09:55.020 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:09:55.216 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:09:55.288 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:09:55.451 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:09:55.539 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:09:55.665 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:09:55.701 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:09:55.966 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:09:56.018 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:09:56.103 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:09:56.259 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:09:56.388 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:09:56.510 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:09:56.514 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:09:56.761 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:09:56.806 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:09:57.004 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:09:57.108 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:09:57.263 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:09:57.342 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:09:57.389 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:09:57.453 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:09:57.577 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:57.667 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:09:57.682 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:09:57.808 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:09:58.092 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:09:58.112 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:09:58.247 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:09:58.393 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:09:58.628 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:09:58.640 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:09:58.737 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:09:58.863 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:09:58.899 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:09:58.952 INFO:teuthology.orchestra.run.smithi193.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:09:59.000 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:09:59.190 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:09:59.243 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:09:59.316 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:09:59.386 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:09:59.700 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:09:59.737 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:09:59.968 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:10:00.063 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:10:00.069 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:10:00.295 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:10:00.347 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:10:00.421 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:10:00.473 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:10:00.732 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:10:00.738 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:10:01.002 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:10:01.040 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:10:01.316 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:10:01.356 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:10:01.442 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:10:01.709 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:10:01.741 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:10:01.952 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:10:02.017 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:10:02.297 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:10:02.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:10:02.496 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:02.622 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:02.699 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:10:02.748 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:10:02.984 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:10:03.034 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.169 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.295 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:10:03.328 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:10:03.446 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.572 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.597 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.698 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:10:03.722 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:03.865 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.034 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:10:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:10:04.160 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.261 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:10:04.537 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.542 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.642 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.663 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.760 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.789 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:04.886 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:10:05.000 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:10:05.000 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:10:05.491 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:05.617 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:05.760 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:05.861 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:10:06.190 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:06.291 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:06.392 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:06.518 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:06.653 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.010 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.128 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.195 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2024-09-12T17:10:07.254 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.380 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.514 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2024-09-12T17:10:07.539 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:07.691 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2024-09-12T17:10:07.706 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:10:07.850 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:10:08.073 INFO:teuthology.orchestra.run.smithi193.stdout:Adding group ceph....done 2024-09-12T17:10:08.177 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:10:08.459 INFO:teuthology.orchestra.run.smithi193.stdout:Adding system user ceph....done 2024-09-12T17:10:08.627 INFO:teuthology.orchestra.run.smithi193.stdout:Setting system user ceph properties....done 2024-09-12T17:10:08.637 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:08.642 INFO:teuthology.orchestra.run.smithi193.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:10:08.763 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:08.775 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:10:09.109 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:10:09.246 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:10:09.246 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:10:09.590 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:09.707 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:09.716 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:10.040 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:10:10.191 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:10:10.191 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:10:10.484 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:10.693 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:10.717 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:10:10.717 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:10:11.043 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:10:11.203 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:11.432 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:10:11.432 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:10:11.561 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:11.765 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:10:11.765 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:10:11.920 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:12.197 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:10:12.197 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:10:12.271 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:12.471 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:10:12.472 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:10:12.722 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:12.848 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:12.964 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:12.974 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:13.181 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:10:13.181 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:10:13.234 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:10:13.234 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:10:13.651 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:13.749 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:13.794 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:13.875 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:13.920 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:14.026 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:14.071 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:14.237 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:10:14.238 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:10:14.449 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:10:14.558 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:10:14.694 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:10:14.711 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:14.853 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:14.954 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:15.089 INFO:teuthology.orchestra.run.smithi193.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:10:15.458 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:10:15.559 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:10:15.728 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:10:15.870 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:10:16.511 INFO:teuthology.orchestra.run.smithi193.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:10:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:10:16.539 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:17.155 INFO:teuthology.orchestra.run.smithi193.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:10:17.159 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:17.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:10:17.307 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:10:17.326 INFO:teuthology.orchestra.run.smithi062.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:10:17.327 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:10:17.327 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:10:17.329 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:10:17.478 DEBUG:teuthology.orchestra.run.smithi193:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:10:17.497 INFO:teuthology.orchestra.run.smithi193.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:10:17.497 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:10:17.498 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:10:17.499 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:10:17.500 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:17.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:10:17.514 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:17.515 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:10:17.551 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:10:17.551 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:17.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:10:17.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:10:17.625 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:17.626 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:10:17.639 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:10:17.693 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:10:17.694 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:17.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:10:17.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:10:17.762 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:17.763 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:10:17.775 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:10:17.830 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:10:17.830 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:17.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:10:17.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:10:17.902 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:17.902 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:10:17.915 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:10:17.972 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:10:18.057 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:10:18.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-09-12T17:10:18.060 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /var/log/ceph 2024-09-12T17:10:18.073 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:10:18.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:10:18.115 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:10:18.127 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:10:18.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:10:18.171 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:10:18.191 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:10:18.192 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:10:18.192 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7902709', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNZ1ybRrb5hFtspgOjvhgGXn/O1GtTRgw6Ay0heuUhHMFsXR7Y1SVWge5axPOiEbrqm+7cWJWz5HWhSmySg9RpM=', 'smithi193.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEYCdYnzTskWUTRcetTY8oKIwp4i59nPDFh0eLcI+n4SVWrc+Evp1LqXYetY9EosZFAs2Ab2WDLwunv7a2T7fD8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:10:18.192 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:10:18.228 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:10:18.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:10:18.276 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:10:18.291 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:18.291 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:10:18.335 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:10:18.335 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 875 Links: 1 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 17:04:47.101779414 +0000 2024-09-12T17:10:18.383 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 17:04:47.097779449 +0000 2024-09-12T17:10:18.384 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 17:04:47.097779449 +0000 2024-09-12T17:10:18.384 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-12T17:10:18.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:10:18.437 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T17:10:18.437 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T17:10:18.437 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000385535 s, 1.3 MB/s 2024-09-12T17:10:18.439 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:10:18.490 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-12T17:10:18.538 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:10:18.538 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:18.539 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T17:10:18.539 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:18.539 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 17:04:47.869772553 +0000 2024-09-12T17:10:18.540 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 17:04:47.609774875 +0000 2024-09-12T17:10:18.540 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 17:04:47.609774875 +0000 2024-09-12T17:10:18.540 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-12T17:10:18.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:10:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T17:10:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T17:10:18.593 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000416747 s, 1.2 MB/s 2024-09-12T17:10:18.595 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:10:18.644 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-12T17:10:18.692 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 17:04:48.365768123 +0000 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 17:04:48.109770410 +0000 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 17:04:48.109770410 +0000 2024-09-12T17:10:18.693 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-12T17:10:18.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:10:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T17:10:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T17:10:18.746 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000449221 s, 1.1 MB/s 2024-09-12T17:10:18.747 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:10:18.796 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-12T17:10:18.842 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 17:04:48.901763336 +0000 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 17:04:48.613765908 +0000 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 17:04:48.613765908 +0000 2024-09-12T17:10:18.843 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-09-12T17:10:18.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:10:18.898 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T17:10:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T17:10:18.899 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000285566 s, 1.8 MB/s 2024-09-12T17:10:18.900 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:10:18.948 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T17:10:18.948 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:18.948 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:10:18.954 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:10:18.954 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-12T17:10:19.004 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:10:19.004 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:19.004 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-12T17:10:19.004 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:19.004 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-12 17:04:45.101480985 +0000 2024-09-12T17:10:19.005 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-12 17:04:44.845483271 +0000 2024-09-12T17:10:19.005 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-12 17:04:44.845483271 +0000 2024-09-12T17:10:19.005 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-09-12T17:10:19.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:10:19.057 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-12T17:10:19.057 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-12T17:10:19.057 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000447159 s, 1.1 MB/s 2024-09-12T17:10:19.058 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:10:19.108 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-12 17:04:45.597476555 +0000 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-12 17:04:45.329478948 +0000 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-12 17:04:45.329478948 +0000 2024-09-12T17:10:19.155 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-09-12T17:10:19.156 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:10:19.209 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-12T17:10:19.209 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-12T17:10:19.209 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000344429 s, 1.5 MB/s 2024-09-12T17:10:19.210 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:10:19.264 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-12 17:04:46.093472123 +0000 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-12 17:04:45.853474267 +0000 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-12 17:04:45.853474267 +0000 2024-09-12T17:10:19.311 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-09-12T17:10:19.311 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:10:19.365 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-12T17:10:19.365 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-12T17:10:19.365 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000408617 s, 1.3 MB/s 2024-09-12T17:10:19.368 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:10:19.417 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-12T17:10:19.462 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-12 17:04:46.585467729 +0000 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-12 17:04:46.345469873 +0000 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-12 17:04:46.345469873 +0000 2024-09-12T17:10:19.463 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: - 2024-09-12T17:10:19.463 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:10:19.517 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-12T17:10:19.517 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-12T17:10:19.518 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000386737 s, 1.3 MB/s 2024-09-12T17:10:19.518 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:10:19.568 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:10:19.568 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T17:10:19.568 INFO:tasks.ceph:Generating config... 2024-09-12T17:10:19.569 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T17:10:19.569 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-12T17:10:19.569 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T17:10:19.569 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T17:10:19.569 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T17:10:19.569 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:10:19.570 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:10:19.571 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:10:19.571 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:10:19.571 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:10:19.571 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:10:19.571 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:10:19.571 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:10:19.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:10:19.606 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:10:19.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:10:19.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:10:19.755 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62')] 2024-09-12T17:10:19.755 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-12T17:10:19.756 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:19.756 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:10:19.802 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:19.883 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 198a6104-5b15-4a13-a23d-e0904a8cd750 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 198a6104-5b15-4a13-a23d-e0904a8cd750 2024-09-12T17:10:19.884 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-09-12T17:10:19.885010+0000 2024-09-12T17:10:19.885 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T17:10:19.885010+0000 2024-09-12T17:10:19.885 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-09-12T17:10:19.885 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-09-12T17:10:19.885 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T17:10:19.885 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-12T17:10:19.886 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:10:19.934 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 198a6104-5b15-4a13-a23d-e0904a8cd750... 2024-09-12T17:10:19.935 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:10:19.979 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:10:20.009 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-12T17:10:20.009 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-09-12T17:10:20.009 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:10:20.009 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-09-12T17:10:20.009 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.010 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:10:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = 172.21.15.62 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 198a6104-5b15-4a13-a23d-e0904a8cd750 2024-09-12T17:10:20.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-09-12T17:10:20.013 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.014 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: debug objclass = 20 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-09-12T17:10:20.015 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-09-12T17:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T17:10:20.017 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:10:20.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: rgw gc obj min wait = 15 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw = 20 2024-09-12T17:10:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: setgroup = ceph 2024-09-12T17:10:20.020 INFO:teuthology.orchestra.run.smithi062.stdout: setuser = ceph 2024-09-12T17:10:20.020 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-09-12T17:10:20.020 INFO:teuthology.orchestra.run.smithi193.stdout:[global] 2024-09-12T17:10:20.020 INFO:teuthology.orchestra.run.smithi193.stdout: chdir = "" 2024-09-12T17:10:20.020 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: auth supported = cephx 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: filestore xattr use omap = true 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: mon clock drift allowed = 1.000 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: osd crush chooseleaf type = 0 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: auth debug = true 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on old message = true 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on bug = true 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:10:20.021 INFO:teuthology.orchestra.run.smithi193.stdout: mon pg warn max object skew = 0 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default size = 2 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow primary affinity = true 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow pg remap = true 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on no sortbitwise = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on too few osds = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:10:20.022 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: mon_allow_pool_size_one = true 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: osd default data pool replay window = 5 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: mon allow pool delete = true 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: mon cluster log file level = debug 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: debug asserts on shutdown = true 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: mon health detail to clog = false 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: mon host = 172.21.15.62 2024-09-12T17:10:20.023 INFO:teuthology.orchestra.run.smithi193.stdout: fsid = 198a6104-5b15-4a13-a23d-e0904a8cd750 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout:[osd] 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd journal size = 100 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub load threshold = 5.0 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub max interval = 600 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd recover clone overlap = true 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd recovery max chunk = 1048576 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.024 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug shutdown = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug op order = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug verify stray on activate = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug trim objects = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd open classes on start = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug pg log writeout = true 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.025 INFO:teuthology.orchestra.run.smithi193.stdout: osd map max advance = 10 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: journal zero on create = true 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: filestore apply finisher threads = 3 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: bdev debug aio = true 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug misdirected ops = true 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: debug objclass = 20 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: bdev async discard = True 2024-09-12T17:10:20.026 INFO:teuthology.orchestra.run.smithi193.stdout: bdev enable discard = True 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore allocator = bitmap 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore block size = 96636764160 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore fsck on mount = True 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluefs = 1/20 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluestore = 1/20 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: debug osd = 20 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: debug rocksdb = 4/10 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd full ratio = 0.9 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:10:20.027 INFO:teuthology.orchestra.run.smithi193.stdout: osd objectstore = bluestore 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr] 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: debug mgr = 20 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: mgr/telemetry/nag = false 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout:[mon] 2024-09-12T17:10:20.028 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: debug paxos = 20 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon data avail warn = 5 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon mgr mkfs grace = 240 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd reporter subtree level = osd 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd prime pg temp = true 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:10:20.029 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: # 1m isn't quite enough 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout:[client] 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: rgw cache enabled = true 2024-09-12T17:10:20.030 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable ops log = true 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable usage log = true 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: rgw gc obj min wait = 15 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: debug rgw = 20 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: setgroup = ceph 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout: setuser = ceph 2024-09-12T17:10:20.031 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.a] 2024-09-12T17:10:20.032 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:10:20.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:10:20.124 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:10:20.124 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:20.124 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:10:20.130 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:20.130 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:10:20.178 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T17:10:20.178 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:20.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:10:20.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:10:20.243 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:20.243 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:20.291 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:10:20.291 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:20.291 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:10:20.291 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:10:20.314 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:20.314 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:20.362 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:10:20.363 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:10:20.363 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:10:20.446 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:10:20.456 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:10:20.456 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:10:20.456 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:10:20.530 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:10:20.540 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:10:20.540 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-12T17:10:20.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:10:20.555 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-12T17:10:20.555 INFO:tasks.ceph:role: osd.0 2024-09-12T17:10:20.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T17:10:20.555 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:10:20.619 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:10:20.620 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:10:21.110 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-12T17:10:21.112 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-12T17:10:21.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:10:21.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:10:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:10:21.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:21.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:21.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:21.376+0000 7f8630de77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:10:21.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:21.376+0000 7f8630de77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:10:21.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:21.376+0000 7f8630de77c0 -1 bdev(0x565513207800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:10:21.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:21.376+0000 7f8630de77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:10:24.531 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:10:24.545 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:10:24.560 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:10:24.560 INFO:tasks.ceph:role: osd.1 2024-09-12T17:10:24.560 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:10:24.560 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:10:24.622 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:10:24.622 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:10:24.622 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:10:24.622 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:10:24.622 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:10:24.623 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:10:24.623 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:10:24.623 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:10:24.623 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:10:24.623 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:10:25.078 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-12T17:10:25.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-12T17:10:25.081 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-12T17:10:25.174 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:10:25.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:25.184 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:10:25.185 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:10:25.235 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:10:25.236 INFO:tasks.ceph:role: osd.2 2024-09-12T17:10:25.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:10:25.236 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:10:25.298 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:10:25.299 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:10:25.763 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-12T17:10:25.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-12T17:10:25.766 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-12T17:10:25.885 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:10:25.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:25.897 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:10:25.897 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:10:25.949 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-12T17:10:25.949 INFO:tasks.ceph:role: osd.3 2024-09-12T17:10:25.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:10:25.949 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:10:26.009 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:10:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:10:26.009 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:10:26.010 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:10:26.491 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-12T17:10:26.493 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-12T17:10:26.493 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-12T17:10:26.654 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:10:26.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:10:26.693 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:26.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:26.800+0000 7faaa91ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:10:26.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:26.800+0000 7faaa91ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:10:26.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:26.800+0000 7faaa91ea7c0 -1 bdev(0x56547fa5b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:10:26.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:26.800+0000 7faaa91ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:10:30.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:10:30.019 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:30.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:30.096+0000 7f62cef4e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:10:30.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:30.096+0000 7f62cef4e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:10:30.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:30.096+0000 7f62cef4e7c0 -1 bdev(0x55d09782b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:10:30.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:30.096+0000 7f62cef4e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:10:33.238 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:10:33.296 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:33.372+0000 7faf8bd987c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:10:33.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:33.372+0000 7faf8bd987c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:10:33.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:33.376+0000 7faf8bd987c0 -1 bdev(0x562a122e7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:10:33.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:33.376+0000 7faf8bd987c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:10:36.521 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:10:36.578 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:10:36.578 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:36.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:10:36.593 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:36.593 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:10:36.632 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:36.633 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:10:36.684 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:36.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:10:36.737 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:36.737 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:10:36.793 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:36.793 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:10:36.838 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:10:36.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:10:36.850 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-09-12T17:10:36.850 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB9IONmQZWpFhAA04AZI6UsSt09p4opHDV22g== 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB8IONmRWmlGhAAc36xyMHS2pSxrp0OrOma8Q== 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCCIONmynzxLxAAFrw6loMmAgWkNY2NrIqnqw== 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCGIONmP9sRBhAA1vdNMd5g7tPwisZilvm1Ew== 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCJIONmVv6JFhAAfBXLXpzKlPL4QLKDeHQZSQ== 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-12T17:10:36.851 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB8IONmrqGlHxAA2fw5bRwxMgnHiMrmePhQ9g== 2024-09-12T17:10:36.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:36.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:10:36.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:37.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:37.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:10:37.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:10:37.289 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:10:37.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:10:37.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:10:37.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:10:37.450 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:10:37.497 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:10:37.498 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:10:37.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:10:37.543 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:10:37.543 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:10:37.544 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:10:37.544 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:10:37.547 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:10:37.548 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:10:37.548 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:10:37.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:10:37.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f213ded8640 1 Processor -- start 2024-09-12T17:10:37.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f213ded8640 1 -- start start 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f213ded8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f213ded8640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2138099d90 con 0x7f213812fdd0 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f213ded8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f213809bcb0 con 0x7f213812f4b0 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f2136ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f213812fdd0 0x7f2138099680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:54600/0 (socket says 172.21.15.62:54600) 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35344/0 (socket says 172.21.15.62:35344) 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f2136ffd640 1 -- 172.21.15.62:0/644714650 learned_addr learned my addr 172.21.15.62:0/644714650 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:37.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 -- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 msgr2=0x7f213812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T17:10:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 -- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 msgr2=0x7f213812f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T17:10:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 --2- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T17:10:37.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.668+0000 7f21377fe640 1 --2- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T17:10:37.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417081073 0 0) 0x7f2138099d90 con 0x7f213812fdd0 2024-09-12T17:10:37.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2120003530 con 0x7f213812fdd0 2024-09-12T17:10:37.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1955377391 0 0) 0x7f2120003530 con 0x7f213812fdd0 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 msgr2=0x7f213812f890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 --2- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138099f60 con 0x7f213812fdd0 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1907683638 0 0) 0x7f212c001630 con 0x7f213812fdd0 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 >> v1:172.21.15.62:6789/0 conn(0x7f213812fdd0 legacy=0x7f2138099680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 --2- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f2120003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2120004620 con 0x7f2120003ab0 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21377fe640 1 --2- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f2120003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:37.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.680+0000 7f21377fe640 1 -- 172.21.15.62:0/644714650 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2120003530 con 0x7f2120003ab0 2024-09-12T17:10:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f21377fe640 1 --2- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f2120003eb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f212800c7a0 tx=0x7f212801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a4db2249ccc4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f212800f040 con 0x7f2120003ab0 2024-09-12T17:10:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21280a6570 con 0x7f2120003ab0 2024-09-12T17:10:37.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f21367fc640 1 -- 172.21.15.62:0/644714650 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21280a6890 con 0x7f2120003ab0 2024-09-12T17:10:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 msgr2=0x7f2120003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 --2- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f2120003eb0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f212800c7a0 tx=0x7f212801c5d0 comp rx=0 tx=0).stop 2024-09-12T17:10:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- 172.21.15.62:0/644714650 shutdown_connections 2024-09-12T17:10:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 --2- 172.21.15.62:0/644714650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f2120003eb0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:37.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 --2- 172.21.15.62:0/644714650 >> v2:172.21.15.62:3300/0 conn(0x7f213812f4b0 0x7f213812f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- 172.21.15.62:0/644714650 >> 172.21.15.62:0/644714650 conn(0x7f21380a0010 msgr2=0x7f21380a03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- 172.21.15.62:0/644714650 shutdown_connections 2024-09-12T17:10:37.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- 172.21.15.62:0/644714650 wait complete. 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 Processor -- start 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.696+0000 7f213ded8640 1 -- start start 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f213ded8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f213ded8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f213809ad60 con 0x7f2120003ab0 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f21377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:37.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f21377fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35358/0 (socket says 172.21.15.62:35358) 2024-09-12T17:10:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f21377fe640 1 -- 172.21.15.62:0/1128394288 learned_addr learned my addr 172.21.15.62:0/1128394288 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:37.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f21377fe640 1 -- 172.21.15.62:0/1128394288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2138073d60 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f21377fe640 1 --2- 172.21.15.62:0/1128394288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f21280191e0 tx=0x7f2120005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21280a6cf0 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21280b6070 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21280ba460 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2138129980 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2138127710 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f21280c1060 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21280c34e0 con 0x7f2120003ab0 2024-09-12T17:10:37.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.700+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2138076880 con 0x7f2120003ab0 2024-09-12T17:10:37.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.704+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f21280c8020 con 0x7f2120003ab0 2024-09-12T17:10:37.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.768+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f213812fdd0 con 0x7f2120003ab0 2024-09-12T17:10:37.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.768+0000 7f211ffff640 1 -- 172.21.15.62:0/1128394288 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f21280ac030 con 0x7f2120003ab0 2024-09-12T17:10:37.773 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-09-12T17:10:37.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 msgr2=0x7f21381271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:37.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 --2- 172.21.15.62:0/1128394288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f21280191e0 tx=0x7f2120005840 comp rx=0 tx=0).stop 2024-09-12T17:10:37.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 shutdown_connections 2024-09-12T17:10:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 --2- 172.21.15.62:0/1128394288 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2120003ab0 0x7f21381271d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 >> 172.21.15.62:0/1128394288 conn(0x7f21380a0010 msgr2=0x7f21381341d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 shutdown_connections 2024-09-12T17:10:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:37.772+0000 7f213ded8640 1 -- 172.21.15.62:0/1128394288 wait complete. 2024-09-12T17:10:37.791 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:10:37.792 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:10:37.792 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T17:10:37.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:10:37.801 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:37.802 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:10:37.816 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:37.816 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:10:37.871 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-12T17:10:37.871 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:10:37.925 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new fe207eab-874b-4cab-b0b9-bad98e2ff8b7 0 2024-09-12T17:10:38.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1e184b640 1 Processor -- start 2024-09-12T17:10:38.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1e184b640 1 -- start start 2024-09-12T17:10:38.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1e184b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1dc114790 0x7fb1dc114b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1e184b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1dc115260 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1e184b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb1dc06dd90 con 0x7fb1dc114790 2024-09-12T17:10:38.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1daffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1dc114790 0x7fb1dc114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1da7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb1dc06d1f0 0x7fb1dc06d680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:58860/0 (socket says 172.21.15.193:58860) 2024-09-12T17:10:38.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.084+0000 7fb1da7fc640 1 -- 172.21.15.193:0/1831786353 learned_addr learned my addr 172.21.15.193:0/1831786353 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:10:38.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1daffd640 1 -- 172.21.15.193:0/1831786353 >> v1:172.21.15.62:6789/0 conn(0x7fb1dc06d1f0 legacy=0x7fb1dc06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1daffd640 1 -- 172.21.15.193:0/1831786353 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc06df40 con 0x7fb1dc114790 2024-09-12T17:10:38.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1daffd640 1 --2- 172.21.15.193:0/1831786353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc114790 0x7fb1dc114b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009740 tx=0x7fb1d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1647f48942ef64c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1d9ffb640 1 -- 172.21.15.193:0/1831786353 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d40b1070 con 0x7fb1dc114790 2024-09-12T17:10:38.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1d9ffb640 1 -- 172.21.15.193:0/1831786353 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40ac520 con 0x7fb1dc114790 2024-09-12T17:10:38.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1d9ffb640 1 -- 172.21.15.193:0/1831786353 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d40ac820 con 0x7fb1dc114790 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 -- 172.21.15.193:0/1831786353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc114790 msgr2=0x7fb1dc114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 --2- 172.21.15.193:0/1831786353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc114790 0x7fb1dc114b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4009740 tx=0x7fb1d401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 -- 172.21.15.193:0/1831786353 shutdown_connections 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 --2- 172.21.15.193:0/1831786353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc114790 0x7fb1dc114b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 -- 172.21.15.193:0/1831786353 >> 172.21.15.193:0/1831786353 conn(0x7fb1dc070d50 msgr2=0x7fb1dc073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 -- 172.21.15.193:0/1831786353 shutdown_connections 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 -- 172.21.15.193:0/1831786353 wait complete. 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.088+0000 7fb1e184b640 1 Processor -- start 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 -- start start 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1dc11f2e0 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1daffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47716/0 (socket says 172.21.15.193:47716) 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1daffd640 1 -- 172.21.15.193:0/347447003 learned_addr learned my addr 172.21.15.193:0/347447003 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1daffd640 1 -- 172.21.15.193:0/347447003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1dc1aa420 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1daffd640 1 --2- 172.21.15.193:0/347447003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401aa20 tx=0x7fb1d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d40b1050 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1d40b2040 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1dc1aa6b0 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1d40aba40 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1dc1af690 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb1d40bf030 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb1d40bd070 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.092+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1dc114bf0 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.100+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb1d40c6060 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.172+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe207eab-874b-4cab-b0b9-bad98e2ff8b7", "id": 0} v 0) -- 0x7fb1dc114790 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.172+0000 7fb1c3fff640 1 -- 172.21.15.193:0/347447003 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe207eab-874b-4cab-b0b9-bad98e2ff8b7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb1d40a9070 con 0x7fb1dc06d1f0 2024-09-12T17:10:38.177 INFO:teuthology.orchestra.run.smithi193.stdout:0 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 msgr2=0x7fb1dc1a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 --2- 172.21.15.193:0/347447003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb1d401aa20 tx=0x7fb1d401abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 shutdown_connections 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 --2- 172.21.15.193:0/347447003 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1dc06d1f0 0x7fb1dc1a9e50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 >> 172.21.15.193:0/347447003 conn(0x7fb1dc070d50 msgr2=0x7fb1dc113220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 shutdown_connections 2024-09-12T17:10:38.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.176+0000 7fb1e184b640 1 -- 172.21.15.193:0/347447003 wait complete. 2024-09-12T17:10:38.194 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new ea19089e-ce25-40ca-aff9-7c73315bb51e 1 2024-09-12T17:10:38.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd9daf0640 1 Processor -- start 2024-09-12T17:10:38.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd9daf0640 1 -- start start 2024-09-12T17:10:38.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd9daf0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbd98110050 0x7fbd98110430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd9daf0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd98110b50 con 0x7fbd981153e0 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd9daf0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbd98115f80 con 0x7fbd98110050 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd977fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbd98110050 0x7fbd98110430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd977fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbd98110050 0x7fbd98110430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47722/0 (socket says 172.21.15.193:47722) 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.312+0000 7fbd977fe640 1 -- 172.21.15.193:0/3113597866 learned_addr learned my addr 172.21.15.193:0/3113597866 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd977fe640 1 -- 172.21.15.193:0/3113597866 >> v1:172.21.15.62:6789/0 conn(0x7fbd981153e0 legacy=0x7fbd98115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd977fe640 1 -- 172.21.15.193:0/3113597866 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd98116130 con 0x7fbd98110050 2024-09-12T17:10:38.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd977fe640 1 --2- 172.21.15.193:0/3113597866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd98110430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000ba90 tx=0x7fbd9001eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5e775896638507 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd967fc640 1 -- 172.21.15.193:0/3113597866 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd900b4070 con 0x7fbd98110050 2024-09-12T17:10:38.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd967fc640 1 -- 172.21.15.193:0/3113597866 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd900a7a00 con 0x7fbd98110050 2024-09-12T17:10:38.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd967fc640 1 -- 172.21.15.193:0/3113597866 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd900a7d00 con 0x7fbd98110050 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 -- 172.21.15.193:0/3113597866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 msgr2=0x7fbd98110430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 --2- 172.21.15.193:0/3113597866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd98110430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000ba90 tx=0x7fbd9001eae0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 -- 172.21.15.193:0/3113597866 shutdown_connections 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 --2- 172.21.15.193:0/3113597866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd98110430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 -- 172.21.15.193:0/3113597866 >> 172.21.15.193:0/3113597866 conn(0x7fbd98070d50 msgr2=0x7fbd98073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 -- 172.21.15.193:0/3113597866 shutdown_connections 2024-09-12T17:10:38.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.316+0000 7fbd9daf0640 1 -- 172.21.15.193:0/3113597866 wait complete. 2024-09-12T17:10:38.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 Processor -- start 2024-09-12T17:10:38.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 -- start start 2024-09-12T17:10:38.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9806df30 con 0x7fbd98110050 2024-09-12T17:10:38.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd977fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47726/0 (socket says 172.21.15.193:47726) 2024-09-12T17:10:38.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd977fe640 1 -- 172.21.15.193:0/2758747747 learned_addr learned my addr 172.21.15.193:0/2758747747 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd977fe640 1 -- 172.21.15.193:0/2758747747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd981a61f0 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd977fe640 1 --2- 172.21.15.193:0/2758747747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd9001c710 tx=0x7fbd9001b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd900be070 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd981a6480 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd900afd30 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd900b4040 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd981ab460 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd900c1070 con 0x7fbd98110050 2024-09-12T17:10:38.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbd900c3800 con 0x7fbd98110050 2024-09-12T17:10:38.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.320+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd981104b0 con 0x7fbd98110050 2024-09-12T17:10:38.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.328+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbd90018760 con 0x7fbd98110050 2024-09-12T17:10:38.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.400+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea19089e-ce25-40ca-aff9-7c73315bb51e", "id": 1} v 0) -- 0x7fbd981153e0 con 0x7fbd98110050 2024-09-12T17:10:38.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd8ffff640 1 -- 172.21.15.193:0/2758747747 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea19089e-ce25-40ca-aff9-7c73315bb51e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbd900a79d0 con 0x7fbd98110050 2024-09-12T17:10:38.407 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 msgr2=0x7fbd981a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 --2- 172.21.15.193:0/2758747747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbd9001c710 tx=0x7fbd9001b880 comp rx=0 tx=0).stop 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 shutdown_connections 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 --2- 172.21.15.193:0/2758747747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd98110050 0x7fbd981a5c20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 >> 172.21.15.193:0/2758747747 conn(0x7fbd98070d50 msgr2=0x7fbd98071620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 shutdown_connections 2024-09-12T17:10:38.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.404+0000 7fbd9daf0640 1 -- 172.21.15.193:0/2758747747 wait complete. 2024-09-12T17:10:38.425 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 3480faae-f8de-4e3e-a8fc-a884592e7228 2 2024-09-12T17:10:38.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c89ec5640 1 Processor -- start 2024-09-12T17:10:38.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c89ec5640 1 -- start start 2024-09-12T17:10:38.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c89ec5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c84110050 0x7f5c84110430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c89ec5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c84110b50 con 0x7f5c841153e0 2024-09-12T17:10:38.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c89ec5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5c84115f80 con 0x7f5c84110050 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c84110050 0x7f5c84110430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5c84110050 0x7f5c84110430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47742/0 (socket says 172.21.15.193:47742) 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c837fe640 1 -- 172.21.15.193:0/2820543063 learned_addr learned my addr 172.21.15.193:0/2820543063 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c7affd640 1 --1- 172.21.15.193:0/2820543063 >> v1:172.21.15.62:6789/0 conn(0x7f5c841153e0 0x7f5c84115870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:58882/0 (socket says 172.21.15.193:58882) 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c837fe640 1 -- 172.21.15.193:0/2820543063 >> v1:172.21.15.62:6789/0 conn(0x7f5c841153e0 legacy=0x7f5c84115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.544+0000 7f5c837fe640 1 -- 172.21.15.193:0/2820543063 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c84116130 con 0x7f5c84110050 2024-09-12T17:10:38.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c837fe640 1 --2- 172.21.15.193:0/2820543063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c84110430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400d150 tx=0x7f5c7401eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47093f044419b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c82ffd640 1 -- 172.21.15.193:0/2820543063 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7400b200 con 0x7f5c84110050 2024-09-12T17:10:38.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c82ffd640 1 -- 172.21.15.193:0/2820543063 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7400b3a0 con 0x7f5c84110050 2024-09-12T17:10:38.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c82ffd640 1 -- 172.21.15.193:0/2820543063 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c740a7a40 con 0x7f5c84110050 2024-09-12T17:10:38.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- 172.21.15.193:0/2820543063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 msgr2=0x7f5c84110430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 --2- 172.21.15.193:0/2820543063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c84110430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c7400d150 tx=0x7f5c7401eb80 comp rx=0 tx=0).stop 2024-09-12T17:10:38.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- 172.21.15.193:0/2820543063 shutdown_connections 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 --2- 172.21.15.193:0/2820543063 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c84110430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- 172.21.15.193:0/2820543063 >> 172.21.15.193:0/2820543063 conn(0x7f5c84070d50 msgr2=0x7f5c84073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- 172.21.15.193:0/2820543063 shutdown_connections 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- 172.21.15.193:0/2820543063 wait complete. 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 Processor -- start 2024-09-12T17:10:38.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.548+0000 7f5c89ec5640 1 -- start start 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c89ec5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c89ec5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8406ded0 con 0x7f5c84110050 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47758/0 (socket says 172.21.15.193:47758) 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c837fe640 1 -- 172.21.15.193:0/1800103097 learned_addr learned my addr 172.21.15.193:0/1800103097 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c837fe640 1 -- 172.21.15.193:0/1800103097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c841a61a0 con 0x7f5c84110050 2024-09-12T17:10:38.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c837fe640 1 --2- 172.21.15.193:0/1800103097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c7401c7b0 tx=0x7f5c7401b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c740be020 con 0x7f5c84110050 2024-09-12T17:10:38.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c74009c70 con 0x7f5c84110050 2024-09-12T17:10:38.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c841a6430 con 0x7f5c84110050 2024-09-12T17:10:38.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c740ba470 con 0x7f5c84110050 2024-09-12T17:10:38.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c841ab410 con 0x7f5c84110050 2024-09-12T17:10:38.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5c740c1020 con 0x7f5c84110050 2024-09-12T17:10:38.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f5c740b8b30 con 0x7f5c84110050 2024-09-12T17:10:38.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.552+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c841104b0 con 0x7f5c84110050 2024-09-12T17:10:38.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.560+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5c740c8030 con 0x7f5c84110050 2024-09-12T17:10:38.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.628+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3480faae-f8de-4e3e-a8fc-a884592e7228", "id": 2} v 0) -- 0x7f5c841153e0 con 0x7f5c84110050 2024-09-12T17:10:38.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c80ff9640 1 -- 172.21.15.193:0/1800103097 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3480faae-f8de-4e3e-a8fc-a884592e7228", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f5c74018800 con 0x7f5c84110050 2024-09-12T17:10:38.636 INFO:teuthology.orchestra.run.smithi193.stdout:2 2024-09-12T17:10:38.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 msgr2=0x7f5c841a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 --2- 172.21.15.193:0/1800103097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c7401c7b0 tx=0x7f5c7401b920 comp rx=0 tx=0).stop 2024-09-12T17:10:38.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 shutdown_connections 2024-09-12T17:10:38.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 --2- 172.21.15.193:0/1800103097 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c84110050 0x7f5c841a5bd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 >> 172.21.15.193:0/1800103097 conn(0x7f5c84070d50 msgr2=0x7f5c840716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 shutdown_connections 2024-09-12T17:10:38.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.632+0000 7f5c89ec5640 1 -- 172.21.15.193:0/1800103097 wait complete. 2024-09-12T17:10:38.653 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 865097ec-4413-4906-89a8-28b5234ae853 3 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c3096b640 1 Processor -- start 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c3096b640 1 -- start start 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c3096b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c2c111060 0x7f4c2c111440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c3096b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c2c111b60 con 0x7f4c2c1164f0 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c3096b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2c117090 con 0x7f4c2c111060 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c2a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c2c111060 0x7f4c2c111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c2a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c2c111060 0x7f4c2c111440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47764/0 (socket says 172.21.15.193:47764) 2024-09-12T17:10:38.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c2a59c640 1 -- 172.21.15.193:0/2583489647 learned_addr learned my addr 172.21.15.193:0/2583489647 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c29d9b640 1 --1- 172.21.15.193:0/2583489647 >> v1:172.21.15.62:6789/0 conn(0x7f4c2c1164f0 0x7f4c2c116980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:58894/0 (socket says 172.21.15.193:58894) 2024-09-12T17:10:38.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c2a59c640 1 -- 172.21.15.193:0/2583489647 >> v1:172.21.15.62:6789/0 conn(0x7f4c2c1164f0 legacy=0x7f4c2c116980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.764+0000 7f4c2a59c640 1 -- 172.21.15.193:0/2583489647 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c117240 con 0x7f4c2c111060 2024-09-12T17:10:38.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c2a59c640 1 --2- 172.21.15.193:0/2583489647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c111440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0097f0 tx=0x7f4c1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56613d98bacc038 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c2959a640 1 -- 172.21.15.193:0/2583489647 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c0ab580 con 0x7f4c2c111060 2024-09-12T17:10:38.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c2959a640 1 -- 172.21.15.193:0/2583489647 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c0b0070 con 0x7f4c2c111060 2024-09-12T17:10:38.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c2959a640 1 -- 172.21.15.193:0/2583489647 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c0ab870 con 0x7f4c2c111060 2024-09-12T17:10:38.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 -- 172.21.15.193:0/2583489647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 msgr2=0x7f4c2c111440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 --2- 172.21.15.193:0/2583489647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c111440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0097f0 tx=0x7f4c1c01c430 comp rx=0 tx=0).stop 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 -- 172.21.15.193:0/2583489647 shutdown_connections 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 --2- 172.21.15.193:0/2583489647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c111440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 -- 172.21.15.193:0/2583489647 >> 172.21.15.193:0/2583489647 conn(0x7f4c2c071e50 msgr2=0x7f4c2c074270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 -- 172.21.15.193:0/2583489647 shutdown_connections 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 -- 172.21.15.193:0/2583489647 wait complete. 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.768+0000 7f4c3096b640 1 Processor -- start 2024-09-12T17:10:38.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 -- start start 2024-09-12T17:10:38.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:38.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2c11f2c0 con 0x7f4c2c111060 2024-09-12T17:10:38.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:38.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c2a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:47780/0 (socket says 172.21.15.193:47780) 2024-09-12T17:10:38.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c2a59c640 1 -- 172.21.15.193:0/1808506987 learned_addr learned my addr 172.21.15.193:0/1808506987 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:10:38.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c2a59c640 1 -- 172.21.15.193:0/1808506987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2c070450 con 0x7f4c2c111060 2024-09-12T17:10:38.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c2a59c640 1 --2- 172.21.15.193:0/1808506987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01a060 tx=0x7f4c1c01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:38.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c0aa7d0 con 0x7f4c2c111060 2024-09-12T17:10:38.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c0aa970 con 0x7f4c2c111060 2024-09-12T17:10:38.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2c06eb00 con 0x7f4c2c111060 2024-09-12T17:10:38.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c0aac70 con 0x7f4c2c111060 2024-09-12T17:10:38.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2c06f090 con 0x7f4c2c111060 2024-09-12T17:10:38.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c1c0c77d0 con 0x7f4c2c111060 2024-09-12T17:10:38.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4c1c0b43f0 con 0x7f4c2c111060 2024-09-12T17:10:38.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.772+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c2c1114c0 con 0x7f4c2c111060 2024-09-12T17:10:38.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.780+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4c1c0de860 con 0x7f4c2c111060 2024-09-12T17:10:38.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.852+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "865097ec-4413-4906-89a8-28b5234ae853", "id": 3} v 0) -- 0x7f4c2c06f370 con 0x7f4c2c111060 2024-09-12T17:10:38.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.852+0000 7f4c1affd640 1 -- 172.21.15.193:0/1808506987 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "865097ec-4413-4906-89a8-28b5234ae853", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4c1c0cc030 con 0x7f4c2c111060 2024-09-12T17:10:38.857 INFO:teuthology.orchestra.run.smithi193.stdout:3 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.852+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 msgr2=0x7f4c2c06e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 --2- 172.21.15.193:0/1808506987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c01a060 tx=0x7f4c1c01ac70 comp rx=0 tx=0).stop 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 shutdown_connections 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 --2- 172.21.15.193:0/1808506987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c2c111060 0x7f4c2c06e560 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 >> 172.21.15.193:0/1808506987 conn(0x7f4c2c071e50 msgr2=0x7f4c2c112490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 shutdown_connections 2024-09-12T17:10:38.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:10:38.856+0000 7f4c3096b640 1 -- 172.21.15.193:0/1808506987 wait complete. 2024-09-12T17:10:38.874 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:10:38.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:10:38.877 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:10:38.877 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:10:38.877 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:10:38.879 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:10:38.879 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:10:38.879 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:10:38.881 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:10:38.881 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:10:38.881 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:10:38.883 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:10:38.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.000+0000 7f8aaf2ae640 1 Processor -- start 2024-09-12T17:10:39.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.000+0000 7f8aaf2ae640 1 -- start start 2024-09-12T17:10:39.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8aa8132420 0x7f8aa8134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa812b9d0 con 0x7f8aa812aee0 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa8071e70 con 0x7f8aa8132420 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aac849640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8aa8132420 0x7f8aa8134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aad04a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8aa812aee0 0x7f8aa812b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:54628/0 (socket says 172.21.15.62:54628) 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aad04a640 1 -- 172.21.15.62:0/2767711970 learned_addr learned my addr 172.21.15.62:0/2767711970 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aac849640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8aa8132420 0x7f8aa8134810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35380/0 (socket says 172.21.15.62:35380) 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aac849640 1 -- 172.21.15.62:0/2767711970 >> v1:172.21.15.62:6789/0 conn(0x7f8aa812aee0 legacy=0x7f8aa812b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aac849640 1 -- 172.21.15.62:0/2767711970 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa80008e0 con 0x7f8aa8132420 2024-09-12T17:10:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aac849640 1 --2- 172.21.15.62:0/2767711970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa8132420 0x7f8aa8134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009740 tx=0x7f8a9c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4ca9d68712e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aa7fff640 1 -- 172.21.15.62:0/2767711970 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a9c0b1070 con 0x7f8aa8132420 2024-09-12T17:10:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aa7fff640 1 -- 172.21.15.62:0/2767711970 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0ac520 con 0x7f8aa8132420 2024-09-12T17:10:39.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aa7fff640 1 -- 172.21.15.62:0/2767711970 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a9c0ac820 con 0x7f8aa8132420 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/2767711970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa8132420 msgr2=0x7f8aa8134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 --2- 172.21.15.62:0/2767711970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa8132420 0x7f8aa8134810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009740 tx=0x7f8a9c01c370 comp rx=0 tx=0).stop 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/2767711970 shutdown_connections 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 --2- 172.21.15.62:0/2767711970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa8132420 0x7f8aa8134810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/2767711970 >> 172.21.15.62:0/2767711970 conn(0x7f8aa80a0a60 msgr2=0x7f8aa806e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/2767711970 shutdown_connections 2024-09-12T17:10:39.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.004+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/2767711970 wait complete. 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 Processor -- start 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 -- start start 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa8137570 con 0x7f8aa812aee0 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aad04a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aad04a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35384/0 (socket says 172.21.15.62:35384) 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aad04a640 1 -- 172.21.15.62:0/1075503417 learned_addr learned my addr 172.21.15.62:0/1075503417 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aad04a640 1 -- 172.21.15.62:0/1075503417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa8073a80 con 0x7f8aa812aee0 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aad04a640 1 --2- 172.21.15.62:0/1075503417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c450 tx=0x7f8a9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a98017070 con 0x7f8aa812aee0 2024-09-12T17:10:39.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a98005c20 con 0x7f8aa812aee0 2024-09-12T17:10:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a980070d0 con 0x7f8aa812aee0 2024-09-12T17:10:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa811c510 con 0x7f8aa812aee0 2024-09-12T17:10:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa8129fb0 con 0x7f8aa812aee0 2024-09-12T17:10:39.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a9801a070 con 0x7f8aa812aee0 2024-09-12T17:10:39.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8a9801cbf0 con 0x7f8aa812aee0 2024-09-12T17:10:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.008+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa811b300 con 0x7f8aa812aee0 2024-09-12T17:10:39.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.012+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8a9801ce10 con 0x7f8aa812aee0 2024-09-12T17:10:39.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8aa812b2c0 con 0x7f8aa812aee0 2024-09-12T17:10:39.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aa5ffb640 1 -- 172.21.15.62:0/1075503417 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f8a9801c4a0 con 0x7f8aa812aee0 2024-09-12T17:10:39.076 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:39.076 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":6,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:38.856102+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 msgr2=0x7f8aa81298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 --2- 172.21.15.62:0/1075503417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c450 tx=0x7f8a9800c910 comp rx=0 tx=0).stop 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 shutdown_connections 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 --2- 172.21.15.62:0/1075503417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8aa812aee0 0x7f8aa81298a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 >> 172.21.15.62:0/1075503417 conn(0x7f8aa80a0a60 msgr2=0x7f8aa80a1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:39.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 shutdown_connections 2024-09-12T17:10:39.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:39.072+0000 7f8aaf2ae640 1 -- 172.21.15.62:0/1075503417 wait complete. 2024-09-12T17:10:39.094 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:10:39.094 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:10:39.498 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:39.625 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.620+0000 7f1db0b70640 1 Processor -- start 2024-09-12T17:10:39.625 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.620+0000 7f1db0b70640 1 -- start start 2024-09-12T17:10:39.626 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1db0b70640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1dac110da0 0x7f1dac111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1db0b70640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dac112c80 con 0x7f1dac1116c0 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1db0b70640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1dac06dd90 con 0x7f1dac110da0 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da9d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1dac1116c0 0x7f1dac132680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:54644/0 (socket says 172.21.15.62:54644) 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da9d9b640 1 -- 172.21.15.62:0/2463101462 learned_addr learned my addr 172.21.15.62:0/2463101462 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1daa59c640 1 --2- 172.21.15.62:0/2463101462 >> v2:172.21.15.62:3300/0 conn(0x7f1dac110da0 0x7f1dac111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da959a640 1 -- 172.21.15.62:0/2463101462 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793331301 0 0) 0x7f1dac112c80 con 0x7f1dac1116c0 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da959a640 1 -- 172.21.15.62:0/2463101462 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d98003530 con 0x7f1dac1116c0 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1daa59c640 1 -- 172.21.15.62:0/2463101462 >> v1:172.21.15.62:6789/0 conn(0x7f1dac1116c0 legacy=0x7f1dac132680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.627 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1daa59c640 1 -- 172.21.15.62:0/2463101462 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac0736a0 con 0x7f1dac110da0 2024-09-12T17:10:39.629 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1daa59c640 1 --2- 172.21.15.62:0/2463101462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac111180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009740 tx=0x7f1d9401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f8464ce7bfc97f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:39.629 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da959a640 1 -- 172.21.15.62:0/2463101462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d940b0070 con 0x7f1dac110da0 2024-09-12T17:10:39.629 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da959a640 1 -- 172.21.15.62:0/2463101462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940ab530 con 0x7f1dac110da0 2024-09-12T17:10:39.629 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.624+0000 7f1da959a640 1 -- 172.21.15.62:0/2463101462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d940ab810 con 0x7f1dac110da0 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/2463101462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 msgr2=0x7f1dac111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 --2- 172.21.15.62:0/2463101462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac111180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009740 tx=0x7f1d9401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/2463101462 shutdown_connections 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 --2- 172.21.15.62:0/2463101462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac111180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/2463101462 >> 172.21.15.62:0/2463101462 conn(0x7f1dac0709a0 msgr2=0x7f1dac072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/2463101462 shutdown_connections 2024-09-12T17:10:39.630 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/2463101462 wait complete. 2024-09-12T17:10:39.631 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 Processor -- start 2024-09-12T17:10:39.631 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- start start 2024-09-12T17:10:39.631 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac13c050 con 0x7f1dac110da0 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1daa59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1daa59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:35412/0 (socket says 172.21.15.62:35412) 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1daa59c640 1 -- 172.21.15.62:0/1083040721 learned_addr learned my addr 172.21.15.62:0/1083040721 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1daa59c640 1 -- 172.21.15.62:0/1083040721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac12e380 con 0x7f1dac110da0 2024-09-12T17:10:39.632 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1daa59c640 1 --2- 172.21.15.62:0/1083040721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d94018f80 tx=0x7f1d9401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d940b9020 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d940b1040 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac12e670 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d940b0070 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac114cf0 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1d940bc020 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1d940be400 con 0x7f1dac110da0 2024-09-12T17:10:39.633 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.628+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dac111180 con 0x7f1dac110da0 2024-09-12T17:10:39.635 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.632+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1d940c3030 con 0x7f1dac110da0 2024-09-12T17:10:39.695 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1dac074f70 con 0x7f1dac110da0 2024-09-12T17:10:39.696 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1da2ffd640 1 -- 172.21.15.62:0/1083040721 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f1d94015ff0 con 0x7f1dac110da0 2024-09-12T17:10:39.696 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T17:10:39.696 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":6,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:38.856102+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 msgr2=0x7f1dac12de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 --2- 172.21.15.62:0/1083040721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1d94018f80 tx=0x7f1d9401abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 shutdown_connections 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 --2- 172.21.15.62:0/1083040721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1dac110da0 0x7f1dac12de40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 >> 172.21.15.62:0/1083040721 conn(0x7f1dac0709a0 msgr2=0x7f1dac070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:39.697 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 shutdown_connections 2024-09-12T17:10:39.698 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:39.692+0000 7f1db0b70640 1 -- 172.21.15.62:0/1083040721 wait complete. 2024-09-12T17:10:39.713 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T17:10:39.947 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T17:10:39.944+0000 7fa3f3a8c7c0 -1 Falling back to public interface 2024-09-12T17:10:40.531 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-09-12T17:10:40.528+0000 7f39802047c0 -1 Falling back to public interface 2024-09-12T17:10:40.567 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-09-12T17:10:40.564+0000 7fb4963f67c0 -1 Falling back to public interface 2024-09-12T17:10:40.671 INFO:tasks.ceph.mgr.x.smithi193.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:10:40.671 INFO:tasks.ceph.mgr.x.smithi193.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:10:40.672 INFO:tasks.ceph.mgr.x.smithi193.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:10:40.800 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-09-12T17:10:40.796+0000 7f59b58497c0 -1 Falling back to public interface 2024-09-12T17:10:43.657 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-09-12T17:10:43.652+0000 7f37065a8640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-12T17:10:43.766 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T17:10:43.764+0000 7fa3f3a8c7c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:10:44.622 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-09-12T17:10:44.620+0000 7f39802047c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:10:44.818 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-09-12T17:10:44.816+0000 7f59b58497c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:10:44.919 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-09-12T17:10:44.916+0000 7fb4963f67c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:10:46.117 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:46.236 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f9846511640 1 Processor -- start 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f9846511640 1 -- start start 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f9846511640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98401128c0 0x7f984012c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f9846511640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98401131d0 con 0x7f984012bfc0 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f9846511640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9840112ca0 con 0x7f98401128c0 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98401128c0 0x7f984012c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f984012bfc0 0x7f9840128870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38828/0 (socket says 172.21.15.62:38828) 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983f7fe640 1 -- 172.21.15.62:0/4219675930 learned_addr learned my addr 172.21.15.62:0/4219675930 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983ffff640 1 -- 172.21.15.62:0/4219675930 >> v1:172.21.15.62:6789/0 conn(0x7f984012bfc0 legacy=0x7f9840128870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983ffff640 1 -- 172.21.15.62:0/4219675930 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9840113700 con 0x7f98401128c0 2024-09-12T17:10:46.237 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.232+0000 7f983effd640 1 -- 172.21.15.62:0/4219675930 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620262435 0 0) 0x7f98401131d0 con 0x7f984012bfc0 2024-09-12T17:10:46.239 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f983ffff640 1 --2- 172.21.15.62:0/4219675930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f984012c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9830009740 tx=0x7f983001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3993413aff2c3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:46.239 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f983effd640 1 -- 172.21.15.62:0/4219675930 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300b0070 con 0x7f98401128c0 2024-09-12T17:10:46.239 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f983effd640 1 -- 172.21.15.62:0/4219675930 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98300ab530 con 0x7f98401128c0 2024-09-12T17:10:46.239 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f983effd640 1 -- 172.21.15.62:0/4219675930 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300ab830 con 0x7f98401128c0 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- 172.21.15.62:0/4219675930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 msgr2=0x7f984012c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 --2- 172.21.15.62:0/4219675930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f984012c510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9830009740 tx=0x7f983001c310 comp rx=0 tx=0).stop 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- 172.21.15.62:0/4219675930 shutdown_connections 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 --2- 172.21.15.62:0/4219675930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f984012c510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- 172.21.15.62:0/4219675930 >> 172.21.15.62:0/4219675930 conn(0x7f9840071890 msgr2=0x7f984010fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- 172.21.15.62:0/4219675930 shutdown_connections 2024-09-12T17:10:46.240 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- 172.21.15.62:0/4219675930 wait complete. 2024-09-12T17:10:46.241 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 Processor -- start 2024-09-12T17:10:46.241 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.236+0000 7f9846511640 1 -- start start 2024-09-12T17:10:46.241 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f9846511640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:46.241 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f9846511640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f98401343a0 con 0x7f98401128c0 2024-09-12T17:10:46.242 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:46.242 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42320/0 (socket says 172.21.15.62:42320) 2024-09-12T17:10:46.242 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983ffff640 1 -- 172.21.15.62:0/2914219542 learned_addr learned my addr 172.21.15.62:0/2914219542 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983ffff640 1 -- 172.21.15.62:0/2914219542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9840126560 con 0x7f98401128c0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983ffff640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9830019f40 tx=0x7f983001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300bb070 con 0x7f98401128c0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830004020 con 0x7f98401128c0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98401312b0 con 0x7f98401128c0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98300b0040 con 0x7f98401128c0 2024-09-12T17:10:46.243 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98401159b0 con 0x7f98401128c0 2024-09-12T17:10:46.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f984012c510 con 0x7f98401128c0 2024-09-12T17:10:46.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) ==== 48276+0+0 (secure 0 0 0) 0x7f9830004300 con 0x7f98401128c0 2024-09-12T17:10:46.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 0x7f982c03d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:46.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1591+0+0 (secure 0 0 0) 0x7f98300e9190 con 0x7f98401128c0 2024-09-12T17:10:46.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983f7fe640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 0x7f982c03d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:46.245 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.240+0000 7f983f7fe640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 0x7f982c03d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:46.249 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.244+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9830015ff0 con 0x7f98401128c0 2024-09-12T17:10:46.509 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.504+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9840050d70 con 0x7f98401128c0 2024-09-12T17:10:46.510 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f983cff9640 1 -- 172.21.15.62:0/2914219542 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f98300b5de0 con 0x7f98401128c0 2024-09-12T17:10:46.510 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T17:10:46.510 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":8,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:45.706727+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 msgr2=0x7f982c03d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 0x7f982c03d600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9834007fd0 tx=0x7f9834007900 comp rx=0 tx=0).stop 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 msgr2=0x7f98401c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9830019f40 tx=0x7f983001ab50 comp rx=0 tx=0).stop 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 shutdown_connections 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f982c03b140 0x7f982c03d600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 --2- 172.21.15.62:0/2914219542 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98401128c0 0x7f98401c4810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:46.513 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 >> 172.21.15.62:0/2914219542 conn(0x7f9840071890 msgr2=0x7f9840123160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 shutdown_connections 2024-09-12T17:10:46.514 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:46.508+0000 7f9846511640 1 -- 172.21.15.62:0/2914219542 wait complete. 2024-09-12T17:10:46.530 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-12T17:10:46.651 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-09-12T17:10:46.648+0000 7f397c9bf640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:10:46.671 INFO:tasks.ceph.osd.2.smithi193.stderr:2024-09-12T17:10:46.668+0000 7f3973fdf640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:46.719 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T17:10:46.716+0000 7fa3efa35640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:10:46.747 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T17:10:46.744+0000 7fa3e7867640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:48.103 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-09-12T17:10:48.100+0000 7f59b2004640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:10:48.112 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-09-12T17:10:48.108+0000 7fb49239f640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:10:48.122 INFO:tasks.ceph.osd.3.smithi193.stderr:2024-09-12T17:10:48.120+0000 7f59a9624640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:48.134 INFO:tasks.ceph.osd.1.smithi193.stderr:2024-09-12T17:10:48.132+0000 7fb48a1d1640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:10:52.934 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:53.058 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7ff0489640 1 Processor -- start 2024-09-12T17:10:53.058 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7ff0489640 1 -- start start 2024-09-12T17:10:53.059 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7ff0489640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fe8130390 0x7f7fe8132780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.059 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7ff0489640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe8073730 con 0x7f7fe812d580 2024-09-12T17:10:53.059 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7ff0489640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7fe8114b80 con 0x7f7fe8130390 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fe8130390 0x7f7fe8132780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fe8130390 0x7f7fe8132780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33202/0 (socket says 172.21.15.62:33202) 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 -- 172.21.15.62:0/169570258 learned_addr learned my addr 172.21.15.62:0/169570258 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7fee225640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7fe812d580 0x7f7fe812d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36236/0 (socket says 172.21.15.62:36236) 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 -- 172.21.15.62:0/169570258 >> v1:172.21.15.62:6789/0 conn(0x7f7fe812d580 legacy=0x7f7fe812d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.060 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 -- 172.21.15.62:0/169570258 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe812d130 con 0x7f7fe8130390 2024-09-12T17:10:53.061 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.056+0000 7f7feda24640 1 --2- 172.21.15.62:0/169570258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe8130390 0x7f7fe8132780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80097f0 tx=0x7f7fd801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d8c2499e1583cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.062 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fed223640 1 -- 172.21.15.62:0/169570258 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd80b0070 con 0x7f7fe8130390 2024-09-12T17:10:53.062 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fed223640 1 -- 172.21.15.62:0/169570258 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fd80ab530 con 0x7f7fe8130390 2024-09-12T17:10:53.062 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fed223640 1 -- 172.21.15.62:0/169570258 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fd80ab830 con 0x7f7fe8130390 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/169570258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe8130390 msgr2=0x7f7fe8132780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 --2- 172.21.15.62:0/169570258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe8130390 0x7f7fe8132780 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80097f0 tx=0x7f7fd801c430 comp rx=0 tx=0).stop 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/169570258 shutdown_connections 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 --2- 172.21.15.62:0/169570258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe8130390 0x7f7fe8132780 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/169570258 >> 172.21.15.62:0/169570258 conn(0x7f7fe80709a0 msgr2=0x7f7fe8072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/169570258 shutdown_connections 2024-09-12T17:10:53.063 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/169570258 wait complete. 2024-09-12T17:10:53.066 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 Processor -- start 2024-09-12T17:10:53.066 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- start start 2024-09-12T17:10:53.066 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.066 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe8135870 con 0x7f7fe812d580 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fee225640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fee225640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33214/0 (socket says 172.21.15.62:33214) 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fee225640 1 -- 172.21.15.62:0/1796143110 learned_addr learned my addr 172.21.15.62:0/1796143110 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fee225640 1 -- 172.21.15.62:0/1796143110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8126f50 con 0x7f7fe812d580 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fee225640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400c480 tx=0x7f7fe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4007410 con 0x7f7fe812d580 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe40075b0 con 0x7f7fe812d580 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4004920 con 0x7f7fe812d580 2024-09-12T17:10:53.067 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe8116140 con 0x7f7fe812d580 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.060+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe8125f70 con 0x7f7fe812d580 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe8115930 con 0x7f7fe812d580 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fe401a020 con 0x7f7fe812d580 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7fdeffd640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 0x7f7fcc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7f7fe404e2d0 con 0x7f7fe812d580 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7feda24640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 0x7f7fcc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.068 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.064+0000 7f7feda24640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 0x7f7fcc03d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ad000 tx=0x7f7fd80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.070 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.068+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f7fe4013920 con 0x7f7fe812d580 2024-09-12T17:10:53.241 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.236+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7fe812d960 con 0x7f7fe812d580 2024-09-12T17:10:53.244 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7fdeffd640 1 -- 172.21.15.62:0/1796143110 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8014 (secure 0 0 0) 0x7f7fe401a310 con 0x7f7fe812d580 2024-09-12T17:10:53.244 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T17:10:53.244 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":13,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:50.735763+0000","last_up_change":"2024-09-12T17:10:48.732218+0000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:48.692031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6801","nonce":4046570222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6803","nonce":4046570222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6807","nonce":4046570222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6805","nonce":4046570222}]},"public_addr":"172.21.15.62:6801/4046570222","cluster_addr":"172.21.15.62:6803/4046570222","heartbeat_back_addr":"172.21.15.62:6807/4046570222","heartbeat_front_addr":"172.21.15.62:6805/4046570222","state":["exists","up"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6809","nonce":1040547927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6811","nonce":1040547927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6815","nonce":1040547927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6813","nonce":1040547927}]},"public_addr":"172.21.15.193:6809/1040547927","cluster_addr":"172.21.15.193:6811/1040547927","heartbeat_back_addr":"172.21.15.193:6815/1040547927","heartbeat_front_addr":"172.21.15.193:6813/1040547927","state":["exists","up"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6801","nonce":1491583795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6803","nonce":1491583795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6807","nonce":1491583795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6805","nonce":1491583795}]},"public_addr":"172.21.15.193:6801/1491583795","cluster_addr":"172.21.15.193:6803/1491583795","heartbeat_back_addr":"172.21.15.193:6807/1491583795","heartbeat_front_addr":"172.21.15.193:6805/1491583795","state":["exists","up"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6817","nonce":1944991354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6819","nonce":1944991354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6823","nonce":1944991354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6821","nonce":1944991354}]},"public_addr":"172.21.15.193:6817/1944991354","cluster_addr":"172.21.15.193:6819/1944991354","heartbeat_back_addr":"172.21.15.193:6823/1944991354","heartbeat_front_addr":"172.21.15.193:6821/1944991354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:44.745671+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.880365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.607464+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.844552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:53.245 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 msgr2=0x7f7fcc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.245 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 0x7f7fcc03d690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80ad000 tx=0x7f7fd80a6000 comp rx=0 tx=0).stop 2024-09-12T17:10:53.245 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 msgr2=0x7f7fe8125860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.245 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7fe400c480 tx=0x7f7fe400c940 comp rx=0 tx=0).stop 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 shutdown_connections 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7fcc03b1d0 0x7f7fcc03d690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 --2- 172.21.15.62:0/1796143110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fe812d580 0x7f7fe8125860 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 >> 172.21.15.62:0/1796143110 conn(0x7f7fe80709a0 msgr2=0x7f7fe812e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 shutdown_connections 2024-09-12T17:10:53.246 INFO:teuthology.misc.health.smithi062.stderr:2024-09-12T17:10:53.240+0000 7f7ff0489640 1 -- 172.21.15.62:0/1796143110 wait complete. 2024-09-12T17:10:53.260 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-12T17:10:53.261 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:10:53.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:10:53.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.384+0000 7fdd32986640 1 Processor -- start 2024-09-12T17:10:53.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.384+0000 7fdd32986640 1 -- start start 2024-09-12T17:10:53.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd2c12be20 0x7fdd2c12c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2c06df00 con 0x7fdd2c09a190 2024-09-12T17:10:53.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdd2c0981a0 con 0x7fdd2c12be20 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdd2c12be20 0x7fdd2c12c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdd2c09a190 0x7fdd2c12ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36248/0 (socket says 172.21.15.62:36248) 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2b7fe640 1 -- 172.21.15.62:0/2252228404 learned_addr learned my addr 172.21.15.62:0/2252228404 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2affd640 1 -- 172.21.15.62:0/2252228404 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330138140 0 0) 0x7fdd2c06df00 con 0x7fdd2c09a190 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2affd640 1 -- 172.21.15.62:0/2252228404 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd18005740 con 0x7fdd2c09a190 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2bfff640 1 -- 172.21.15.62:0/2252228404 >> v1:172.21.15.62:6789/0 conn(0x7fdd2c09a190 legacy=0x7fdd2c12ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2bfff640 1 -- 172.21.15.62:0/2252228404 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c099b90 con 0x7fdd2c12be20 2024-09-12T17:10:53.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2bfff640 1 --2- 172.21.15.62:0/2252228404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c12be20 0x7fdd2c12c200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009740 tx=0x7fdd1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c578aca9d540008a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2affd640 1 -- 172.21.15.62:0/2252228404 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd140b1070 con 0x7fdd2c12be20 2024-09-12T17:10:53.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2affd640 1 -- 172.21.15.62:0/2252228404 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd140ac520 con 0x7fdd2c12be20 2024-09-12T17:10:53.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd2affd640 1 -- 172.21.15.62:0/2252228404 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd140ac820 con 0x7fdd2c12be20 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 -- 172.21.15.62:0/2252228404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c12be20 msgr2=0x7fdd2c12c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 --2- 172.21.15.62:0/2252228404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c12be20 0x7fdd2c12c200 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009740 tx=0x7fdd1401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 -- 172.21.15.62:0/2252228404 shutdown_connections 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.388+0000 7fdd32986640 1 --2- 172.21.15.62:0/2252228404 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c12be20 0x7fdd2c12c200 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/2252228404 >> 172.21.15.62:0/2252228404 conn(0x7fdd2c09a930 msgr2=0x7fdd2c09ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/2252228404 shutdown_connections 2024-09-12T17:10:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/2252228404 wait complete. 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 Processor -- start 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- start start 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdd2c095520 con 0x7fdd2c09a190 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33218/0 (socket says 172.21.15.62:33218) 2024-09-12T17:10:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2bfff640 1 -- 172.21.15.62:0/1180185971 learned_addr learned my addr 172.21.15.62:0/1180185971 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2bfff640 1 -- 172.21.15.62:0/1180185971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2c128b70 con 0x7fdd2c09a190 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2bfff640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd140af040 tx=0x7fdd1401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd140b1050 con 0x7fdd2c09a190 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd140b2040 con 0x7fdd2c09a190 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd140b85a0 con 0x7fdd2c09a190 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd2c073760 con 0x7fdd2c09a190 2024-09-12T17:10:53.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd2c129720 con 0x7fdd2c09a190 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd2c1290d0 con 0x7fdd2c09a190 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdd140bf030 con 0x7fdd2c09a190 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 0x7fdd0c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3129+0+0 (secure 0 0 0) 0x7fdd140bd070 con 0x7fdd2c09a190 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.392+0000 7fdd2b7fe640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 0x7fdd0c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.396+0000 7fdd2b7fe640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 0x7fdd0c03d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c09a5a0 tx=0x7fdd1c0016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.400+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fdd140c6060 con 0x7fdd2c09a190 2024-09-12T17:10:53.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.572+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fdd2c068e50 con 0x7fdd2c09a190 2024-09-12T17:10:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.744+0000 7fdd28ff9640 1 -- 172.21.15.62:0/1180185971 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) ==== 109+0+0 (secure 0 0 0) 0x7fdd2c073760 con 0x7fdd2c09a190 2024-09-12T17:10:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-09-12T17:10:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 msgr2=0x7fdd0c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 0x7fdd0c03d690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c09a5a0 tx=0x7fdd1c0016a0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 msgr2=0x7fdd2c1c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd140af040 tx=0x7fdd1401abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 shutdown_connections 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdd0c03b1d0 0x7fdd0c03d690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 --2- 172.21.15.62:0/1180185971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd2c09a190 0x7fdd2c1c7470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 >> 172.21.15.62:0/1180185971 conn(0x7fdd2c09a930 msgr2=0x7fdd2c09c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 shutdown_connections 2024-09-12T17:10:53.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.748+0000 7fdd32986640 1 -- 172.21.15.62:0/1180185971 wait complete. 2024-09-12T17:10:53.772 DEBUG:teuthology.orchestra.run.smithi062:> rbd --cluster ceph pool init rbd 2024-09-12T17:10:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:10:53.822 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:10:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1e383100 1 Processor -- start 2024-09-12T17:10:53.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1e383100 1 -- start start 2024-09-12T17:10:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1e383100 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5584bf46d050 0x5584bf46d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1e383100 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5584bf2c0c50 con 0x5584bf46d970 2024-09-12T17:10:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1e383100 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5584bf341600 con 0x5584bf46d050 2024-09-12T17:10:53.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1ce8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5584bf46d050 0x5584bf46d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b17fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5584bf46d970 0x5584bf4fef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36254/0 (socket says 172.21.15.62:36254) 2024-09-12T17:10:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1ce8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5584bf46d050 0x5584bf46d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33226/0 (socket says 172.21.15.62:33226) 2024-09-12T17:10:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b17fff640 1 -- 172.21.15.62:0/3450891371 learned_addr learned my addr 172.21.15.62:0/3450891371 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1ce8c640 1 -- 172.21.15.62:0/3450891371 >> v1:172.21.15.62:6789/0 conn(0x5584bf46d970 legacy=0x5584bf4fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.820+0000 7f8b1ce8c640 1 -- 172.21.15.62:0/3450891371 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584bf46eed0 con 0x5584bf46d050 2024-09-12T17:10:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1ce8c640 1 --2- 172.21.15.62:0/3450891371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf46d430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a480 tx=0x7f8b1001b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779c75c7a38126c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b177fe640 1 -- 172.21.15.62:0/3450891371 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100af530 con 0x5584bf46d050 2024-09-12T17:10:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b177fe640 1 -- 172.21.15.62:0/3450891371 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100af6d0 con 0x5584bf46d050 2024-09-12T17:10:53.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b177fe640 1 -- 172.21.15.62:0/3450891371 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100af9d0 con 0x5584bf46d050 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- 172.21.15.62:0/3450891371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 msgr2=0x5584bf46d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 --2- 172.21.15.62:0/3450891371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf46d430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a480 tx=0x7f8b1001b6a0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- 172.21.15.62:0/3450891371 shutdown_connections 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 --2- 172.21.15.62:0/3450891371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf46d430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- 172.21.15.62:0/3450891371 >> 172.21.15.62:0/3450891371 conn(0x5584bf471f90 msgr2=0x5584bf46e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- 172.21.15.62:0/3450891371 shutdown_connections 2024-09-12T17:10:53.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- 172.21.15.62:0/3450891371 wait complete. 2024-09-12T17:10:53.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 Processor -- start 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- start start 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1e383100 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5584bf3455b0 con 0x5584bf46d050 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1ce8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1ce8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33234/0 (socket says 172.21.15.62:33234) 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.824+0000 7f8b1ce8c640 1 -- 172.21.15.62:0/2099592565 learned_addr learned my addr 172.21.15.62:0/2099592565 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:53.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b1ce8c640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584bf46b620 con 0x5584bf46d050 2024-09-12T17:10:53.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b1ce8c640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a480 tx=0x7f8b10018440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100afdb0 con 0x5584bf46d050 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100bf070 con 0x5584bf46d050 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584bf4e98d0 con 0x5584bf46d050 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b100ba570 con 0x5584bf46d050 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584bf4fcac0 con 0x5584bf46d050 2024-09-12T17:10:53.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8b100ba710 con 0x5584bf46d050 2024-09-12T17:10:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 0x7f8b0003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3471+0+0 (secure 0 0 0) 0x7f8b100e95d0 con 0x5584bf46d050 2024-09-12T17:10:53.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x5584bf510d90 con 0x5584bf46d050 2024-09-12T17:10:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b17fff640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 0x7f8b0003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:53.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:53.828+0000 7f8b17fff640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 0x7f8b0003bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8b08004180 tx=0x7f8b08001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.752+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v15) ==== 141+0+0 (secure 0 0 0) 0x5584bf46eed0 con 0x5584bf46d050 2024-09-12T17:10:54.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.752+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b100af6d0 con 0x5584bf46d050 2024-09-12T17:10:54.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8b100c4b70 con 0x5584bf46d050 2024-09-12T17:10:54.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b16ffd640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=15}) -- 0x7f8af8002af0 con 0x5584bf46d050 2024-09-12T17:10:54.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 8 ==== osd_map(15..15 src has 1..15) ==== 650+0+0 (secure 0 0 0) 0x7f8b100a7dc0 con 0x5584bf46d050 2024-09-12T17:10:54.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 0x5584bf4f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:54.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) -- 0x5584bf4f89e0 con 0x5584bf46d970 2024-09-12T17:10:54.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b1e0ee640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 0x5584bf4f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:54.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.760+0000 7f8b1e0ee640 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 0x5584bf4f84a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.772+0000 7f8b1e0ee640 1 -- 172.21.15.62:0/2099592565 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(1 rbd_trash [create] v15'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f8b1800a4d0 con 0x5584bf46d970 2024-09-12T17:10:54.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5584bf568170 con 0x5584bf46d970 2024-09-12T17:10:54.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.776+0000 7f8b1e0ee640 1 -- 172.21.15.62:0/2099592565 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8b1800a4d0 con 0x5584bf46d970 2024-09-12T17:10:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.780+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e15) -- 0x5584bf567180 con 0x5584bf46d970 2024-09-12T17:10:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.780+0000 7f8b1e0ee640 1 -- 172.21.15.62:0/2099592565 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8b1800a4d0 con 0x5584bf46d970 2024-09-12T17:10:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:54.780+0000 7f8b167fc640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f8afc001f10 con 0x5584bf46d050 2024-09-12T17:10:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.764+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 9 ==== pool_op_reply(tid 4 (0) Success v16) ==== 55+0+0 (secure 0 0 0) 0x7f8b100ab030 con 0x5584bf46d050 2024-09-12T17:10:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.764+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f8b0003f670 con 0x5584bf46d050 2024-09-12T17:10:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.764+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 10 ==== osd_map(16..16 src has 1..16) ==== 626+0+0 (secure 0 0 0) 0x7f8b100a53a0 con 0x5584bf46d050 2024-09-12T17:10:55.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.764+0000 7f8b16ffd640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x7f8af8005790 con 0x5584bf46d970 2024-09-12T17:10:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.772+0000 7f8b1e0ee640 1 -- 172.21.15.62:0/2099592565 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v16'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f8b1800a4d0 con 0x5584bf46d970 2024-09-12T17:10:55.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:55.772+0000 7f8b167fc640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v16) -- 0x7f8afc003360 con 0x5584bf46d050 2024-09-12T17:10:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.768+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 11 ==== pool_op_reply(tid 6 (0) Success v17) ==== 43+0+0 (secure 0 0 0) 0x7f8b100d2070 con 0x5584bf46d050 2024-09-12T17:10:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.768+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f8b0003f8f0 con 0x5584bf46d050 2024-09-12T17:10:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.768+0000 7f8b14ff9640 1 -- 172.21.15.62:0/2099592565 <== mon.0 v2:172.21.15.62:3300/0 12 ==== osd_map(17..17 src has 1..17) ==== 654+0+0 (secure 0 0 0) 0x7f8b100baa00 con 0x5584bf46d050 2024-09-12T17:10:56.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.768+0000 7f8b16ffd640 1 -- 172.21.15.62:0/2099592565 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f8af8005b30 con 0x5584bf46d970 2024-09-12T17:10:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e0ee640 1 -- 172.21.15.62:0/2099592565 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(7 rbd_info [write 0~19] v17'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b1800a4d0 con 0x5584bf46d970 2024-09-12T17:10:56.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 msgr2=0x5584bf4f84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 0x5584bf4f84a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 msgr2=0x7f8b0003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 0x7f8b0003bf80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8b08004180 tx=0x7f8b08001340 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 msgr2=0x5584bf510850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000a480 tx=0x7f8b10018440 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 shutdown_connections 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8b00039ac0 0x7f8b0003bf80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5584bf46d970 0x5584bf4f84a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 --2- 172.21.15.62:0/2099592565 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5584bf46d050 0x5584bf510850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.776+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 >> 172.21.15.62:0/2099592565 conn(0x5584bf471f90 msgr2=0x5584bf46fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.780+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 shutdown_connections 2024-09-12T17:10:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.780+0000 7f8b1e383100 1 -- 172.21.15.62:0/2099592565 wait complete. 2024-09-12T17:10:56.788 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:10:56.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:10:56.789 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:10:56.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e446d640 1 Processor -- start 2024-09-12T17:10:56.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e446d640 1 -- start start 2024-09-12T17:10:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e446d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0dc111890 0x7fa0dc1346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e446d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0dc1122f0 con 0x7fa0dc110da0 2024-09-12T17:10:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e446d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa0dc073ad0 con 0x7fa0dc111890 2024-09-12T17:10:56.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e2209640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa0dc110da0 0x7fa0dc111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36270/0 (socket says 172.21.15.62:36270) 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e2209640 1 -- 172.21.15.62:0/116823726 learned_addr learned my addr 172.21.15.62:0/116823726 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e1a08640 1 --2- 172.21.15.62:0/116823726 >> v2:172.21.15.62:3300/0 conn(0x7fa0dc111890 0x7fa0dc1346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e1207640 1 -- 172.21.15.62:0/116823726 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943846461 0 0) 0x7fa0dc1122f0 con 0x7fa0dc110da0 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e1207640 1 -- 172.21.15.62:0/116823726 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0c8003530 con 0x7fa0dc110da0 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e1a08640 1 -- 172.21.15.62:0/116823726 >> v1:172.21.15.62:6789/0 conn(0x7fa0dc110da0 legacy=0x7fa0dc111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:56.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.920+0000 7fa0e1a08640 1 -- 172.21.15.62:0/116823726 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc112b50 con 0x7fa0dc111890 2024-09-12T17:10:56.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e1a08640 1 --2- 172.21.15.62:0/116823726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc111890 0x7fa0dc1346e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009740 tx=0x7fa0cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e31b71b2b126113 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:56.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e1207640 1 -- 172.21.15.62:0/116823726 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc0b1070 con 0x7fa0dc111890 2024-09-12T17:10:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e1207640 1 -- 172.21.15.62:0/116823726 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0cc0ac570 con 0x7fa0dc111890 2024-09-12T17:10:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e1207640 1 -- 172.21.15.62:0/116823726 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0cc0ac850 con 0x7fa0dc111890 2024-09-12T17:10:56.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- 172.21.15.62:0/116823726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc111890 msgr2=0x7fa0dc1346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 --2- 172.21.15.62:0/116823726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc111890 0x7fa0dc1346e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc009740 tx=0x7fa0cc01c400 comp rx=0 tx=0).stop 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- 172.21.15.62:0/116823726 shutdown_connections 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 --2- 172.21.15.62:0/116823726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc111890 0x7fa0dc1346e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- 172.21.15.62:0/116823726 >> 172.21.15.62:0/116823726 conn(0x7fa0dc070940 msgr2=0x7fa0dc072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- 172.21.15.62:0/116823726 shutdown_connections 2024-09-12T17:10:56.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- 172.21.15.62:0/116823726 wait complete. 2024-09-12T17:10:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 Processor -- start 2024-09-12T17:10:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- start start 2024-09-12T17:10:56.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e446d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc1377d0 con 0x7fa0dc110da0 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e2209640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e2209640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33246/0 (socket says 172.21.15.62:33246) 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.924+0000 7fa0e2209640 1 -- 172.21.15.62:0/695368909 learned_addr learned my addr 172.21.15.62:0/695368909 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e2209640 1 -- 172.21.15.62:0/695368909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc1143c0 con 0x7fa0dc110da0 2024-09-12T17:10:56.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e2209640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c450 tx=0x7fa0d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0d8017070 con 0x7fa0dc110da0 2024-09-12T17:10:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8005ce0 con 0x7fa0dc110da0 2024-09-12T17:10:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc11d7f0 con 0x7fa0dc110da0 2024-09-12T17:10:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0d8007200 con 0x7fa0dc110da0 2024-09-12T17:10:56.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc11e410 con 0x7fa0dc110da0 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa0d801a070 con 0x7fa0dc110da0 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc111180 con 0x7fa0dc110da0 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 0x7fa0c003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa0d804e0c0 con 0x7fa0dc110da0 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e1a08640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 0x7fa0c003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:56.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.928+0000 7fa0e1a08640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 0x7fa0c003d6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0ae000 tx=0x7fa0cc0a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:56.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:56.932+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa0d8012400 con 0x7fa0dc110da0 2024-09-12T17:10:57.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.104+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa0dc11ddf0 con 0x7fa0dc110da0 2024-09-12T17:10:57.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.104+0000 7fa0d2ffd640 1 -- 172.21.15.62:0/695368909 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fa0d8012780 con 0x7fa0dc110da0 2024-09-12T17:10:57.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 msgr2=0x7fa0c003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 0x7fa0c003d6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc0ae000 tx=0x7fa0cc0a6070 comp rx=0 tx=0).stop 2024-09-12T17:10:57.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 msgr2=0x7fa0dc1c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c450 tx=0x7fa0d800c910 comp rx=0 tx=0).stop 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 shutdown_connections 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c003b200 0x7fa0c003d6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 --2- 172.21.15.62:0/695368909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0dc110da0 0x7fa0dc1c6ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 >> 172.21.15.62:0/695368909 conn(0x7fa0dc070940 msgr2=0x7fa0dc071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 shutdown_connections 2024-09-12T17:10:57.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.108+0000 7fa0e446d640 1 -- 172.21.15.62:0/695368909 wait complete. 2024-09-12T17:10:57.127 INFO:teuthology.orchestra.run.smithi062.stdout:[{"version":5,"timestamp":"2024-09-12T17:10:48.114400+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"5481.924929"}]}] 2024-09-12T17:10:57.127 INFO:tasks.ceph_manager:config epoch is 5 2024-09-12T17:10:57.128 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:10:57.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:10:57.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:10:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.252+0000 7fe751cf5640 1 Processor -- start 2024-09-12T17:10:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.252+0000 7fe751cf5640 1 -- start start 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.252+0000 7fe751cf5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe74c12f150 0x7fe74c131540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.252+0000 7fe751cf5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe74c06dcb0 con 0x7fe74c128c60 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.252+0000 7fe751cf5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe74c075000 con 0x7fe74c12f150 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe74c12f150 0x7fe74c131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe74c128c60 0x7fe74c129040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36284/0 (socket says 172.21.15.62:36284) 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74b7fe640 1 -- 172.21.15.62:0/688114476 learned_addr learned my addr 172.21.15.62:0/688114476 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74affd640 1 -- 172.21.15.62:0/688114476 >> v1:172.21.15.62:6789/0 conn(0x7fe74c128c60 legacy=0x7fe74c129040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74affd640 1 -- 172.21.15.62:0/688114476 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c073a90 con 0x7fe74c12f150 2024-09-12T17:10:57.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.256+0000 7fe74a7fc640 1 -- 172.21.15.62:0/688114476 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846802101 0 0) 0x7fe74c06dcb0 con 0x7fe74c128c60 2024-09-12T17:10:57.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74affd640 1 --2- 172.21.15.62:0/688114476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c12f150 0x7fe74c131540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe740009740 tx=0x7fe74001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133ccc5dac38b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74a7fc640 1 -- 172.21.15.62:0/688114476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7400b0070 con 0x7fe74c12f150 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74a7fc640 1 -- 172.21.15.62:0/688114476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7400ab530 con 0x7fe74c12f150 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74a7fc640 1 -- 172.21.15.62:0/688114476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7400ab830 con 0x7fe74c12f150 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/688114476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c12f150 msgr2=0x7fe74c131540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 --2- 172.21.15.62:0/688114476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c12f150 0x7fe74c131540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe740009740 tx=0x7fe74001c370 comp rx=0 tx=0).stop 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/688114476 shutdown_connections 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 --2- 172.21.15.62:0/688114476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c12f150 0x7fe74c131540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/688114476 >> 172.21.15.62:0/688114476 conn(0x7fe74c070900 msgr2=0x7fe74c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/688114476 shutdown_connections 2024-09-12T17:10:57.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/688114476 wait complete. 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 Processor -- start 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- start start 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c134630 con 0x7fe74c128c60 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33262/0 (socket says 172.21.15.62:33262) 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74b7fe640 1 -- 172.21.15.62:0/3841833725 learned_addr learned my addr 172.21.15.62:0/3841833725 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74b7fe640 1 -- 172.21.15.62:0/3841833725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c115240 con 0x7fe74c128c60 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe74b7fe640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c7f0 tx=0x7fe73c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c018070 con 0x7fe74c128c60 2024-09-12T17:10:57.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe73c004d80 con 0x7fe74c128c60 2024-09-12T17:10:57.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c12bc50 con 0x7fe74c128c60 2024-09-12T17:10:57.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe73c00a7b0 con 0x7fe74c128c60 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.260+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c115690 con 0x7fe74c128c60 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c129040 con 0x7fe74c128c60 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe73c01b070 con 0x7fe74c128c60 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe733fff640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 0x7fe73803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe73c04e390 con 0x7fe74c128c60 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe74affd640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 0x7fe73803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.264+0000 7fe74affd640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 0x7fe73803d640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe7400ad000 tx=0x7fe7400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.268+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe73c010d70 con 0x7fe74c128c60 2024-09-12T17:10:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.476+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe74c1265d0 con 0x7fe74c128c60 2024-09-12T17:10:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.480+0000 7fe733fff640 1 -- 172.21.15.62:0/3841833725 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92915 (secure 0 0 0) 0x7fe73c038b10 con 0x7fe74c128c60 2024-09-12T17:10:57.485 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 msgr2=0x7fe73803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 0x7fe73803d640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe7400ad000 tx=0x7fe7400a6000 comp rx=0 tx=0).stop 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 msgr2=0x7fe74c113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00c7f0 tx=0x7fe73c00ccb0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 shutdown_connections 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe73803b180 0x7fe73803d640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 --2- 172.21.15.62:0/3841833725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe74c128c60 0x7fe74c113ee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 >> 172.21.15.62:0/3841833725 conn(0x7fe74c070900 msgr2=0x7fe74c070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 shutdown_connections 2024-09-12T17:10:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.484+0000 7fe751cf5640 1 -- 172.21.15.62:0/3841833725 wait complete. 2024-09-12T17:10:57.503 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":1409480917},{"type":"v1","addr":"172.21.15.193:6825","nonce":1409480917}]},"active_addr":"172.21.15.193:6825/1409480917","active_change":"2024-09-12T17:10:42.644523+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":1369744236}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2307284551}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2029705728}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":67574251}]}]} 2024-09-12T17:10:57.506 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:10:57.506 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:10:57.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:57.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28b291640 1 Processor -- start 2024-09-12T17:10:57.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28b291640 1 -- start start 2024-09-12T17:10:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28b291640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa28412cfe0 0x7fa28412d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28b291640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa284073b50 con 0x7fa28412d900 2024-09-12T17:10:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28b291640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa2840a0fb0 con 0x7fa28412cfe0 2024-09-12T17:10:57.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28882c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa28412d900 0x7fa284126860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36300/0 (socket says 172.21.15.62:36300) 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28902d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa28412cfe0 0x7fa28412d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28882c640 1 -- 172.21.15.62:0/3939902361 learned_addr learned my addr 172.21.15.62:0/3939902361 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa27bfff640 1 -- 172.21.15.62:0/3939902361 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65079966 0 0) 0x7fa284073b50 con 0x7fa28412d900 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa27bfff640 1 -- 172.21.15.62:0/3939902361 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa270003530 con 0x7fa28412d900 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28902d640 1 -- 172.21.15.62:0/3939902361 >> v1:172.21.15.62:6789/0 conn(0x7fa28412d900 legacy=0x7fa284126860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28902d640 1 -- 172.21.15.62:0/3939902361 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28409f4a0 con 0x7fa28412cfe0 2024-09-12T17:10:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.612+0000 7fa28902d640 1 --2- 172.21.15.62:0/3939902361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa28412d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009740 tx=0x7fa27c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9c7e0fe5bf4fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa27bfff640 1 -- 172.21.15.62:0/3939902361 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0b0070 con 0x7fa28412cfe0 2024-09-12T17:10:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa27bfff640 1 -- 172.21.15.62:0/3939902361 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c0ab530 con 0x7fa28412cfe0 2024-09-12T17:10:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa27bfff640 1 -- 172.21.15.62:0/3939902361 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0ab830 con 0x7fa28412cfe0 2024-09-12T17:10:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3939902361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 msgr2=0x7fa28412d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 --2- 172.21.15.62:0/3939902361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa28412d3c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009740 tx=0x7fa27c01c370 comp rx=0 tx=0).stop 2024-09-12T17:10:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3939902361 shutdown_connections 2024-09-12T17:10:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 --2- 172.21.15.62:0/3939902361 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa28412d3c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3939902361 >> 172.21.15.62:0/3939902361 conn(0x7fa284071dc0 msgr2=0x7fa2840721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3939902361 shutdown_connections 2024-09-12T17:10:57.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3939902361 wait complete. 2024-09-12T17:10:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 Processor -- start 2024-09-12T17:10:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- start start 2024-09-12T17:10:57.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa284135710 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28902d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28902d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33292/0 (socket says 172.21.15.62:33292) 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28902d640 1 -- 172.21.15.62:0/3936580729 learned_addr learned my addr 172.21.15.62:0/3936580729 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28902d640 1 -- 172.21.15.62:0/3936580729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa284127870 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28902d640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0ae040 tx=0x7fa27c019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0b8020 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27c0abdb0 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27c0b0040 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa284117090 con 0x7fa28412cfe0 2024-09-12T17:10:57.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa284124ba0 con 0x7fa28412cfe0 2024-09-12T17:10:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28412d3c0 con 0x7fa28412cfe0 2024-09-12T17:10:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.616+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa27c0bb020 con 0x7fa28412cfe0 2024-09-12T17:10:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.620+0000 7fa279ffb640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 0x7fa26803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.620+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa27c0e8950 con 0x7fa28412cfe0 2024-09-12T17:10:57.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.620+0000 7fa28882c640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 0x7fa26803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.620+0000 7fa28882c640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 0x7fa26803d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2800020b0 tx=0x7fa2800016a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.628+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa27c0c2030 con 0x7fa28412cfe0 2024-09-12T17:10:57.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa284116c60 con 0x7fa28412cfe0 2024-09-12T17:10:57.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa279ffb640 1 -- 172.21.15.62:0/3936580729 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9914 (secure 0 0 0) 0x7fa27c015ff0 con 0x7fa28412cfe0 2024-09-12T17:10:57.799 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:57.799 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:56.764993+0000","last_up_change":"2024-09-12T17:10:48.732218+0000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:48.692031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:53.581785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6801","nonce":4046570222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6803","nonce":4046570222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6807","nonce":4046570222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6805","nonce":4046570222}]},"public_addr":"172.21.15.62:6801/4046570222","cluster_addr":"172.21.15.62:6803/4046570222","heartbeat_back_addr":"172.21.15.62:6807/4046570222","heartbeat_front_addr":"172.21.15.62:6805/4046570222","state":["exists","up"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6809","nonce":1040547927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6811","nonce":1040547927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6815","nonce":1040547927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6813","nonce":1040547927}]},"public_addr":"172.21.15.193:6809/1040547927","cluster_addr":"172.21.15.193:6811/1040547927","heartbeat_back_addr":"172.21.15.193:6815/1040547927","heartbeat_front_addr":"172.21.15.193:6813/1040547927","state":["exists","up"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6801","nonce":1491583795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6803","nonce":1491583795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6807","nonce":1491583795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6805","nonce":1491583795}]},"public_addr":"172.21.15.193:6801/1491583795","cluster_addr":"172.21.15.193:6803/1491583795","heartbeat_back_addr":"172.21.15.193:6807/1491583795","heartbeat_front_addr":"172.21.15.193:6805/1491583795","state":["exists","up"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6817","nonce":1944991354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6819","nonce":1944991354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6823","nonce":1944991354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6821","nonce":1944991354}]},"public_addr":"172.21.15.193:6817/1944991354","cluster_addr":"172.21.15.193:6819/1944991354","heartbeat_back_addr":"172.21.15.193:6823/1944991354","heartbeat_front_addr":"172.21.15.193:6821/1944991354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:44.745671+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.880365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.607464+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.844552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 msgr2=0x7fa26803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 0x7fa26803d690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa2800020b0 tx=0x7fa2800016a0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 msgr2=0x7fa284124490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0ae040 tx=0x7fa27c019110 comp rx=0 tx=0).stop 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 shutdown_connections 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa26803b1d0 0x7fa26803d690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 --2- 172.21.15.62:0/3936580729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa28412cfe0 0x7fa284124490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 >> 172.21.15.62:0/3936580729 conn(0x7fa284071dc0 msgr2=0x7fa28412adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 shutdown_connections 2024-09-12T17:10:57.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.796+0000 7fa28b291640 1 -- 172.21.15.62:0/3936580729 wait complete. 2024-09-12T17:10:57.817 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:10:57.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:10:57.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4e68b1640 1 Processor -- start 2024-09-12T17:10:57.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4e68b1640 1 -- start start 2024-09-12T17:10:57.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4e68b1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4e012aee0 0x7fe4e012b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4e68b1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4e00008e0 con 0x7fe4e012f110 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4e68b1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe4e0071e70 con 0x7fe4e012aee0 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4dffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4e012aee0 0x7fe4e012b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4df7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe4e012f110 0x7fe4e012f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36306/0 (socket says 172.21.15.62:36306) 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.924+0000 7fe4df7fe640 1 -- 172.21.15.62:0/4031332560 learned_addr learned my addr 172.21.15.62:0/4031332560 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4dffff640 1 -- 172.21.15.62:0/4031332560 >> v1:172.21.15.62:6789/0 conn(0x7fe4e012f110 legacy=0x7fe4e012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4dffff640 1 -- 172.21.15.62:0/4031332560 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e00a30b0 con 0x7fe4e012aee0 2024-09-12T17:10:57.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4dffff640 1 --2- 172.21.15.62:0/4031332560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e012b2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009740 tx=0x7fe4d401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aac30f272f60e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4deffd640 1 -- 172.21.15.62:0/4031332560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d40b1070 con 0x7fe4e012aee0 2024-09-12T17:10:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4deffd640 1 -- 172.21.15.62:0/4031332560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d40ac520 con 0x7fe4e012aee0 2024-09-12T17:10:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4deffd640 1 -- 172.21.15.62:0/4031332560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d40ac820 con 0x7fe4e012aee0 2024-09-12T17:10:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 -- 172.21.15.62:0/4031332560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 msgr2=0x7fe4e012b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/4031332560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e012b2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009740 tx=0x7fe4d401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:57.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 -- 172.21.15.62:0/4031332560 shutdown_connections 2024-09-12T17:10:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/4031332560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e012b2c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 -- 172.21.15.62:0/4031332560 >> 172.21.15.62:0/4031332560 conn(0x7fe4e00a0a60 msgr2=0x7fe4e006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 -- 172.21.15.62:0/4031332560 shutdown_connections 2024-09-12T17:10:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.928+0000 7fe4e68b1640 1 -- 172.21.15.62:0/4031332560 wait complete. 2024-09-12T17:10:57.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 Processor -- start 2024-09-12T17:10:57.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 -- start start 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e012b980 con 0x7fe4e012aee0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33318/0 (socket says 172.21.15.62:33318) 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dffff640 1 -- 172.21.15.62:0/3880211439 learned_addr learned my addr 172.21.15.62:0/3880211439 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dffff640 1 -- 172.21.15.62:0/3880211439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e011bc30 con 0x7fe4e012aee0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dffff640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4d401aa20 tx=0x7fe4d401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d40b1050 con 0x7fe4e012aee0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d40b2040 con 0x7fe4e012aee0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4d40b6870 con 0x7fe4e012aee0 2024-09-12T17:10:57.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e011aa00 con 0x7fe4e012aee0 2024-09-12T17:10:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e0128fd0 con 0x7fe4e012aee0 2024-09-12T17:10:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4d40bf030 con 0x7fe4e012aee0 2024-09-12T17:10:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4e012b2c0 con 0x7fe4e012aee0 2024-09-12T17:10:57.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 0x7fe4cc03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fe4d40bd070 con 0x7fe4e012aee0 2024-09-12T17:10:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4df7fe640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 0x7fe4cc03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:57.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.932+0000 7fe4df7fe640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 0x7fe4cc03d6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005890 tx=0x7fe4d0007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:57.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:57.936+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fe4d40c6020 con 0x7fe4e012aee0 2024-09-12T17:10:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.100+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4e0068e50 con 0x7fe4e012aee0 2024-09-12T17:10:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.100+0000 7fe4dcff9640 1 -- 172.21.15.62:0/3880211439 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+9914 (secure 0 0 0) 0x7fe4d40c1e20 con 0x7fe4e012aee0 2024-09-12T17:10:58.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:10:58.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:10:56.764993+0000","last_up_change":"2024-09-12T17:10:48.732218+0000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:48.692031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:53.581785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6801","nonce":4046570222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6803","nonce":4046570222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6807","nonce":4046570222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6805","nonce":4046570222}]},"public_addr":"172.21.15.62:6801/4046570222","cluster_addr":"172.21.15.62:6803/4046570222","heartbeat_back_addr":"172.21.15.62:6807/4046570222","heartbeat_front_addr":"172.21.15.62:6805/4046570222","state":["exists","up"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6809","nonce":1040547927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6811","nonce":1040547927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6815","nonce":1040547927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6813","nonce":1040547927}]},"public_addr":"172.21.15.193:6809/1040547927","cluster_addr":"172.21.15.193:6811/1040547927","heartbeat_back_addr":"172.21.15.193:6815/1040547927","heartbeat_front_addr":"172.21.15.193:6813/1040547927","state":["exists","up"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6801","nonce":1491583795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6803","nonce":1491583795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6807","nonce":1491583795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6805","nonce":1491583795}]},"public_addr":"172.21.15.193:6801/1491583795","cluster_addr":"172.21.15.193:6803/1491583795","heartbeat_back_addr":"172.21.15.193:6807/1491583795","heartbeat_front_addr":"172.21.15.193:6805/1491583795","state":["exists","up"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6817","nonce":1944991354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6819","nonce":1944991354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6823","nonce":1944991354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6821","nonce":1944991354}]},"public_addr":"172.21.15.193:6817/1944991354","cluster_addr":"172.21.15.193:6819/1944991354","heartbeat_back_addr":"172.21.15.193:6823/1944991354","heartbeat_front_addr":"172.21.15.193:6821/1944991354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:44.745671+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.880365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.607464+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.844552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:10:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 msgr2=0x7fe4cc03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 0x7fe4cc03d6c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0005890 tx=0x7fe4d0007ab0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 msgr2=0x7fe4e01288c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4d401aa20 tx=0x7fe4d401abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 shutdown_connections 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe4cc03b200 0x7fe4cc03d6c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 --2- 172.21.15.62:0/3880211439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4e012aee0 0x7fe4e01288c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 >> 172.21.15.62:0/3880211439 conn(0x7fe4e00a0a60 msgr2=0x7fe4e0129d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 shutdown_connections 2024-09-12T17:10:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.104+0000 7fe4e68b1640 1 -- 172.21.15.62:0/3880211439 wait complete. 2024-09-12T17:10:58.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:10:58.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:10:58.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:10:58.124 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:10:58.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc452e4640 1 Processor -- start 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc452e4640 1 -- start start 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc452e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc4006e7d0 0x7fdc40134800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc452e4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc40112150 con 0x7fdc4006dce0 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc452e4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdc40112c00 con 0x7fdc4006e7d0 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc4006e7d0 0x7fdc40134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3effd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdc4006dce0 0x7fdc4006e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36320/0 (socket says 172.21.15.62:36320) 2024-09-12T17:10:58.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3effd640 1 -- 172.21.15.62:0/1413511286 learned_addr learned my addr 172.21.15.62:0/1413511286 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3e7fc640 1 -- 172.21.15.62:0/1413511286 >> v1:172.21.15.62:6789/0 conn(0x7fdc4006dce0 legacy=0x7fdc4006e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3dffb640 1 -- 172.21.15.62:0/1413511286 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110413821 0 0) 0x7fdc30001120 con 0x7fdc4006dce0 2024-09-12T17:10:58.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.228+0000 7fdc3e7fc640 1 -- 172.21.15.62:0/1413511286 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc401111f0 con 0x7fdc4006e7d0 2024-09-12T17:10:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd870cf7640 1 Processor -- start 2024-09-12T17:10:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd870cf7640 1 -- start start 2024-09-12T17:10:58.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc3e7fc640 1 --2- 172.21.15.62:0/1413511286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006e7d0 0x7fdc40134800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009740 tx=0x7fdc3401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abe00f3356aa709 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc3dffb640 1 -- 172.21.15.62:0/1413511286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc340b1070 con 0x7fdc4006e7d0 2024-09-12T17:10:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc3dffb640 1 -- 172.21.15.62:0/1413511286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc340ac520 con 0x7fdc4006e7d0 2024-09-12T17:10:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc3dffb640 1 -- 172.21.15.62:0/1413511286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc340ac820 con 0x7fdc4006e7d0 2024-09-12T17:10:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 -- 172.21.15.62:0/1413511286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006e7d0 msgr2=0x7fdc40134800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1413511286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006e7d0 0x7fdc40134800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009740 tx=0x7fdc3401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd870cf7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c09c160 0x7fd86c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd870cf7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd86c09d690 con 0x7fd86c06e760 2024-09-12T17:10:58.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd870cf7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd86c073a20 con 0x7fd86c09c160 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd86a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c09c160 0x7fd86c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd86a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd86c09c160 0x7fd86c09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33338/0 (socket says 172.21.15.62:33338) 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd86a59c640 1 -- 172.21.15.62:0/3623425114 learned_addr learned my addr 172.21.15.62:0/3623425114 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd869d9b640 1 --1- 172.21.15.62:0/3623425114 >> v1:172.21.15.62:6789/0 conn(0x7fd86c06e760 0x7fd86c128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36332/0 (socket says 172.21.15.62:36332) 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd86a59c640 1 -- 172.21.15.62:0/3623425114 >> v1:172.21.15.62:6789/0 conn(0x7fd86c06e760 legacy=0x7fd86c128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fd86a59c640 1 -- 172.21.15.62:0/3623425114 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c06deb0 con 0x7fd86c09c160 2024-09-12T17:10:58.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 -- 172.21.15.62:0/1413511286 shutdown_connections 2024-09-12T17:10:58.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1413511286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006e7d0 0x7fdc40134800 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009740 tx=0x7fdc3401c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 -- 172.21.15.62:0/1413511286 >> 172.21.15.62:0/1413511286 conn(0x7fdc400709b0 msgr2=0x7fdc40072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 -- 172.21.15.62:0/1413511286 shutdown_connections 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.232+0000 7fdc452e4640 1 -- 172.21.15.62:0/1413511286 wait complete. 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 Processor -- start 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 -- start start 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdc401376e0 con 0x7fdc4006dce0 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33340/0 (socket says 172.21.15.62:33340) 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3effd640 1 -- 172.21.15.62:0/1777274984 learned_addr learned my addr 172.21.15.62:0/1777274984 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86a59c640 1 --2- 172.21.15.62:0/3623425114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c09c160 0x7fd86c09c540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd85c013150 tx=0x7fd85c024bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03f30d6a84599a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3effd640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc401179b0 con 0x7fdc4006dce0 2024-09-12T17:10:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86959a640 1 -- 172.21.15.62:0/3623425114 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c0adb60 con 0x7fd86c09c160 2024-09-12T17:10:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86959a640 1 -- 172.21.15.62:0/3623425114 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c0add00 con 0x7fd86c09c160 2024-09-12T17:10:58.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86959a640 1 -- 172.21.15.62:0/3623425114 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c0110d0 con 0x7fd86c09c160 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3effd640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c6b0 tx=0x7fdc3000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc30018070 con 0x7fdc4006dce0 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc30007e30 con 0x7fdc4006dce0 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc40118a70 con 0x7fdc4006dce0 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc30007200 con 0x7fdc4006dce0 2024-09-12T17:10:58.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc401332c0 con 0x7fdc4006dce0 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- 172.21.15.62:0/3623425114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c09c160 msgr2=0x7fd86c09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3623425114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c09c160 0x7fd86c09c540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd85c013150 tx=0x7fd85c024bc0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- 172.21.15.62:0/3623425114 shutdown_connections 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3623425114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c09c160 0x7fd86c09c540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- 172.21.15.62:0/3623425114 >> 172.21.15.62:0/3623425114 conn(0x7fd86c071630 msgr2=0x7fd86c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- 172.21.15.62:0/3623425114 shutdown_connections 2024-09-12T17:10:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- 172.21.15.62:0/3623425114 wait complete. 2024-09-12T17:10:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc401343d0 con 0x7fdc4006dce0 2024-09-12T17:10:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdc3001b070 con 0x7fdc4006dce0 2024-09-12T17:10:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 0x7fdc2c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 Processor -- start 2024-09-12T17:10:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fdc3004dff0 con 0x7fdc4006dce0 2024-09-12T17:10:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 0x7fdc2c042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc2c0434a0 con 0x7fdc2c040950 2024-09-12T17:10:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fdc30055050 con 0x7fdc4006dce0 2024-09-12T17:10:58.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- start start 2024-09-12T17:10:58.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3e7fc640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 0x7fdc2c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fdc3f7fe640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 0x7fdc2c042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd870cf7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd86c117a10 con 0x7fd86c06e760 2024-09-12T17:10:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33346/0 (socket says 172.21.15.62:33346) 2024-09-12T17:10:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.236+0000 7fd86a59c640 1 -- 172.21.15.62:0/3058677600 learned_addr learned my addr 172.21.15.62:0/3058677600 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd86a59c640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86c11e6d0 con 0x7fd86c06e760 2024-09-12T17:10:58.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fdc3e7fc640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 0x7fdc2c03d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc340ae000 tx=0x7fdc34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd86a59c640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0227f0 tx=0x7fd85c021960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fdc3f7fe640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 0x7fdc2c042dd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c0c4020 con 0x7fd86c06e760 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd85c011200 con 0x7fd86c06e760 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd85c011520 con 0x7fd86c06e760 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86c11de90 con 0x7fd86c06e760 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86c11d5e0 con 0x7fd86c06e760 2024-09-12T17:10:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd86c09c160 con 0x7fd86c06e760 2024-09-12T17:10:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8f4914640 1 Processor -- start 2024-09-12T17:10:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd85c0c7020 con 0x7fd86c06e760 2024-09-12T17:10:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8f4914640 1 -- start start 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 0x7fd84c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd85c0f2210 con 0x7fd86c06e760 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 0x7fd84c042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd85c0b6e90 con 0x7fd84c040950 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd85c0f9050 con 0x7fd86c06e760 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8f4914640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd8f0130250 0x7fd8f0132640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8f4914640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f0124000 con 0x7fd8f0123510 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8f4914640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f0073c80 con 0x7fd8f0130250 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8ee59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd8f0123510 0x7fd8f01238f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36344/0 (socket says 172.21.15.62:36344) 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8ee59c640 1 -- 172.21.15.62:0/1328372676 learned_addr learned my addr 172.21.15.62:0/1328372676 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc2c0434a0 con 0x7fdc2c040950 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd869d9b640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 0x7fd84c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd86ad9d640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 0x7fd84c042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8e5d9b640 1 --2- 172.21.15.62:0/1328372676 >> v2:172.21.15.62:3300/0 conn(0x7fd8f0130250 0x7fd8f0132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8e5d9b640 1 -- 172.21.15.62:0/1328372676 >> v1:172.21.15.62:6789/0 conn(0x7fd8f0123510 legacy=0x7fd8f01238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd8e5d9b640 1 -- 172.21.15.62:0/1328372676 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f006d520 con 0x7fd8f0130250 2024-09-12T17:10:58.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd86ad9d640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 0x7fd84c042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.240+0000 7fd869d9b640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 0x7fd84c03d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8600015f0 tx=0x7fd860007a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8e5d9b640 1 --2- 172.21.15.62:0/1328372676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0130250 0x7fd8f0132640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009740 tx=0x7fd8d801c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7a7827c4e39581 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8edd9b640 1 -- 172.21.15.62:0/1328372676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d80b0070 con 0x7fd8f0130250 2024-09-12T17:10:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8edd9b640 1 -- 172.21.15.62:0/1328372676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d80ab530 con 0x7fd8f0130250 2024-09-12T17:10:58.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8edd9b640 1 -- 172.21.15.62:0/1328372676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8d80ab830 con 0x7fd8f0130250 2024-09-12T17:10:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd85c0b6e90 con 0x7fd84c040950 2024-09-12T17:10:58.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- 172.21.15.62:0/1328372676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0130250 msgr2=0x7fd8f0132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 --2- 172.21.15.62:0/1328372676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0130250 0x7fd8f0132640 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009740 tx=0x7fd8d801c200 comp rx=0 tx=0).stop 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- 172.21.15.62:0/1328372676 shutdown_connections 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 --2- 172.21.15.62:0/1328372676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0130250 0x7fd8f0132640 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- 172.21.15.62:0/1328372676 >> 172.21.15.62:0/1328372676 conn(0x7fd8f009b890 msgr2=0x7fd8f006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- 172.21.15.62:0/1328372676 shutdown_connections 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- 172.21.15.62:0/1328372676 wait complete. 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 Processor -- start 2024-09-12T17:10:58.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- start start 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7f66f5734640 1 Processor -- start 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7f66f5734640 1 -- start start 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7f66f5734640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66f006f3c0 0x7f66f006f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7f66f5734640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f0073460 con 0x7f66f006fce0 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7fd8f4914640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f0135730 con 0x7fd8f0123510 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.244+0000 7f66f5734640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f66f006d520 con 0x7f66f006f3c0 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66f006f3c0 0x7f66f006f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66f006f3c0 0x7f66f006f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33374/0 (socket says 172.21.15.62:33374) 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 -- 172.21.15.62:0/3637740572 learned_addr learned my addr 172.21.15.62:0/3637740572 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66ee7fc640 1 --1- 172.21.15.62:0/3637740572 >> v1:172.21.15.62:6789/0 conn(0x7f66f006fce0 0x7f66f012f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36358/0 (socket says 172.21.15.62:36358) 2024-09-12T17:10:58.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8ee59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8ee59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33376/0 (socket says 172.21.15.62:33376) 2024-09-12T17:10:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8ee59c640 1 -- 172.21.15.62:0/2717820884 learned_addr learned my addr 172.21.15.62:0/2717820884 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 -- 172.21.15.62:0/3637740572 >> v1:172.21.15.62:6789/0 conn(0x7f66f006fce0 legacy=0x7f66f012f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 -- 172.21.15.62:0/3637740572 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f0070af0 con 0x7f66f006f3c0 2024-09-12T17:10:58.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66edffb640 1 -- 172.21.15.62:0/3637740572 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200833750 0 0) 0x7f66f0073460 con 0x7f66f006fce0 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8ee59c640 1 -- 172.21.15.62:0/2717820884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f0125460 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8ee59c640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c600 tx=0x7fd8e000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e0018070 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0007430 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f01249d0 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd8e00047f0 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f006ebf0 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd8e001b070 con 0x7fd8f0123510 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 0x7fd8d003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fd8e004e1f0 con 0x7fd8f0123510 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 0x7fd8f012f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd8f0127630 con 0x7fd8f0130250 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e5d9b640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 0x7fd8d003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8eed9d640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 0x7fd8f012f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8e5d9b640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 0x7fd8d003d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80ad000 tx=0x7fd8d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7fd8eed9d640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 0x7fd8f012f710 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66eeffd640 1 --2- 172.21.15.62:0/3637740572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f006f7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097f0 tx=0x7f66e001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd25216becfed14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66edffb640 1 -- 172.21.15.62:0/3637740572 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e00b0070 con 0x7f66f006f3c0 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66edffb640 1 -- 172.21.15.62:0/3637740572 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e00ab530 con 0x7f66f006f3c0 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.248+0000 7f66edffb640 1 -- 172.21.15.62:0/3637740572 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e00ab830 con 0x7f66f006f3c0 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- 172.21.15.62:0/3637740572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 msgr2=0x7f66f006f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 --2- 172.21.15.62:0/3637740572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f006f7a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f66e00097f0 tx=0x7f66e001c430 comp rx=0 tx=0).stop 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- 172.21.15.62:0/3637740572 shutdown_connections 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 --2- 172.21.15.62:0/3637740572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f006f7a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- 172.21.15.62:0/3637740572 >> 172.21.15.62:0/3637740572 conn(0x7f66f009b890 msgr2=0x7f66f006dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- 172.21.15.62:0/3637740572 shutdown_connections 2024-09-12T17:10:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- 172.21.15.62:0/3637740572 wait complete. 2024-09-12T17:10:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd8f0127630 con 0x7fd8f0130250 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 Processor -- start 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- start start 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66f5734640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0137800 con 0x7f66f006f3c0 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66eeffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33382/0 (socket says 172.21.15.62:33382) 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66eeffd640 1 -- 172.21.15.62:0/3508826449 learned_addr learned my addr 172.21.15.62:0/3508826449 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66eeffd640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f0116570 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66eeffd640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66e001a060 tx=0x7f66e001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e00ba020 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e00b6420 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.252+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66e00b0040 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f01178e0 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f012d110 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f66e00bd020 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66f0073660 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 0x7f66dc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f66e00e90b0 con 0x7f66f006f3c0 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 0x7f66dc042dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66e000af30 con 0x7f66dc040950 2024-09-12T17:10:58.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f66e00f0050 con 0x7f66f006f3c0 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66ef7fe640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 0x7f66dc042dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66ee7fc640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 0x7f66dc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66ef7fe640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 0x7f66dc042dd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66ee7fc640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 0x7f66dc03d690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66e4007fd0 tx=0x7f66e4007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.256+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66e000af30 con 0x7f66dc040950 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc4006e0c0 con 0x7fdc2c040950 2024-09-12T17:10:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc277fe640 1 -- 172.21.15.62:0/1777274984 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc4006e0c0 con 0x7fdc2c040950 2024-09-12T17:10:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 msgr2=0x7fdc2c042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 0x7fdc2c042dd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd86c11b8a0 con 0x7fd84c040950 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 msgr2=0x7fdc2c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 0x7fdc2c03d690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdc340ae000 tx=0x7fdc34008040 comp rx=0 tx=0).stop 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 msgr2=0x7fdc40132d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc3000c6b0 tx=0x7fdc3000cb70 comp rx=0 tx=0).stop 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 shutdown_connections 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdc2c040950 0x7fdc2c042dd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc2c03b1d0 0x7fdc2c03d690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 --2- 172.21.15.62:0/1777274984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc4006dce0 0x7fdc40132d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 >> 172.21.15.62:0/1777274984 conn(0x7fdc400709b0 msgr2=0x7fdc4012bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 shutdown_connections 2024-09-12T17:10:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fdc452e4640 1 -- 172.21.15.62:0/1777274984 wait complete. 2024-09-12T17:10:58.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd85affd640 1 -- 172.21.15.62:0/3058677600 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd86c11b8a0 con 0x7fd84c040950 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 msgr2=0x7fd84c042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 0x7fd84c042dd0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 msgr2=0x7fd84c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 0x7fd84c03d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd8600015f0 tx=0x7fd860007a50 comp rx=0 tx=0).stop 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 msgr2=0x7fd86c11b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0227f0 tx=0x7fd85c021960 comp rx=0 tx=0).stop 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 shutdown_connections 2024-09-12T17:10:58.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd84c03b1d0 0x7fd84c03d690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7fd84c040950 0x7fd84c042dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 --2- 172.21.15.62:0/3058677600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd86c06e760 0x7fd86c11b360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 >> 172.21.15.62:0/3058677600 conn(0x7fd86c071630 msgr2=0x7fd86c12c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 shutdown_connections 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.260+0000 7fd870cf7640 1 -- 172.21.15.62:0/3058677600 wait complete. 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd8f01238f0 con 0x7fd8f0130250 2024-09-12T17:10:58.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8e77fe640 1 -- 172.21.15.62:0/2717820884 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd8f01238f0 con 0x7fd8f0130250 2024-09-12T17:10:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 msgr2=0x7fd8f012f710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 0x7fd8f012f710 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 msgr2=0x7fd8d003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 0x7fd8d003d690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd8d80ad000 tx=0x7fd8d80a6000 comp rx=0 tx=0).stop 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 msgr2=0x7fd8f006e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.268+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c600 tx=0x7fd8e000cac0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 shutdown_connections 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7fd8f0130250 0x7fd8f012f710 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd8d003b1d0 0x7fd8d003d690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 --2- 172.21.15.62:0/2717820884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd8f0123510 0x7fd8f006e6b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 >> 172.21.15.62:0/2717820884 conn(0x7fd8f009b890 msgr2=0x7fd8f012dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 shutdown_connections 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7fd8f4914640 1 -- 172.21.15.62:0/2717820884 wait complete. 2024-09-12T17:10:58.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66f0073660 con 0x7f66dc040950 2024-09-12T17:10:58.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7f66d77fe640 1 -- 172.21.15.62:0/3508826449 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f66e800ad10 con 0x7f66dc040950 2024-09-12T17:10:58.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 msgr2=0x7f66dc042dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.272+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 0x7f66dc042dd0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 msgr2=0x7f66dc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 0x7f66dc03d690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f66e4007fd0 tx=0x7f66e4007900 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 msgr2=0x7f66f012ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f66e001a060 tx=0x7f66e001ac70 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 shutdown_connections 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f66dc040950 0x7f66dc042dd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f66dc03b1d0 0x7f66dc03d690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 --2- 172.21.15.62:0/3508826449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66f006f3c0 0x7f66f012ca00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 >> 172.21.15.62:0/3508826449 conn(0x7f66f009b890 msgr2=0x7f66f0131380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 shutdown_connections 2024-09-12T17:10:58.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.276+0000 7f66f5734640 1 -- 172.21.15.62:0/3508826449 wait complete. 2024-09-12T17:10:58.284 INFO:teuthology.orchestra.run.smithi062.stdout:38654705670 2024-09-12T17:10:58.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:58.285 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-09-12T17:10:58.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:58.293 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-09-12T17:10:58.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:58.295 INFO:teuthology.orchestra.run.smithi062.stdout:42949672966 2024-09-12T17:10:58.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:58.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.392+0000 7f936b0f1640 1 Processor -- start 2024-09-12T17:10:58.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.392+0000 7f936b0f1640 1 -- start start 2024-09-12T17:10:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a2e181640 1 Processor -- start 2024-09-12T17:10:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f936b0f1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f936406df40 0x7f93641347d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f936b0f1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936409d740 con 0x7f936409c160 2024-09-12T17:10:58.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f936b0f1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f936409fe30 con 0x7f936406df40 2024-09-12T17:10:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a2e181640 1 -- start start 2024-09-12T17:10:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f9368e8d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f936409c160 0x7f936409c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36370/0 (socket says 172.21.15.62:36370) 2024-09-12T17:10:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f9368e8d640 1 -- 172.21.15.62:0/716957125 learned_addr learned my addr 172.21.15.62:0/716957125 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f9363fff640 1 --2- 172.21.15.62:0/716957125 >> v2:172.21.15.62:3300/0 conn(0x7f936406df40 0x7f93641347d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f93637fe640 1 -- 172.21.15.62:0/716957125 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747192998 0 0) 0x7f936409d740 con 0x7f936409c160 2024-09-12T17:10:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f93637fe640 1 -- 172.21.15.62:0/716957125 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9354003530 con 0x7f936409c160 2024-09-12T17:10:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a2e181640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a2809c160 0x7f0a2809c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a2e181640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2809d690 con 0x7f0a2806e760 2024-09-12T17:10:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a2e181640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0a28073a20 con 0x7f0a2809c160 2024-09-12T17:10:58.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f9363fff640 1 -- 172.21.15.62:0/716957125 >> v1:172.21.15.62:6789/0 conn(0x7f936409c160 legacy=0x7f936409c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f9363fff640 1 -- 172.21.15.62:0/716957125 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936406e790 con 0x7f936406df40 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a26ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0a2806e760 0x7f0a28128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36372/0 (socket says 172.21.15.62:36372) 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a26ffd640 1 -- 172.21.15.62:0/3810230921 learned_addr learned my addr 172.21.15.62:0/3810230921 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a277fe640 1 --2- 172.21.15.62:0/3810230921 >> v2:172.21.15.62:3300/0 conn(0x7f0a2809c160 0x7f0a2809c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a267fc640 1 -- 172.21.15.62:0/3810230921 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555506325 0 0) 0x7f0a2809d690 con 0x7f0a2806e760 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a267fc640 1 -- 172.21.15.62:0/3810230921 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a10003530 con 0x7f0a2806e760 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a277fe640 1 -- 172.21.15.62:0/3810230921 >> v1:172.21.15.62:6789/0 conn(0x7f0a2806e760 legacy=0x7f0a28128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a277fe640 1 -- 172.21.15.62:0/3810230921 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2806deb0 con 0x7f0a2809c160 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a277fe640 1 --2- 172.21.15.62:0/3810230921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2809c160 0x7f0a2809c540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009740 tx=0x7f0a1801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fe40447e62f3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a267fc640 1 -- 172.21.15.62:0/3810230921 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a180b1070 con 0x7f0a2809c160 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a267fc640 1 -- 172.21.15.62:0/3810230921 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a180ac520 con 0x7f0a2809c160 2024-09-12T17:10:58.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.396+0000 7f0a267fc640 1 -- 172.21.15.62:0/3810230921 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a180ac800 con 0x7f0a2809c160 2024-09-12T17:10:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9363fff640 1 --2- 172.21.15.62:0/716957125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f93641347d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9350009740 tx=0x7f935001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc922ea8f0255a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f93637fe640 1 -- 172.21.15.62:0/716957125 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93500b0070 con 0x7f936406df40 2024-09-12T17:10:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f93637fe640 1 -- 172.21.15.62:0/716957125 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93500ab530 con 0x7f936406df40 2024-09-12T17:10:58.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f93637fe640 1 -- 172.21.15.62:0/716957125 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93500ab830 con 0x7f936406df40 2024-09-12T17:10:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/3810230921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2809c160 msgr2=0x7f0a2809c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 --2- 172.21.15.62:0/3810230921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2809c160 0x7f0a2809c540 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009740 tx=0x7f0a1801c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/3810230921 shutdown_connections 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 --2- 172.21.15.62:0/3810230921 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2809c160 0x7f0a2809c540 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/3810230921 >> 172.21.15.62:0/3810230921 conn(0x7f0a28071630 msgr2=0x7f0a2809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/3810230921 shutdown_connections 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/3810230921 wait complete. 2024-09-12T17:10:58.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- 172.21.15.62:0/716957125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 msgr2=0x7f93641347d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 --2- 172.21.15.62:0/716957125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f93641347d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9350009740 tx=0x7f935001c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- 172.21.15.62:0/716957125 shutdown_connections 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 --2- 172.21.15.62:0/716957125 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f93641347d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- 172.21.15.62:0/716957125 >> 172.21.15.62:0/716957125 conn(0x7f93640715e0 msgr2=0x7f936409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- 172.21.15.62:0/716957125 shutdown_connections 2024-09-12T17:10:58.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- 172.21.15.62:0/716957125 wait complete. 2024-09-12T17:10:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 Processor -- start 2024-09-12T17:10:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- start start 2024-09-12T17:10:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a28137b80 con 0x7f0a2806e760 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a277fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a277fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33398/0 (socket says 172.21.15.62:33398) 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a277fe640 1 -- 172.21.15.62:0/1309960820 learned_addr learned my addr 172.21.15.62:0/1309960820 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 Processor -- start 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- start start 2024-09-12T17:10:58.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a277fe640 1 -- 172.21.15.62:0/1309960820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a28129b80 con 0x7f0a2806e760 2024-09-12T17:10:58.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f936b0f1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f93641378c0 con 0x7f936406df40 2024-09-12T17:10:58.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a277fe640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a18019fa0 tx=0x7f0a1801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9368e8d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9368e8d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33410/0 (socket says 172.21.15.62:33410) 2024-09-12T17:10:58.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9368e8d640 1 -- 172.21.15.62:0/2461902009 learned_addr learned my addr 172.21.15.62:0/2461902009 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a180b1050 con 0x7f0a2806e760 2024-09-12T17:10:58.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a180b2040 con 0x7f0a2806e760 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/1309960820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2811aef0 con 0x7f0a2806e760 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a18004020 con 0x7f0a2806e760 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f0a2e181640 1 -- 172.21.15.62:0/1309960820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28127dc0 con 0x7f0a2806e760 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9368e8d640 1 -- 172.21.15.62:0/2461902009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9364134460 con 0x7f936406df40 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.400+0000 7f9368e8d640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f935800c450 tx=0x7f935800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9358017070 con 0x7f936406df40 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f936b0f1640 1 -- 172.21.15.62:0/2461902009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9364133890 con 0x7f936406df40 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f936b0f1640 1 -- 172.21.15.62:0/2461902009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936411b470 con 0x7f936406df40 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358005ce0 con 0x7f936406df40 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9358007200 con 0x7f936406df40 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a00005090 con 0x7f0a2806e760 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a180bf060 con 0x7f0a2806e760 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a0ffff640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 0x7f0a1403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0a180e8660 con 0x7f0a2806e760 2024-09-12T17:10:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f933c005090 con 0x7f936406df40 2024-09-12T17:10:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f935801a070 con 0x7f936406df40 2024-09-12T17:10:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a26ffd640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 0x7f0a1403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 0x7f934803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f935804dfe0 con 0x7f936406df40 2024-09-12T17:10:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f9363fff640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 0x7f934803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f0a26ffd640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 0x7f0a1403d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c007fd0 tx=0x7f0a1c007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.404+0000 7f9363fff640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 0x7f934803d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93500ad000 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.408+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0a28129b80 con 0x7f0a2806e760 2024-09-12T17:10:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.412+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f935801b3b0 con 0x7f936406df40 2024-09-12T17:10:58.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ced050640 1 Processor -- start 2024-09-12T17:10:58.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ced050640 1 -- start start 2024-09-12T17:10:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ced050640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ce8113600 0x7f1ce81322f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ced050640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce8124170 con 0x7f1ce8123680 2024-09-12T17:10:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ced050640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce8114dd0 con 0x7f1ce8113600 2024-09-12T17:10:58.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f82c1618640 1 Processor -- start 2024-09-12T17:10:58.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ce6d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1ce8123680 0x7f1ce8123a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36380/0 (socket says 172.21.15.62:36380) 2024-09-12T17:10:58.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ce6d9d640 1 -- 172.21.15.62:0/2402187478 learned_addr learned my addr 172.21.15.62:0/2402187478 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f82c1618640 1 -- start start 2024-09-12T17:10:58.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ce659c640 1 --2- 172.21.15.62:0/2402187478 >> v2:172.21.15.62:3300/0 conn(0x7f1ce8113600 0x7f1ce81322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ce659c640 1 -- 172.21.15.62:0/2402187478 >> v1:172.21.15.62:6789/0 conn(0x7f1ce8123680 legacy=0x7f1ce8123a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f1ce659c640 1 -- 172.21.15.62:0/2402187478 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce8073bb0 con 0x7f1ce8113600 2024-09-12T17:10:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f82c1618640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82bc09c160 0x7f82bc09c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f82c1618640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82bc09d690 con 0x7f82bc06e760 2024-09-12T17:10:58.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.448+0000 7f82c1618640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f82bc073a20 con 0x7f82bc09c160 2024-09-12T17:10:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82ba7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f82bc06e760 0x7f82bc128b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36388/0 (socket says 172.21.15.62:36388) 2024-09-12T17:10:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82ba7fc640 1 -- 172.21.15.62:0/428371419 learned_addr learned my addr 172.21.15.62:0/428371419 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82baffd640 1 --2- 172.21.15.62:0/428371419 >> v2:172.21.15.62:3300/0 conn(0x7f82bc09c160 0x7f82bc09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82baffd640 1 -- 172.21.15.62:0/428371419 >> v1:172.21.15.62:6789/0 conn(0x7f82bc06e760 legacy=0x7f82bc128b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82baffd640 1 -- 172.21.15.62:0/428371419 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc06deb0 con 0x7f82bc09c160 2024-09-12T17:10:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82b9ffb640 1 -- 172.21.15.62:0/428371419 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763083424 0 0) 0x7f82bc09d690 con 0x7f82bc06e760 2024-09-12T17:10:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ce659c640 1 --2- 172.21.15.62:0/2402187478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce81322f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009740 tx=0x7f1cdc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8e8ddf29d23547 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ce5d9b640 1 -- 172.21.15.62:0/2402187478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cdc0b0070 con 0x7f1ce8113600 2024-09-12T17:10:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ce5d9b640 1 -- 172.21.15.62:0/2402187478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0ab530 con 0x7f1ce8113600 2024-09-12T17:10:58.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ce5d9b640 1 -- 172.21.15.62:0/2402187478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cdc0ab830 con 0x7f1ce8113600 2024-09-12T17:10:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- 172.21.15.62:0/2402187478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 msgr2=0x7f1ce81322f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 --2- 172.21.15.62:0/2402187478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce81322f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009740 tx=0x7f1cdc01c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- 172.21.15.62:0/2402187478 shutdown_connections 2024-09-12T17:10:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 --2- 172.21.15.62:0/2402187478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce81322f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- 172.21.15.62:0/2402187478 >> 172.21.15.62:0/2402187478 conn(0x7f1ce80709b0 msgr2=0x7f1ce8072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82baffd640 1 --2- 172.21.15.62:0/428371419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc09c160 0x7f82bc09c540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009740 tx=0x7f82ac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5623bf18b120672f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- 172.21.15.62:0/2402187478 shutdown_connections 2024-09-12T17:10:58.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- 172.21.15.62:0/2402187478 wait complete. 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82b9ffb640 1 -- 172.21.15.62:0/428371419 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82ac0b1070 con 0x7f82bc09c160 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82b9ffb640 1 -- 172.21.15.62:0/428371419 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac0ac520 con 0x7f82bc09c160 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82b9ffb640 1 -- 172.21.15.62:0/428371419 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82ac0ac820 con 0x7f82bc09c160 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82c1618640 1 -- 172.21.15.62:0/428371419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc09c160 msgr2=0x7f82bc09c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f82c1618640 1 --2- 172.21.15.62:0/428371419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc09c160 0x7f82bc09c540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009740 tx=0x7f82ac01c370 comp rx=0 tx=0).stop 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 Processor -- start 2024-09-12T17:10:58.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.452+0000 7f1ced050640 1 -- start start 2024-09-12T17:10:58.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- 172.21.15.62:0/428371419 shutdown_connections 2024-09-12T17:10:58.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 --2- 172.21.15.62:0/428371419 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc09c160 0x7f82bc09c540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- 172.21.15.62:0/428371419 >> 172.21.15.62:0/428371419 conn(0x7f82bc071630 msgr2=0x7f82bc09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ced050640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ced050640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce81353e0 con 0x7f1ce8113600 2024-09-12T17:10:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- 172.21.15.62:0/428371419 shutdown_connections 2024-09-12T17:10:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- 172.21.15.62:0/428371419 wait complete. 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33422/0 (socket says 172.21.15.62:33422) 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce6d9d640 1 -- 172.21.15.62:0/2190966597 learned_addr learned my addr 172.21.15.62:0/2190966597 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce6d9d640 1 -- 172.21.15.62:0/2190966597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce8131480 con 0x7f1ce8113600 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce6d9d640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c450 tx=0x7f1cd800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd8017070 con 0x7f1ce8113600 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd8005c20 con 0x7f1ce8113600 2024-09-12T17:10:58.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd80070d0 con 0x7f1ce8113600 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce81325f0 con 0x7f1ce8113600 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81218b0 con 0x7f1ce8113600 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 Processor -- start 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- start start 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82c1618640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc137b80 con 0x7f82bc06e760 2024-09-12T17:10:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce8131220 con 0x7f1ce8113600 2024-09-12T17:10:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82baffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82baffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33430/0 (socket says 172.21.15.62:33430) 2024-09-12T17:10:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82baffd640 1 -- 172.21.15.62:0/1109358610 learned_addr learned my addr 172.21.15.62:0/1109358610 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:58.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82baffd640 1 -- 172.21.15.62:0/1109358610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc11a580 con 0x7f82bc06e760 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f82baffd640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0af040 tx=0x7f82ac019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1cd801a070 con 0x7f1ce8113600 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 0x7f1cd403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f1cd804e480 con 0x7f1ce8113600 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.456+0000 7f1ce659c640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 0x7f1cd403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.460+0000 7f1ce659c640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 0x7f1cd403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0ad000 tx=0x7f1cdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.460+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82ac0b9070 con 0x7f82bc06e760 2024-09-12T17:10:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.460+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac0b5410 con 0x7f82bc06e760 2024-09-12T17:10:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.460+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82ac0b1040 con 0x7f82bc06e760 2024-09-12T17:10:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.460+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f1ce8131480 con 0x7f1ce8113600 2024-09-12T17:10:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc127e30 con 0x7f82bc06e760 2024-09-12T17:10:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc1282f0 con 0x7f82bc06e760 2024-09-12T17:10:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc11a810 con 0x7f82bc06e760 2024-09-12T17:10:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f82ac0bc070 con 0x7f82bc06e760 2024-09-12T17:10:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82a37fe640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 0x7f82a803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f82ac0e8ba0 con 0x7f82bc06e760 2024-09-12T17:10:58.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82ba7fc640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 0x7f82a803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.464+0000 7f82ba7fc640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 0x7f82a803d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f82b0007fd0 tx=0x7f82b00078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.468+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f82ac0a9070 con 0x7f82bc06e760 2024-09-12T17:10:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.580+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0a00005380 con 0x7f0a2806e760 2024-09-12T17:10:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.580+0000 7f0a0ffff640 1 -- 172.21.15.62:0/1309960820 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a180a9070 con 0x7f0a2806e760 2024-09-12T17:10:58.584 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 msgr2=0x7f0a1403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 0x7f0a1403d690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c007fd0 tx=0x7f0a1c007900 comp rx=0 tx=0).stop 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 msgr2=0x7f0a281276b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a18019fa0 tx=0x7f0a1801abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 shutdown_connections 2024-09-12T17:10:58.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a1403b1d0 0x7f0a1403d690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 --2- 172.21.15.62:0/1309960820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a2806e760 0x7f0a281276b0 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a18019fa0 tx=0x7f0a1801abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 >> 172.21.15.62:0/1309960820 conn(0x7f0a28071630 msgr2=0x7f0a2812bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 shutdown_connections 2024-09-12T17:10:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f0a0dffb640 1 -- 172.21.15.62:0/1309960820 wait complete. 2024-09-12T17:10:58.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f933c005380 con 0x7f936406df40 2024-09-12T17:10:58.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.584+0000 7f93617fa640 1 -- 172.21.15.62:0/2461902009 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f935801b730 con 0x7f936406df40 2024-09-12T17:10:58.588 INFO:teuthology.orchestra.run.smithi062.stdout:38654705668 2024-09-12T17:10:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 msgr2=0x7f934803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 0x7f934803d690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f93500ad000 tx=0x7f9350008040 comp rx=0 tx=0).stop 2024-09-12T17:10:58.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 msgr2=0x7f9364119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f935800c450 tx=0x7f935800c910 comp rx=0 tx=0).stop 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 shutdown_connections 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f934803b1d0 0x7f934803d690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 --2- 172.21.15.62:0/2461902009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f936406df40 0x7f9364119a80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 >> 172.21.15.62:0/2461902009 conn(0x7f93640715e0 msgr2=0x7f936412be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 shutdown_connections 2024-09-12T17:10:58.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.588+0000 7f934effd640 1 -- 172.21.15.62:0/2461902009 wait complete. 2024-09-12T17:10:58.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-09-12T17:10:58.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705668 for osd.2 2024-09-12T17:10:58.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.700+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1ce8068e50 con 0x7f1ce8113600 2024-09-12T17:10:58.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.700+0000 7f1ccf7fe640 1 -- 172.21.15.62:0/2190966597 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cd804c420 con 0x7f1ce8113600 2024-09-12T17:10:58.704 INFO:teuthology.orchestra.run.smithi062.stdout:42949672965 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 msgr2=0x7f1cd403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 0x7f1cd403d690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc0ad000 tx=0x7f1cdc008040 comp rx=0 tx=0).stop 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 msgr2=0x7f1ce8121370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c450 tx=0x7f1cd800c910 comp rx=0 tx=0).stop 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 shutdown_connections 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1cd403b1d0 0x7f1cd403d690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 --2- 172.21.15.62:0/2190966597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ce8113600 0x7f1ce8121370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 >> 172.21.15.62:0/2190966597 conn(0x7f1ce80709b0 msgr2=0x7f1ce8072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 shutdown_connections 2024-09-12T17:10:58.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f1ced050640 1 -- 172.21.15.62:0/2190966597 wait complete. 2024-09-12T17:10:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.704+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f82bc068e50 con 0x7f82bc06e760 2024-09-12T17:10:58.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82a37fe640 1 -- 172.21.15.62:0/1109358610 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82ac015ff0 con 0x7f82bc06e760 2024-09-12T17:10:58.709 INFO:teuthology.orchestra.run.smithi062.stdout:47244640261 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 msgr2=0x7f82a803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 0x7f82a803d690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f82b0007fd0 tx=0x7f82b00078e0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 msgr2=0x7f82bc1278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f82ac0af040 tx=0x7f82ac019110 comp rx=0 tx=0).stop 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 shutdown_connections 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f82a803b1d0 0x7f82a803d690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 --2- 172.21.15.62:0/1109358610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82bc06e760 0x7f82bc1278f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 >> 172.21.15.62:0/1109358610 conn(0x7f82bc071630 msgr2=0x7f82bc09d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 shutdown_connections 2024-09-12T17:10:58.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:58.708+0000 7f82c1618640 1 -- 172.21.15.62:0/1109358610 wait complete. 2024-09-12T17:10:58.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.0 2024-09-12T17:10:58.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-09-12T17:10:59.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:10:59.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:10:59.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:10:59.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:10:59.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f546501f640 1 Processor -- start 2024-09-12T17:10:59.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f546501f640 1 -- start start 2024-09-12T17:10:59.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f546501f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f546012bb80 0x7f546012bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f546501f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5460072ab0 con 0x7f546012c4a0 2024-09-12T17:10:59.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f546501f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f54600721e0 con 0x7f546012bb80 2024-09-12T17:10:59.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f546012bb80 0x7f546012bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545e59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f546012c4a0 0x7f546006fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36398/0 (socket says 172.21.15.62:36398) 2024-09-12T17:10:59.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545e59c640 1 -- 172.21.15.62:0/765985287 learned_addr learned my addr 172.21.15.62:0/765985287 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:59.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545ed9d640 1 -- 172.21.15.62:0/765985287 >> v1:172.21.15.62:6789/0 conn(0x7f546012c4a0 legacy=0x7f546006fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545dd9b640 1 -- 172.21.15.62:0/765985287 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043634364 0 0) 0x7f5460072ab0 con 0x7f546012c4a0 2024-09-12T17:10:59.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.740+0000 7f545ed9d640 1 -- 172.21.15.62:0/765985287 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460070370 con 0x7f546012bb80 2024-09-12T17:10:59.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f545ed9d640 1 --2- 172.21.15.62:0/765985287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012bb80 0x7f546012bf60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5450009740 tx=0x7f545001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ad97ede0f076a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f545dd9b640 1 -- 172.21.15.62:0/765985287 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54500b1070 con 0x7f546012bb80 2024-09-12T17:10:59.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f545dd9b640 1 -- 172.21.15.62:0/765985287 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54500ac520 con 0x7f546012bb80 2024-09-12T17:10:59.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f545dd9b640 1 -- 172.21.15.62:0/765985287 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54500ac820 con 0x7f546012bb80 2024-09-12T17:10:59.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f546501f640 1 -- 172.21.15.62:0/765985287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012bb80 msgr2=0x7f546012bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f546501f640 1 --2- 172.21.15.62:0/765985287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012bb80 0x7f546012bf60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5450009740 tx=0x7f545001c370 comp rx=0 tx=0).stop 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f546501f640 1 -- 172.21.15.62:0/765985287 shutdown_connections 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f546501f640 1 --2- 172.21.15.62:0/765985287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012bb80 0x7f546012bf60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.744+0000 7f546501f640 1 -- 172.21.15.62:0/765985287 >> 172.21.15.62:0/765985287 conn(0x7f546009b890 msgr2=0x7f546006dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- 172.21.15.62:0/765985287 shutdown_connections 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- 172.21.15.62:0/765985287 wait complete. 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 Processor -- start 2024-09-12T17:10:59.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- start start 2024-09-12T17:10:59.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5460071f00 con 0x7f546012c4a0 2024-09-12T17:10:59.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f545ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f545ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33452/0 (socket says 172.21.15.62:33452) 2024-09-12T17:10:59.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f545ed9d640 1 -- 172.21.15.62:0/673180359 learned_addr learned my addr 172.21.15.62:0/673180359 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f545ed9d640 1 -- 172.21.15.62:0/673180359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460073410 con 0x7f546012c4a0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f545ed9d640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f545001aa20 tx=0x7f545001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54500b1050 con 0x7f546012c4a0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54500b2040 con 0x7f546012c4a0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5460120ca0 con 0x7f546012c4a0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54500aba20 con 0x7f546012c4a0 2024-09-12T17:10:59.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.748+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f546012d290 con 0x7f546012c4a0 2024-09-12T17:10:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f546012bf60 con 0x7f546012c4a0 2024-09-12T17:10:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54500bf030 con 0x7f546012c4a0 2024-09-12T17:10:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f54477fe640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 0x7f544c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f54500bd070 con 0x7f546012c4a0 2024-09-12T17:10:59.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f545e59c640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 0x7f544c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.752+0000 7f545e59c640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 0x7f544c03d690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.760+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f54500c6060 con 0x7f546012c4a0 2024-09-12T17:10:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc8586640 1 Processor -- start 2024-09-12T17:10:59.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc8586640 1 -- start start 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc8586640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc0113020 0x7f8cc012c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc8586640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cc0112280 con 0x7f8cc012c600 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc8586640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8cc0123060 con 0x7f8cc0113020 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc5b21640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc0113020 0x7f8cc012c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc5b21640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8cc0113020 0x7f8cc012c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33462/0 (socket says 172.21.15.62:33462) 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc6322640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8cc012c600 0x7f8cc0128960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36402/0 (socket says 172.21.15.62:36402) 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc5b21640 1 -- 172.21.15.62:0/3615560061 learned_addr learned my addr 172.21.15.62:0/3615560061 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc5b21640 1 -- 172.21.15.62:0/3615560061 >> v1:172.21.15.62:6789/0 conn(0x7f8cc012c600 legacy=0x7f8cc0128960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.764+0000 7f8cc5b21640 1 -- 172.21.15.62:0/3615560061 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc012c140 con 0x7f8cc0113020 2024-09-12T17:10:59.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc5b21640 1 --2- 172.21.15.62:0/3615560061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc012c9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00097f0 tx=0x7f8cb001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884a6744785c3ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc5320640 1 -- 172.21.15.62:0/3615560061 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cb00b0070 con 0x7f8cc0113020 2024-09-12T17:10:59.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc5320640 1 -- 172.21.15.62:0/3615560061 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb00ab530 con 0x7f8cc0113020 2024-09-12T17:10:59.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc5320640 1 -- 172.21.15.62:0/3615560061 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cb00ab830 con 0x7f8cc0113020 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- 172.21.15.62:0/3615560061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 msgr2=0x7f8cc012c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 --2- 172.21.15.62:0/3615560061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc012c9e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00097f0 tx=0x7f8cb001c430 comp rx=0 tx=0).stop 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- 172.21.15.62:0/3615560061 shutdown_connections 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 --2- 172.21.15.62:0/3615560061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc012c9e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- 172.21.15.62:0/3615560061 >> 172.21.15.62:0/3615560061 conn(0x7f8cc00709b0 msgr2=0x7f8cc0072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- 172.21.15.62:0/3615560061 shutdown_connections 2024-09-12T17:10:59.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- 172.21.15.62:0/3615560061 wait complete. 2024-09-12T17:10:59.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 Processor -- start 2024-09-12T17:10:59.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- start start 2024-09-12T17:10:59.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc8586640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8cc0134e20 con 0x7f8cc0113020 2024-09-12T17:10:59.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc6322640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc6322640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33468/0 (socket says 172.21.15.62:33468) 2024-09-12T17:10:59.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc6322640 1 -- 172.21.15.62:0/1064594508 learned_addr learned my addr 172.21.15.62:0/1064594508 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc6322640 1 -- 172.21.15.62:0/1064594508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cc0126630 con 0x7f8cc0113020 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cc6322640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c480 tx=0x7f8cbc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc007410 con 0x7f8cc0113020 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.768+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cbc0075b0 con 0x7f8cc0113020 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cc00728e0 con 0x7f8cc0113020 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cbc004920 con 0x7f8cc0113020 2024-09-12T17:10:59.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cc01218b0 con 0x7f8cc0113020 2024-09-12T17:10:59.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cc0121b30 con 0x7f8cc0113020 2024-09-12T17:10:59.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8cbc01a020 con 0x7f8cc0113020 2024-09-12T17:10:59.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cb6ffd640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 0x7f8ca403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f8cbc04e460 con 0x7f8cc0113020 2024-09-12T17:10:59.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cc5b21640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 0x7f8ca403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.772+0000 7f8cc5b21640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 0x7f8ca403d6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00ad000 tx=0x7f8cb00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.776+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f8cbc0113a0 con 0x7f8cc0113020 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a7a9cf640 1 Processor -- start 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a7a9cf640 1 -- start start 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a7a9cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a74132840 0x7f0a74134c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a7a9cf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7409ce70 con 0x7f0a7412c2a0 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a7a9cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7409d8f0 con 0x7f0a74132840 2024-09-12T17:10:59.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a737fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a74132840 0x7f0a74134c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a737fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a74132840 0x7f0a74134c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33476/0 (socket says 172.21.15.62:33476) 2024-09-12T17:10:59.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a737fe640 1 -- 172.21.15.62:0/1269724819 learned_addr learned my addr 172.21.15.62:0/1269724819 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a737fe640 1 -- 172.21.15.62:0/1269724819 >> v1:172.21.15.62:6789/0 conn(0x7f0a7412c2a0 legacy=0x7f0a7412c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.848+0000 7f0a737fe640 1 -- 172.21.15.62:0/1269724819 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74073c00 con 0x7f0a74132840 2024-09-12T17:10:59.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a737fe640 1 --2- 172.21.15.62:0/1269724819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a74132840 0x7f0a74134c30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0a680097f0 tx=0x7f0a6801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353a66f44592e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a72ffd640 1 -- 172.21.15.62:0/1269724819 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680b0070 con 0x7f0a74132840 2024-09-12T17:10:59.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a72ffd640 1 -- 172.21.15.62:0/1269724819 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680ab530 con 0x7f0a74132840 2024-09-12T17:10:59.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a72ffd640 1 -- 172.21.15.62:0/1269724819 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680ab830 con 0x7f0a74132840 2024-09-12T17:10:59.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa48e522640 1 Processor -- start 2024-09-12T17:10:59.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa48e522640 1 -- start start 2024-09-12T17:10:59.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/1269724819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a74132840 msgr2=0x7f0a74134c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/1269724819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a74132840 0x7f0a74134c30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0a680097f0 tx=0x7f0a6801c430 comp rx=0 tx=0).stop 2024-09-12T17:10:59.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/1269724819 shutdown_connections 2024-09-12T17:10:59.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/1269724819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a74132840 0x7f0a74134c30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/1269724819 >> 172.21.15.62:0/1269724819 conn(0x7f0a740715b0 msgr2=0x7f0a7409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/1269724819 shutdown_connections 2024-09-12T17:10:59.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/1269724819 wait complete. 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa48e522640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa488132800 0x7fa488134bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa48e522640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48812c010 con 0x7fa48812c210 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa48e522640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa48809d9e0 con 0x7fa488132800 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa47ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa488132800 0x7fa488134bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa487fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa48812c210 0x7fa48812c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36422/0 (socket says 172.21.15.62:36422) 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa47ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa488132800 0x7fa488134bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33478/0 (socket says 172.21.15.62:33478) 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa487fff640 1 -- 172.21.15.62:0/2998136171 learned_addr learned my addr 172.21.15.62:0/2998136171 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa47ffff640 1 -- 172.21.15.62:0/2998136171 >> v1:172.21.15.62:6789/0 conn(0x7fa48812c210 legacy=0x7fa48812c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa4877fe640 1 -- 172.21.15.62:0/2998136171 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498841476 0 0) 0x7fa48812c010 con 0x7fa48812c210 2024-09-12T17:10:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7fa47ffff640 1 -- 172.21.15.62:0/2998136171 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48806df40 con 0x7fa488132800 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 Processor -- start 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.852+0000 7f0a7a9cf640 1 -- start start 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a7a9cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a7a9cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74137b10 con 0x7f0a7412c2a0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33492/0 (socket says 172.21.15.62:33492) 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a73fff640 1 -- 172.21.15.62:0/3062082585 learned_addr learned my addr 172.21.15.62:0/3062082585 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a73fff640 1 -- 172.21.15.62:0/3062082585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7411ab90 con 0x7f0a7412c2a0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a73fff640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c430 tx=0x7f0a6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64017070 con 0x7f0a7412c2a0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a64005200 con 0x7f0a7412c2a0 2024-09-12T17:10:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a74131670 con 0x7f0a7412c2a0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a64003600 con 0x7f0a7412c2a0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a74119fc0 con 0x7f0a7412c2a0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7412c680 con 0x7f0a7412c2a0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0a6401a070 con 0x7f0a7412c2a0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7fa47ffff640 1 --2- 172.21.15.62:0/2998136171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa488132800 0x7fa488134bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa470009740 tx=0x7fa47001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2da85bd65c8edc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 0x7f0a6003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f0a6404e050 con 0x7f0a7412c2a0 2024-09-12T17:10:59.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a737fe640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 0x7f0a6003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.856+0000 7f0a737fe640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 0x7f0a6003d690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a680ad000 tx=0x7f0a680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa4877fe640 1 -- 172.21.15.62:0/2998136171 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4700b0070 con 0x7fa488132800 2024-09-12T17:10:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa4877fe640 1 -- 172.21.15.62:0/2998136171 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4700ab530 con 0x7fa488132800 2024-09-12T17:10:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa4877fe640 1 -- 172.21.15.62:0/2998136171 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4700ab830 con 0x7fa488132800 2024-09-12T17:10:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f0a7411ab90 con 0x7f0a7412c2a0 2024-09-12T17:10:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 -- 172.21.15.62:0/2998136171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa488132800 msgr2=0x7fa488134bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 --2- 172.21.15.62:0/2998136171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa488132800 0x7fa488134bf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa470009740 tx=0x7fa47001c370 comp rx=0 tx=0).stop 2024-09-12T17:10:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 -- 172.21.15.62:0/2998136171 shutdown_connections 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 --2- 172.21.15.62:0/2998136171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa488132800 0x7fa488134bf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 -- 172.21.15.62:0/2998136171 >> 172.21.15.62:0/2998136171 conn(0x7fa488071650 msgr2=0x7fa48809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 -- 172.21.15.62:0/2998136171 shutdown_connections 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.860+0000 7fa48e522640 1 -- 172.21.15.62:0/2998136171 wait complete. 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 Processor -- start 2024-09-12T17:10:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 -- start start 2024-09-12T17:10:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa488137ad0 con 0x7fa48812c210 2024-09-12T17:10:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa487fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa487fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33502/0 (socket says 172.21.15.62:33502) 2024-09-12T17:10:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa487fff640 1 -- 172.21.15.62:0/2590342608 learned_addr learned my addr 172.21.15.62:0/2590342608 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:10:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa487fff640 1 -- 172.21.15.62:0/2590342608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa488130250 con 0x7fa48812c210 2024-09-12T17:10:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa487fff640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c3d0 tx=0x7fa47800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478007410 con 0x7fa48812c210 2024-09-12T17:10:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4780075d0 con 0x7fa48812c210 2024-09-12T17:10:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa488129c60 con 0x7fa48812c210 2024-09-12T17:10:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48811b2e0 con 0x7fa48812c210 2024-09-12T17:10:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa478004960 con 0x7fa48812c210 2024-09-12T17:10:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.864+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa46c005090 con 0x7fa48812c210 2024-09-12T17:10:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.868+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa478011070 con 0x7fa48812c210 2024-09-12T17:10:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.868+0000 7fa4857fa640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 0x7fa46803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:10:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.868+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fa47804ef00 con 0x7fa48812c210 2024-09-12T17:10:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.868+0000 7fa47ffff640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 0x7fa46803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:10:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.868+0000 7fa47ffff640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 0x7fa46803d690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ad000 tx=0x7fa470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:10:59.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.872+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fa488129c60 con 0x7fa48812c210 2024-09-12T17:10:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.944+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f54601217b0 con 0x7f546012c4a0 2024-09-12T17:10:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f54477fe640 1 -- 172.21.15.62:0/673180359 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54500a9070 con 0x7f546012c4a0 2024-09-12T17:10:59.950 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-09-12T17:10:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8cc0068e50 con 0x7f8cc0113020 2024-09-12T17:10:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cb6ffd640 1 -- 172.21.15.62:0/1064594508 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8cbc012e00 con 0x7f8cc0113020 2024-09-12T17:10:59.951 INFO:teuthology.orchestra.run.smithi062.stdout:38654705670 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 msgr2=0x7f8ca403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 0x7f8ca403d6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00ad000 tx=0x7f8cb00a6000 comp rx=0 tx=0).stop 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 msgr2=0x7f8cc0130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c480 tx=0x7f8cbc00c940 comp rx=0 tx=0).stop 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 shutdown_connections 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ca403b200 0x7f8ca403d6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 --2- 172.21.15.62:0/1064594508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8cc0113020 0x7f8cc0130370 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 >> 172.21.15.62:0/1064594508 conn(0x7f8cc00709b0 msgr2=0x7f8cc006dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 shutdown_connections 2024-09-12T17:10:59.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f8cc8586640 1 -- 172.21.15.62:0/1064594508 wait complete. 2024-09-12T17:10:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 msgr2=0x7f544c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 0x7f544c03d690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454007900 comp rx=0 tx=0).stop 2024-09-12T17:10:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 msgr2=0x7f546012cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:10:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f545001aa20 tx=0x7f545001abb0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 shutdown_connections 2024-09-12T17:10:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f544c03b1d0 0x7f544c03d690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 --2- 172.21.15.62:0/673180359 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f546012c4a0 0x7f546012cb80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:10:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 >> 172.21.15.62:0/673180359 conn(0x7f546009b890 msgr2=0x7f5460130560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:10:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 shutdown_connections 2024-09-12T17:10:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:10:59.948+0000 7f546501f640 1 -- 172.21.15.62:0/673180359 wait complete. 2024-09-12T17:10:59.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-09-12T17:10:59.970 DEBUG:teuthology.parallel:result is None 2024-09-12T17:10:59.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-09-12T17:10:59.979 DEBUG:teuthology.parallel:result is None 2024-09-12T17:11:00.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.068+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0a7406d2c0 con 0x7f0a7412c2a0 2024-09-12T17:11:00.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.068+0000 7f0a70ff9640 1 -- 172.21.15.62:0/3062082585 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0a64011590 con 0x7f0a7412c2a0 2024-09-12T17:11:00.072 INFO:teuthology.orchestra.run.smithi062.stdout:47244640262 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 msgr2=0x7f0a6003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 0x7f0a6003d690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f0a680ad000 tx=0x7f0a680a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 msgr2=0x7f0a74119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400c430 tx=0x7f0a6400c8f0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 shutdown_connections 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0a6003b1d0 0x7f0a6003d690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 --2- 172.21.15.62:0/3062082585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7412c2a0 0x7f0a74119a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 >> 172.21.15.62:0/3062082585 conn(0x7f0a740715b0 msgr2=0x7f0a74071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 shutdown_connections 2024-09-12T17:11:00.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.072+0000 7f0a7a9cf640 1 -- 172.21.15.62:0/3062082585 wait complete. 2024-09-12T17:11:00.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.1 2024-09-12T17:11:00.089 DEBUG:teuthology.parallel:result is None 2024-09-12T17:11:00.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa46c005650 con 0x7fa48812c210 2024-09-12T17:11:00.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa4857fa640 1 -- 172.21.15.62:0/2590342608 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa478011c60 con 0x7fa48812c210 2024-09-12T17:11:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:42949672966 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 msgr2=0x7fa46803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 0x7fa46803d690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ad000 tx=0x7fa470008040 comp rx=0 tx=0).stop 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 msgr2=0x7fa488119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c3d0 tx=0x7fa47800c890 comp rx=0 tx=0).stop 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 shutdown_connections 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa46803b1d0 0x7fa46803d690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 --2- 172.21.15.62:0/2590342608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa48812c210 0x7fa488119a80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 >> 172.21.15.62:0/2590342608 conn(0x7fa488071650 msgr2=0x7fa488071e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 shutdown_connections 2024-09-12T17:11:00.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.088+0000 7fa48e522640 1 -- 172.21.15.62:0/2590342608 wait complete. 2024-09-12T17:11:00.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.0 2024-09-12T17:11:00.107 DEBUG:teuthology.parallel:result is None 2024-09-12T17:11:00.108 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:11:00.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:11:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.260+0000 7f76cb8d9640 1 Processor -- start 2024-09-12T17:11:00.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.260+0000 7f76cb8d9640 1 -- start start 2024-09-12T17:11:00.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76c4110da0 0x7f76c4111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c4112730 con 0x7f76c41116c0 2024-09-12T17:11:00.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f76c4073a90 con 0x7f76c4110da0 2024-09-12T17:11:00.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c9675640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f76c4110da0 0x7f76c4111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c8e74640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76c41116c0 0x7f76c412be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36424/0 (socket says 172.21.15.62:36424) 2024-09-12T17:11:00.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c8e74640 1 -- 172.21.15.62:0/792944618 learned_addr learned my addr 172.21.15.62:0/792944618 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:11:00.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c9675640 1 -- 172.21.15.62:0/792944618 >> v1:172.21.15.62:6789/0 conn(0x7f76c41116c0 legacy=0x7f76c412be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c9675640 1 -- 172.21.15.62:0/792944618 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c4112b70 con 0x7f76c4110da0 2024-09-12T17:11:00.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76c9675640 1 --2- 172.21.15.62:0/792944618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c4111180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009740 tx=0x7f76b401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d317c7ec303594f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76bbfff640 1 -- 172.21.15.62:0/792944618 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b40b0070 con 0x7f76c4110da0 2024-09-12T17:11:00.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76bbfff640 1 -- 172.21.15.62:0/792944618 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b40ab530 con 0x7f76c4110da0 2024-09-12T17:11:00.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76bbfff640 1 -- 172.21.15.62:0/792944618 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b40ab830 con 0x7f76c4110da0 2024-09-12T17:11:00.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- 172.21.15.62:0/792944618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 msgr2=0x7f76c4111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/792944618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c4111180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009740 tx=0x7f76b401c370 comp rx=0 tx=0).stop 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- 172.21.15.62:0/792944618 shutdown_connections 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/792944618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c4111180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- 172.21.15.62:0/792944618 >> 172.21.15.62:0/792944618 conn(0x7f76c4070900 msgr2=0x7f76c4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- 172.21.15.62:0/792944618 shutdown_connections 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.264+0000 7f76cb8d9640 1 -- 172.21.15.62:0/792944618 wait complete. 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 Processor -- start 2024-09-12T17:11:00.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 -- start start 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f76c4138310 con 0x7f76c4110da0 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c9675640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c9675640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33516/0 (socket says 172.21.15.62:33516) 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c9675640 1 -- 172.21.15.62:0/71029335 learned_addr learned my addr 172.21.15.62:0/71029335 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c9675640 1 -- 172.21.15.62:0/71029335 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c411bf10 con 0x7f76c4110da0 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c9675640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76b4019fa0 tx=0x7f76b401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b40b0050 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b40b1040 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c411c390 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76b40b5930 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c41c7d30 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c4111180 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f76b40be030 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 0x7f76a803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f76b40bc070 con 0x7f76c4110da0 2024-09-12T17:11:00.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c8e74640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 0x7f76a803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.268+0000 7f76c8e74640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 0x7f76a803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c0001670 tx=0x7f76c0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.272+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f76b40c5020 con 0x7f76c4110da0 2024-09-12T17:11:00.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.432+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76c4114400 con 0x7f76a803b1d0 2024-09-12T17:11:00.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76b9ffb640 1 -- 172.21.15.62:0/71029335 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32235 (secure 0 0 0) 0x7f76c4114400 con 0x7f76a803b1d0 2024-09-12T17:11:00.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:11:00.439 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 msgr2=0x7f76a803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 0x7f76a803d690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f76c0001670 tx=0x7f76c0007ad0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 msgr2=0x7f76c41c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f76b4019fa0 tx=0x7f76b401abb0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 shutdown_connections 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76a803b1d0 0x7f76a803d690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 --2- 172.21.15.62:0/71029335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4110da0 0x7f76c41c7620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 >> 172.21.15.62:0/71029335 conn(0x7f76c4070900 msgr2=0x7f76c4070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 shutdown_connections 2024-09-12T17:11:00.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.436+0000 7f76cb8d9640 1 -- 172.21.15.62:0/71029335 wait complete. 2024-09-12T17:11:00.456 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-12T17:10:58.654042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1370114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.890700"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779569+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:10:56.779569+0000","last_peered":"2024-09-12T17:10:56.779569+0000","last_clean":"2024-09-12T17:10:56.779569+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:10:56.779569+0000","last_undegraded":"2024-09-12T17:10:56.779569+0000","last_fullsized":"2024-09-12T17:10:56.779569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.783181+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:10:56.783181+0000","last_peered":"2024-09-12T17:10:56.783181+0000","last_clean":"2024-09-12T17:10:56.783181+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:10:56.783181+0000","last_undegraded":"2024-09-12T17:10:56.783181+0000","last_fullsized":"2024-09-12T17:10:56.783181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779865+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:10:56.779865+0000","last_peered":"2024-09-12T17:10:56.779865+0000","last_clean":"2024-09-12T17:10:56.779865+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:10:56.779865+0000","last_undegraded":"2024-09-12T17:10:56.779865+0000","last_fullsized":"2024-09-12T17:10:56.779865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.783685+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:10:56.783685+0000","last_peered":"2024-09-12T17:10:56.783685+0000","last_clean":"2024-09-12T17:10:56.783685+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:10:56.783685+0000","last_undegraded":"2024-09-12T17:10:56.783685+0000","last_fullsized":"2024-09-12T17:10:56.783685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779428+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:10:56.779428+0000","last_peered":"2024-09-12T17:10:56.779428+0000","last_clean":"2024-09-12T17:10:56.779428+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:10:56.779428+0000","last_undegraded":"2024-09-12T17:10:56.779428+0000","last_fullsized":"2024-09-12T17:10:56.779428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:57.774448+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:10:57.774448+0000","last_peered":"2024-09-12T17:10:57.774448+0000","last_clean":"2024-09-12T17:10:57.774448+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:10:57.774448+0000","last_undegraded":"2024-09-12T17:10:57.774448+0000","last_fullsized":"2024-09-12T17:10:57.774448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.777829+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:10:56.777829+0000","last_peered":"2024-09-12T17:10:56.777829+0000","last_clean":"2024-09-12T17:10:56.777829+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:10:56.777829+0000","last_undegraded":"2024-09-12T17:10:56.777829+0000","last_fullsized":"2024-09-12T17:10:56.777829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779135+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:10:56.779135+0000","last_peered":"2024-09-12T17:10:56.779135+0000","last_clean":"2024-09-12T17:10:56.779135+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:10:56.779135+0000","last_undegraded":"2024-09-12T17:10:56.779135+0000","last_fullsized":"2024-09-12T17:10:56.779135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.772469+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:10:56.772469+0000","last_peered":"2024-09-12T17:10:56.772469+0000","last_clean":"2024-09-12T17:10:56.772469+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:10:56.772469+0000","last_undegraded":"2024-09-12T17:10:56.772469+0000","last_fullsized":"2024-09-12T17:10:56.772469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:11:00.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:11:00.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.572+0000 7fb7d2854640 1 Processor -- start 2024-09-12T17:11:00.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.572+0000 7fb7d2854640 1 -- start start 2024-09-12T17:11:00.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7cc12aee0 0x7fb7cc12b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc0008e0 con 0x7fb7cc12f110 2024-09-12T17:11:00.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc071e70 con 0x7fb7cc12aee0 2024-09-12T17:11:00.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb7cc12aee0 0x7fb7cc12b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cb7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb7cc12f110 0x7fb7cc12f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36430/0 (socket says 172.21.15.62:36430) 2024-09-12T17:11:00.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cb7fe640 1 -- 172.21.15.62:0/3395288385 learned_addr learned my addr 172.21.15.62:0/3395288385 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:11:00.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cbfff640 1 -- 172.21.15.62:0/3395288385 >> v1:172.21.15.62:6789/0 conn(0x7fb7cc12f110 legacy=0x7fb7cc12f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cbfff640 1 -- 172.21.15.62:0/3395288385 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc0a30b0 con 0x7fb7cc12aee0 2024-09-12T17:11:00.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7cbfff640 1 --2- 172.21.15.62:0/3395288385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc12b2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009740 tx=0x7fb7bc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0c15ca56a76601 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7caffd640 1 -- 172.21.15.62:0/3395288385 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0b1070 con 0x7fb7cc12aee0 2024-09-12T17:11:00.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7caffd640 1 -- 172.21.15.62:0/3395288385 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0ac520 con 0x7fb7cc12aee0 2024-09-12T17:11:00.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7caffd640 1 -- 172.21.15.62:0/3395288385 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0ac820 con 0x7fb7cc12aee0 2024-09-12T17:11:00.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- 172.21.15.62:0/3395288385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 msgr2=0x7fb7cc12b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 --2- 172.21.15.62:0/3395288385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc12b2c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc009740 tx=0x7fb7bc01c370 comp rx=0 tx=0).stop 2024-09-12T17:11:00.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- 172.21.15.62:0/3395288385 shutdown_connections 2024-09-12T17:11:00.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 --2- 172.21.15.62:0/3395288385 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc12b2c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- 172.21.15.62:0/3395288385 >> 172.21.15.62:0/3395288385 conn(0x7fb7cc0a0a60 msgr2=0x7fb7cc06e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- 172.21.15.62:0/3395288385 shutdown_connections 2024-09-12T17:11:00.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.576+0000 7fb7d2854640 1 -- 172.21.15.62:0/3395288385 wait complete. 2024-09-12T17:11:00.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 Processor -- start 2024-09-12T17:11:00.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 -- start start 2024-09-12T17:11:00.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc12b980 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33532/0 (socket says 172.21.15.62:33532) 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cbfff640 1 -- 172.21.15.62:0/2202706527 learned_addr learned my addr 172.21.15.62:0/2202706527 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cbfff640 1 -- 172.21.15.62:0/2202706527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc11cd60 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cbfff640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0af040 tx=0x7fb7bc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0b1050 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0b2040 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc11c580 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7bc0b6870 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc129f30 con 0x7fb7cc12aee0 2024-09-12T17:11:00.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc12b2c0 con 0x7fb7cc12aee0 2024-09-12T17:11:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb7bc0bf030 con 0x7fb7cc12aee0 2024-09-12T17:11:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 0x7fb7b803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7fb7bc0bd070 con 0x7fb7cc12aee0 2024-09-12T17:11:00.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.580+0000 7fb7cb7fe640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 0x7fb7b803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.584+0000 7fb7cb7fe640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 0x7fb7b803d640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0005c10 tx=0x7fb7c00016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.584+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb7bc0c6020 con 0x7fb7cc12aee0 2024-09-12T17:11:00.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.744+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7cc073a80 con 0x7fb7b803b180 2024-09-12T17:11:00.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7c8ff9640 1 -- 172.21.15.62:0/2202706527 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32199 (secure 0 0 0) 0x7fb7c000cba0 con 0x7fb7b803b180 2024-09-12T17:11:00.750 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:11:00.751 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:11:00.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 msgr2=0x7fb7b803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 0x7fb7b803d640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0005c10 tx=0x7fb7c00016c0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 msgr2=0x7fb7cc1299f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0af040 tx=0x7fb7bc01abb0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 shutdown_connections 2024-09-12T17:11:00.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb7b803b180 0x7fb7b803d640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 --2- 172.21.15.62:0/2202706527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7cc12aee0 0x7fb7cc1299f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 >> 172.21.15.62:0/2202706527 conn(0x7fb7cc0a0a60 msgr2=0x7fb7cc0a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 shutdown_connections 2024-09-12T17:11:00.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.748+0000 7fb7d2854640 1 -- 172.21.15.62:0/2202706527 wait complete. 2024-09-12T17:11:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:11:00.654709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114040,"kb_used_data":1744,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373320,"statfs":{"total":386547056640,"available":386430279680,"internally_reserved":0,"allocated":1785856,"data_stored":1370114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891367"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779569+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:10:56.779569+0000","last_peered":"2024-09-12T17:10:56.779569+0000","last_clean":"2024-09-12T17:10:56.779569+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:10:56.779569+0000","last_undegraded":"2024-09-12T17:10:56.779569+0000","last_fullsized":"2024-09-12T17:10:56.779569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.783181+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:10:56.783181+0000","last_peered":"2024-09-12T17:10:56.783181+0000","last_clean":"2024-09-12T17:10:56.783181+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:10:56.783181+0000","last_undegraded":"2024-09-12T17:10:56.783181+0000","last_fullsized":"2024-09-12T17:10:56.783181+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779865+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:10:56.779865+0000","last_peered":"2024-09-12T17:10:56.779865+0000","last_clean":"2024-09-12T17:10:56.779865+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:10:56.779865+0000","last_undegraded":"2024-09-12T17:10:56.779865+0000","last_fullsized":"2024-09-12T17:10:56.779865+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.783685+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:10:56.783685+0000","last_peered":"2024-09-12T17:10:56.783685+0000","last_clean":"2024-09-12T17:10:56.783685+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:10:56.783685+0000","last_undegraded":"2024-09-12T17:10:56.783685+0000","last_fullsized":"2024-09-12T17:10:56.783685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"17'2","reported_seq":22,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779428+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:10:56.779428+0000","last_peered":"2024-09-12T17:10:56.779428+0000","last_clean":"2024-09-12T17:10:56.779428+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:10:56.779428+0000","last_undegraded":"2024-09-12T17:10:56.779428+0000","last_fullsized":"2024-09-12T17:10:56.779428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:57.774448+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:10:57.774448+0000","last_peered":"2024-09-12T17:10:57.774448+0000","last_clean":"2024-09-12T17:10:57.774448+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:10:57.774448+0000","last_undegraded":"2024-09-12T17:10:57.774448+0000","last_fullsized":"2024-09-12T17:10:57.774448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.777829+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:10:56.777829+0000","last_peered":"2024-09-12T17:10:56.777829+0000","last_clean":"2024-09-12T17:10:56.777829+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:10:56.777829+0000","last_undegraded":"2024-09-12T17:10:56.777829+0000","last_fullsized":"2024-09-12T17:10:56.777829+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"15'1","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.779135+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:10:56.779135+0000","last_peered":"2024-09-12T17:10:56.779135+0000","last_clean":"2024-09-12T17:10:56.779135+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:10:56.779135+0000","last_undegraded":"2024-09-12T17:10:56.779135+0000","last_fullsized":"2024-09-12T17:10:56.779135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'72","reported_seq":111,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-12T17:10:56.772469+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:10:56.772469+0000","last_peered":"2024-09-12T17:10:56.772469+0000","last_clean":"2024-09-12T17:10:56.772469+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:10:56.772469+0000","last_undegraded":"2024-09-12T17:10:56.772469+0000","last_fullsized":"2024-09-12T17:10:56.772469+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640263,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31336,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340504,"statfs":{"total":96636764160,"available":96604676096,"internally_reserved":0,"allocated":151552,"data_stored":47354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":741376,"data_stored":637703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:11:00.769 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:11:00.769 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:11:00.769 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:11:00.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:11:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49ab969640 1 Processor -- start 2024-09-12T17:11:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49ab969640 1 -- start start 2024-09-12T17:11:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49ab969640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49a4111890 0x7f49a4132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49ab969640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a4073a90 con 0x7f49a4110da0 2024-09-12T17:11:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49ab969640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f49a40696e0 con 0x7f49a4111890 2024-09-12T17:11:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49a8f04640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f49a4111890 0x7f49a4132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49a9705640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f49a4110da0 0x7f49a4111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36434/0 (socket says 172.21.15.62:36434) 2024-09-12T17:11:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49a9705640 1 -- 172.21.15.62:0/2980037904 learned_addr learned my addr 172.21.15.62:0/2980037904 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:11:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49a8f04640 1 -- 172.21.15.62:0/2980037904 >> v1:172.21.15.62:6789/0 conn(0x7f49a4110da0 legacy=0x7f49a4111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.884+0000 7f49a8f04640 1 -- 172.21.15.62:0/2980037904 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a406dd50 con 0x7f49a4111890 2024-09-12T17:11:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49a8f04640 1 --2- 172.21.15.62:0/2980037904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4111890 0x7f49a4132450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4994009740 tx=0x7f499401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b5f418b884d551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f499bfff640 1 -- 172.21.15.62:0/2980037904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49940b0070 con 0x7f49a4111890 2024-09-12T17:11:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f499bfff640 1 -- 172.21.15.62:0/2980037904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940ab530 con 0x7f49a4111890 2024-09-12T17:11:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f499bfff640 1 -- 172.21.15.62:0/2980037904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49940ab830 con 0x7f49a4111890 2024-09-12T17:11:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- 172.21.15.62:0/2980037904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4111890 msgr2=0x7f49a4132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 --2- 172.21.15.62:0/2980037904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4111890 0x7f49a4132450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4994009740 tx=0x7f499401c370 comp rx=0 tx=0).stop 2024-09-12T17:11:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- 172.21.15.62:0/2980037904 shutdown_connections 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 --2- 172.21.15.62:0/2980037904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4111890 0x7f49a4132450 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- 172.21.15.62:0/2980037904 >> 172.21.15.62:0/2980037904 conn(0x7f49a4070900 msgr2=0x7f49a4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- 172.21.15.62:0/2980037904 shutdown_connections 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- 172.21.15.62:0/2980037904 wait complete. 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 Processor -- start 2024-09-12T17:11:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- start start 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49ab969640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4135330 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49a9705640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49a9705640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33550/0 (socket says 172.21.15.62:33550) 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49a9705640 1 -- 172.21.15.62:0/2349606642 learned_addr learned my addr 172.21.15.62:0/2349606642 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.888+0000 7f49a9705640 1 -- 172.21.15.62:0/2349606642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a41154f0 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49a9705640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c450 tx=0x7f49a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a0017070 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a0005c20 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a4131da0 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49a00070d0 con 0x7f49a4110da0 2024-09-12T17:11:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a412fcc0 con 0x7f49a4110da0 2024-09-12T17:11:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a4111180 con 0x7f49a4110da0 2024-09-12T17:11:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49a001a070 con 0x7f49a4110da0 2024-09-12T17:11:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 0x7f498803d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f49a004dfc0 con 0x7f49a4110da0 2024-09-12T17:11:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49a8f04640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 0x7f498803d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.892+0000 7f49a8f04640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 0x7f498803d640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49940ad000 tx=0x7f49940a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:00.896+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f49a001b3b0 con 0x7f49a4110da0 2024-09-12T17:11:01.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.096+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f49a4128790 con 0x7f49a4110da0 2024-09-12T17:11:01.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.096+0000 7f4999ffb640 1 -- 172.21.15.62:0/2349606642 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f49a00500f0 con 0x7f49a4110da0 2024-09-12T17:11:01.101 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:11:01.101 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:11:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 msgr2=0x7f498803d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:01.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 0x7f498803d640 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f49940ad000 tx=0x7f49940a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 msgr2=0x7f49a412f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f49a000c450 tx=0x7f49a000c910 comp rx=0 tx=0).stop 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 shutdown_connections 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f498803b180 0x7f498803d640 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 --2- 172.21.15.62:0/2349606642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49a4110da0 0x7f49a412f5b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 >> 172.21.15.62:0/2349606642 conn(0x7f49a4070900 msgr2=0x7f49a412ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 shutdown_connections 2024-09-12T17:11:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:11:01.100+0000 7f49ab969640 1 -- 172.21.15.62:0/2349606642 wait complete. 2024-09-12T17:11:01.119 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:11:01.119 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:11:01.139 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:11:01.139 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:11:01.139 INFO:tasks.rgw:Creating data pools 2024-09-12T17:11:01.139 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:11:01.139 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T17:11:01.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20d4ca2640 1 Processor -- start 2024-09-12T17:11:01.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20d4ca2640 1 -- start start 2024-09-12T17:11:01.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20d4ca2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20d01104a0 0x7f20d011c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:01.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20d4ca2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d0110930 con 0x7f20d0074bf0 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20d4ca2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f20d0110b00 con 0x7f20d01104a0 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20cdd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20d01104a0 0x7f20d011c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20cdd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20d01104a0 0x7f20d011c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45454/0 (socket says 172.21.15.193:45454) 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.268+0000 7f20cdd9b640 1 -- 172.21.15.193:0/1786432570 learned_addr learned my addr 172.21.15.193:0/1786432570 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cdd9b640 1 -- 172.21.15.193:0/1786432570 >> v1:172.21.15.62:6789/0 conn(0x7f20d0074bf0 legacy=0x7f20d010fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:01.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cdd9b640 1 -- 172.21.15.193:0/1786432570 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d011d670 con 0x7f20d01104a0 2024-09-12T17:11:01.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cdd9b640 1 --2- 172.21.15.193:0/1786432570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d01104a0 0x7f20d011c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20c00097f0 tx=0x7f20c001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8eefb005fc1da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:01.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cd59a640 1 -- 172.21.15.193:0/1786432570 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c00b0070 con 0x7f20d01104a0 2024-09-12T17:11:01.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cd59a640 1 -- 172.21.15.193:0/1786432570 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c00ab530 con 0x7f20d01104a0 2024-09-12T17:11:01.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20cd59a640 1 -- 172.21.15.193:0/1786432570 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20c00ab830 con 0x7f20d01104a0 2024-09-12T17:11:01.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 -- 172.21.15.193:0/1786432570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d01104a0 msgr2=0x7f20d011c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:01.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/1786432570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d01104a0 0x7f20d011c120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f20c00097f0 tx=0x7f20c001c430 comp rx=0 tx=0).stop 2024-09-12T17:11:01.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 -- 172.21.15.193:0/1786432570 shutdown_connections 2024-09-12T17:11:01.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/1786432570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d01104a0 0x7f20d011c120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:01.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 -- 172.21.15.193:0/1786432570 >> 172.21.15.193:0/1786432570 conn(0x7f20d006fe70 msgr2=0x7f20d0072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:01.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 -- 172.21.15.193:0/1786432570 shutdown_connections 2024-09-12T17:11:01.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.272+0000 7f20d4ca2640 1 -- 172.21.15.193:0/1786432570 wait complete. 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 Processor -- start 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 -- start start 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f20d011d320 con 0x7f20d0074bf0 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20ce59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20ce59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45458/0 (socket says 172.21.15.193:45458) 2024-09-12T17:11:01.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20ce59c640 1 -- 172.21.15.193:0/645257462 learned_addr learned my addr 172.21.15.193:0/645257462 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20ce59c640 1 -- 172.21.15.193:0/645257462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d01a83f0 con 0x7f20d0074bf0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20ce59c640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c480 tx=0x7f20b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8017070 con 0x7f20d0074bf0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b8005200 con 0x7f20d0074bf0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b8003600 con 0x7f20d0074bf0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d01a86e0 con 0x7f20d0074bf0 2024-09-12T17:11:01.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d01ad830 con 0x7f20d0074bf0 2024-09-12T17:11:01.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d010fd90 con 0x7f20d0074bf0 2024-09-12T17:11:01.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20b801a070 con 0x7f20d0074bf0 2024-09-12T17:11:01.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.276+0000 7f20c6ffd640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 0x7f20b003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:01.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.280+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3538+0+0 (secure 0 0 0) 0x7f20b804e1c0 con 0x7f20d0074bf0 2024-09-12T17:11:01.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.280+0000 7f20cdd9b640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 0x7f20b003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:01.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.280+0000 7f20cdd9b640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 0x7f20b003d6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20d0069f60 tx=0x7f20c00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:01.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.292+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f20b804c0a0 con 0x7f20d0074bf0 2024-09-12T17:11:01.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:01.468+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7f20d01a8a20 con 0x7f20d0074bf0 2024-09-12T17:11:02.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20c6ffd640 1 -- 172.21.15.193:0/645257462 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v18) ==== 151+0+0 (secure 0 0 0) 0x7f20b8021070 con 0x7f20d0074bf0 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 msgr2=0x7f20b003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 0x7f20b003d6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f20d0069f60 tx=0x7f20c00a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 msgr2=0x7f20d01a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20b800c480 tx=0x7f20b800c940 comp rx=0 tx=0).stop 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 shutdown_connections 2024-09-12T17:11:02.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20b003b200 0x7f20b003d6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 --2- 172.21.15.193:0/645257462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20d0074bf0 0x7f20d01a7e20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 >> 172.21.15.193:0/645257462 conn(0x7f20d006fe70 msgr2=0x7f20d0118470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 shutdown_connections 2024-09-12T17:11:02.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.008+0000 7f20d4ca2640 1 -- 172.21.15.193:0/645257462 wait complete. 2024-09-12T17:11:02.030 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T17:11:02.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8ddbf0640 1 Processor -- start 2024-09-12T17:11:02.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8ddbf0640 1 -- start start 2024-09-12T17:11:02.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8ddbf0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8d8118600 0x7fb8d811a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:02.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8ddbf0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8d811afc0 con 0x7fb8d8110050 2024-09-12T17:11:02.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8ddbf0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d811c1a0 con 0x7fb8d8118600 2024-09-12T17:11:02.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8d6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8d8118600 0x7fb8d811a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:02.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8d6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8d8118600 0x7fb8d811a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45464/0 (socket says 172.21.15.193:45464) 2024-09-12T17:11:02.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8d6ffd640 1 -- 172.21.15.193:0/637207786 learned_addr learned my addr 172.21.15.193:0/637207786 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:02.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8d6ffd640 1 -- 172.21.15.193:0/637207786 >> v1:172.21.15.62:6789/0 conn(0x7fb8d8110050 legacy=0x7fb8d8110430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:02.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.156+0000 7fb8d6ffd640 1 -- 172.21.15.193:0/637207786 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d806d330 con 0x7fb8d8118600 2024-09-12T17:11:02.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d6ffd640 1 --2- 172.21.15.193:0/637207786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8118600 0x7fb8d811a9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097f0 tx=0x7fb8cc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1402b2eaaa560d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:02.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d67fc640 1 -- 172.21.15.193:0/637207786 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc0ab580 con 0x7fb8d8118600 2024-09-12T17:11:02.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d67fc640 1 -- 172.21.15.193:0/637207786 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8cc0b0070 con 0x7fb8d8118600 2024-09-12T17:11:02.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d67fc640 1 -- 172.21.15.193:0/637207786 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8cc0ab870 con 0x7fb8d8118600 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/637207786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8118600 msgr2=0x7fb8d811a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/637207786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8118600 0x7fb8d811a9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0097f0 tx=0x7fb8cc01c430 comp rx=0 tx=0).stop 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/637207786 shutdown_connections 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/637207786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8118600 0x7fb8d811a9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/637207786 >> 172.21.15.193:0/637207786 conn(0x7fb8d8070c90 msgr2=0x7fb8d80730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:02.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/637207786 shutdown_connections 2024-09-12T17:11:02.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/637207786 wait complete. 2024-09-12T17:11:02.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 Processor -- start 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- start start 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8ddbf0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d806e280 con 0x7fb8d8110050 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45468/0 (socket says 172.21.15.193:45468) 2024-09-12T17:11:02.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d77fe640 1 -- 172.21.15.193:0/3629480287 learned_addr learned my addr 172.21.15.193:0/3629480287 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d77fe640 1 -- 172.21.15.193:0/3629480287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d81aa570 con 0x7fb8d8110050 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.160+0000 7fb8d77fe640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7f0 tx=0x7fb8d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d0003980 con 0x7fb8d8110050 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d0003b40 con 0x7fb8d8110050 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d81aa860 con 0x7fb8d8110050 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d0003e60 con 0x7fb8d8110050 2024-09-12T17:11:02.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d81af9b0 con 0x7fb8d8110050 2024-09-12T17:11:02.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d8110430 con 0x7fb8d8110050 2024-09-12T17:11:02.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8d000a820 con 0x7fb8d8110050 2024-09-12T17:11:02.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 0x7fb8c403d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:02.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3802+0+0 (secure 0 0 0) 0x7fb8d004ece0 con 0x7fb8d8110050 2024-09-12T17:11:02.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8d6ffd640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 0x7fb8c403d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:02.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.164+0000 7fb8d6ffd640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 0x7fb8c403d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af000 tx=0x7fb8cc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:02.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.176+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fb8d000acf0 con 0x7fb8d8110050 2024-09-12T17:11:02.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:02.344+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fb8d81aaba0 con 0x7fb8d8110050 2024-09-12T17:11:03.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.636+0000 7fb8bffff640 1 -- 172.21.15.193:0/3629480287 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fb8d00055f0 con 0x7fb8d8110050 2024-09-12T17:11:03.641 INFO:teuthology.orchestra.run.smithi193.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:11:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 msgr2=0x7fb8c403d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:03.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 0x7fb8c403d6c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0af000 tx=0x7fb8cc0a7000 comp rx=0 tx=0).stop 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 msgr2=0x7fb8d81a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7f0 tx=0x7fb8d000ccb0 comp rx=0 tx=0).stop 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 shutdown_connections 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c403b200 0x7fb8c403d6c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 --2- 172.21.15.193:0/3629480287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d8110050 0x7fb8d81a9fa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 >> 172.21.15.193:0/3629480287 conn(0x7fb8d8070c90 msgr2=0x7fb8d8119440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.640+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 shutdown_connections 2024-09-12T17:11:03.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.644+0000 7fb8ddbf0640 1 -- 172.21.15.193:0/3629480287 wait complete. 2024-09-12T17:11:03.676 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:11:03.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11f61b640 1 Processor -- start 2024-09-12T17:11:03.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11f61b640 1 -- start start 2024-09-12T17:11:03.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11f61b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd11811fcd0 0x7fd1181220c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:03.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11f61b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1181226f0 con 0x7fd118116930 2024-09-12T17:11:03.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11f61b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd1181238f0 con 0x7fd11811fcd0 2024-09-12T17:11:03.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11cbb6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd11811fcd0 0x7fd1181220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:03.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11d3b7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd118116930 0x7fd118116d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47480/0 (socket says 172.21.15.193:47480) 2024-09-12T17:11:03.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11d3b7640 1 -- 172.21.15.193:0/1971129674 learned_addr learned my addr 172.21.15.193:0/1971129674 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:03.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11cbb6640 1 -- 172.21.15.193:0/1971129674 >> v1:172.21.15.62:6789/0 conn(0x7fd118116930 legacy=0x7fd118116d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:03.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.792+0000 7fd11cbb6640 1 -- 172.21.15.193:0/1971129674 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd118123aa0 con 0x7fd11811fcd0 2024-09-12T17:11:03.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11cbb6640 1 --2- 172.21.15.193:0/1971129674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11811fcd0 0x7fd1181220c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd114009740 tx=0x7fd11401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb392b2c5fd2088 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:03.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd10ffff640 1 -- 172.21.15.193:0/1971129674 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1140ab550 con 0x7fd11811fcd0 2024-09-12T17:11:03.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd10ffff640 1 -- 172.21.15.193:0/1971129674 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1140b0070 con 0x7fd11811fcd0 2024-09-12T17:11:03.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd10ffff640 1 -- 172.21.15.193:0/1971129674 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1140ab840 con 0x7fd11811fcd0 2024-09-12T17:11:03.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- 172.21.15.193:0/1971129674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11811fcd0 msgr2=0x7fd1181220c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:03.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 --2- 172.21.15.193:0/1971129674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11811fcd0 0x7fd1181220c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd114009740 tx=0x7fd11401c400 comp rx=0 tx=0).stop 2024-09-12T17:11:03.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- 172.21.15.193:0/1971129674 shutdown_connections 2024-09-12T17:11:03.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 --2- 172.21.15.193:0/1971129674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd11811fcd0 0x7fd1181220c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:03.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- 172.21.15.193:0/1971129674 >> 172.21.15.193:0/1971129674 conn(0x7fd11806fe70 msgr2=0x7fd118072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:03.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- 172.21.15.193:0/1971129674 shutdown_connections 2024-09-12T17:11:03.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- 172.21.15.193:0/1971129674 wait complete. 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 Processor -- start 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- start start 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11f61b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd1181235b0 con 0x7fd118116930 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11d3b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11d3b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45482/0 (socket says 172.21.15.193:45482) 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.796+0000 7fd11d3b7640 1 -- 172.21.15.193:0/2360733645 learned_addr learned my addr 172.21.15.193:0/2360733645 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:03.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11d3b7640 1 -- 172.21.15.193:0/2360733645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1181ae8a0 con 0x7fd118116930 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11d3b7640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd11000cbd0 tx=0x7fd11000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110017070 con 0x7fd118116930 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1181aeb90 con 0x7fd118116930 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11000abc0 con 0x7fd118116930 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd110012400 con 0x7fd118116930 2024-09-12T17:11:03.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1181b3d60 con 0x7fd118116930 2024-09-12T17:11:03.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd118116d10 con 0x7fd118116930 2024-09-12T17:11:03.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd11001a070 con 0x7fd118116930 2024-09-12T17:11:03.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 0x7fd10403d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:03.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4249+0+0 (secure 0 0 0) 0x7fd11004ef10 con 0x7fd118116930 2024-09-12T17:11:03.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11cbb6640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 0x7fd10403d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:03.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.800+0000 7fd11cbb6640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 0x7fd10403d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af000 tx=0x7fd1140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:03.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.816+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd110007a80 con 0x7fd118116930 2024-09-12T17:11:03.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:03.984+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fd1181aeed0 con 0x7fd118116930 2024-09-12T17:11:04.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.640+0000 7fd10dffb640 1 -- 172.21.15.193:0/2360733645 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7fd11004cb70 con 0x7fd118116930 2024-09-12T17:11:04.643 INFO:teuthology.orchestra.run.smithi193.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 msgr2=0x7fd10403d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 0x7fd10403d670 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd1140af000 tx=0x7fd1140a7000 comp rx=0 tx=0).stop 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 msgr2=0x7fd1181ae2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd11000cbd0 tx=0x7fd11000a430 comp rx=0 tx=0).stop 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 shutdown_connections 2024-09-12T17:11:04.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd10403b1b0 0x7fd10403d670 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:04.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 --2- 172.21.15.193:0/2360733645 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd118116930 0x7fd1181ae2d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:04.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 >> 172.21.15.193:0/2360733645 conn(0x7fd11806fe70 msgr2=0x7fd1181201f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:04.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 shutdown_connections 2024-09-12T17:11:04.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.644+0000 7fd11f61b640 1 -- 172.21.15.193:0/2360733645 wait complete. 2024-09-12T17:11:04.687 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440ff3e640 1 Processor -- start 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440ff3e640 1 -- start start 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440ff3e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f440811b8d0 0x7f440811dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440ff3e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440811e200 con 0x7f4408113070 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440ff3e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f440811f400 con 0x7f440811b8d0 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440d4d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f440811b8d0 0x7f440811dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440d4d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f440811b8d0 0x7f440811dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45498/0 (socket says 172.21.15.193:45498) 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440d4d9640 1 -- 172.21.15.193:0/1665854133 learned_addr learned my addr 172.21.15.193:0/1665854133 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:04.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440dcda640 1 --1- 172.21.15.193:0/1665854133 >> v1:172.21.15.62:6789/0 conn(0x7f4408113070 0x7f4408113450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47494/0 (socket says 172.21.15.193:47494) 2024-09-12T17:11:04.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440d4d9640 1 -- 172.21.15.193:0/1665854133 >> v1:172.21.15.62:6789/0 conn(0x7f4408113070 legacy=0x7f4408113450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:04.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.812+0000 7f440d4d9640 1 -- 172.21.15.193:0/1665854133 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440811f5b0 con 0x7f440811b8d0 2024-09-12T17:11:04.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440d4d9640 1 --2- 172.21.15.193:0/1665854133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440811b8d0 0x7f440811dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097f0 tx=0x7f43f801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb20e2980b78a8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:04.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ccd8640 1 -- 172.21.15.193:0/1665854133 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f80a6040 con 0x7f440811b8d0 2024-09-12T17:11:04.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ccd8640 1 -- 172.21.15.193:0/1665854133 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f80af070 con 0x7f440811b8d0 2024-09-12T17:11:04.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ccd8640 1 -- 172.21.15.193:0/1665854133 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43f80aa6c0 con 0x7f440811b8d0 2024-09-12T17:11:04.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- 172.21.15.193:0/1665854133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440811b8d0 msgr2=0x7f440811dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:04.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1665854133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440811b8d0 0x7f440811dcc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f43f80097f0 tx=0x7f43f801c4c0 comp rx=0 tx=0).stop 2024-09-12T17:11:04.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- 172.21.15.193:0/1665854133 shutdown_connections 2024-09-12T17:11:04.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1665854133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f440811b8d0 0x7f440811dcc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:04.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- 172.21.15.193:0/1665854133 >> 172.21.15.193:0/1665854133 conn(0x7f440806f370 msgr2=0x7f440806f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:04.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- 172.21.15.193:0/1665854133 shutdown_connections 2024-09-12T17:11:04.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- 172.21.15.193:0/1665854133 wait complete. 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 Processor -- start 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- start start 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440ff3e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f440811f0c0 con 0x7f4408113070 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440dcda640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440dcda640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45504/0 (socket says 172.21.15.193:45504) 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440dcda640 1 -- 172.21.15.193:0/1375857695 learned_addr learned my addr 172.21.15.193:0/1375857695 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:04.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440dcda640 1 -- 172.21.15.193:0/1375857695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44081aa4e0 con 0x7f4408113070 2024-09-12T17:11:04.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.816+0000 7f440dcda640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f440400c450 tx=0x7f440400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:04.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404007410 con 0x7f4408113070 2024-09-12T17:11:04.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44081aa7d0 con 0x7f4408113070 2024-09-12T17:11:04.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44081af9a0 con 0x7f4408113070 2024-09-12T17:11:04.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44040075b0 con 0x7f4408113070 2024-09-12T17:11:04.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404004920 con 0x7f4408113070 2024-09-12T17:11:04.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43f0005090 con 0x7f4408113070 2024-09-12T17:11:04.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f440401a020 con 0x7f4408113070 2024-09-12T17:11:04.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 0x7f43ec03d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:04.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4260+0+0 (secure 0 0 0) 0x7f440404ef80 con 0x7f4408113070 2024-09-12T17:11:04.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f440d4d9640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 0x7f43ec03d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:04.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.820+0000 7f440d4d9640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 0x7f43ec03d640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43f80ae000 tx=0x7f43f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:04.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:04.832+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4404021070 con 0x7f4408113070 2024-09-12T17:11:05.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.012+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f43f0005380 con 0x7f4408113070 2024-09-12T17:11:05.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.648+0000 7f43fe7fc640 1 -- 172.21.15.193:0/1375857695 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7f440401b3a0 con 0x7f4408113070 2024-09-12T17:11:05.651 INFO:teuthology.orchestra.run.smithi193.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:11:05.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 msgr2=0x7f43ec03d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:05.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 0x7f43ec03d640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f43f80ae000 tx=0x7f43f8008040 comp rx=0 tx=0).stop 2024-09-12T17:11:05.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 msgr2=0x7f44081a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:05.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f440400c450 tx=0x7f440400c910 comp rx=0 tx=0).stop 2024-09-12T17:11:05.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 shutdown_connections 2024-09-12T17:11:05.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f43ec03b180 0x7f43ec03d640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:05.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 --2- 172.21.15.193:0/1375857695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4408113070 0x7f44081a9f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:05.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 >> 172.21.15.193:0/1375857695 conn(0x7f440806f370 msgr2=0x7f440811a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:05.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 shutdown_connections 2024-09-12T17:11:05.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.652+0000 7f440ff3e640 1 -- 172.21.15.193:0/1375857695 wait complete. 2024-09-12T17:11:05.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:11:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf4a9cb640 1 Processor -- start 2024-09-12T17:11:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf4a9cb640 1 -- start start 2024-09-12T17:11:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf4a9cb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf441104a0 0x7fbf4411c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf4a9cb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf44110930 con 0x7fbf44074bf0 2024-09-12T17:11:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf4a9cb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbf44110b00 con 0x7fbf441104a0 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf437fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf441104a0 0x7fbf4411c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf437fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf441104a0 0x7fbf4411c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45514/0 (socket says 172.21.15.193:45514) 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf437fe640 1 -- 172.21.15.193:0/596514102 learned_addr learned my addr 172.21.15.193:0/596514102 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf43fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbf44074bf0 0x7fbf4410fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47508/0 (socket says 172.21.15.193:47508) 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf437fe640 1 -- 172.21.15.193:0/596514102 >> v1:172.21.15.62:6789/0 conn(0x7fbf44074bf0 legacy=0x7fbf4410fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:05.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.804+0000 7fbf437fe640 1 -- 172.21.15.193:0/596514102 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4411d670 con 0x7fbf441104a0 2024-09-12T17:11:05.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf437fe640 1 --2- 172.21.15.193:0/596514102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf441104a0 0x7fbf4411c120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097f0 tx=0x7fbf3801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c0188dfe1904f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:05.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf42ffd640 1 -- 172.21.15.193:0/596514102 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf380b0070 con 0x7fbf441104a0 2024-09-12T17:11:05.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf42ffd640 1 -- 172.21.15.193:0/596514102 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf380ab530 con 0x7fbf441104a0 2024-09-12T17:11:05.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf42ffd640 1 -- 172.21.15.193:0/596514102 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf380ab830 con 0x7fbf441104a0 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/596514102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf441104a0 msgr2=0x7fbf4411c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/596514102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf441104a0 0x7fbf4411c120 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097f0 tx=0x7fbf3801c430 comp rx=0 tx=0).stop 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/596514102 shutdown_connections 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/596514102 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf441104a0 0x7fbf4411c120 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/596514102 >> 172.21.15.193:0/596514102 conn(0x7fbf4406fe70 msgr2=0x7fbf44072290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/596514102 shutdown_connections 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/596514102 wait complete. 2024-09-12T17:11:05.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 Processor -- start 2024-09-12T17:11:05.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- start start 2024-09-12T17:11:05.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:05.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf4a9cb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4411d320 con 0x7fbf44074bf0 2024-09-12T17:11:05.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:05.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf43fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45518/0 (socket says 172.21.15.193:45518) 2024-09-12T17:11:05.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf43fff640 1 -- 172.21.15.193:0/1631863706 learned_addr learned my addr 172.21.15.193:0/1631863706 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:05.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.808+0000 7fbf43fff640 1 -- 172.21.15.193:0/1631863706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44112eb0 con 0x7fbf44074bf0 2024-09-12T17:11:05.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf43fff640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c480 tx=0x7fbf3400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf34007410 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf44111560 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf44111a70 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf340075b0 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf34004920 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf24005090 con 0x7fbf44074bf0 2024-09-12T17:11:05.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbf3401a020 con 0x7fbf44074bf0 2024-09-12T17:11:05.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 0x7fbf3003d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:05.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4624+0+0 (secure 0 0 0) 0x7fbf3404f150 con 0x7fbf44074bf0 2024-09-12T17:11:05.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf437fe640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 0x7fbf3003d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:05.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.812+0000 7fbf437fe640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 0x7fbf3003d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf44069f60 tx=0x7fbf380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:05.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.824+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fbf34021070 con 0x7fbf44074bf0 2024-09-12T17:11:05.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:05.983+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fbf24005380 con 0x7fbf44074bf0 2024-09-12T17:11:06.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.659+0000 7fbf40ff9640 1 -- 172.21.15.193:0/1631863706 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7fbf340113a0 con 0x7fbf44074bf0 2024-09-12T17:11:06.664 INFO:teuthology.orchestra.run.smithi193.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:11:06.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 msgr2=0x7fbf3003d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 0x7fbf3003d670 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf44069f60 tx=0x7fbf380a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 msgr2=0x7fbf44110fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c480 tx=0x7fbf3400c940 comp rx=0 tx=0).stop 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 shutdown_connections 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbf3003b1b0 0x7fbf3003d670 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 --2- 172.21.15.193:0/1631863706 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf44074bf0 0x7fbf44110fc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 >> 172.21.15.193:0/1631863706 conn(0x7fbf4406fe70 msgr2=0x7fbf44118470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 shutdown_connections 2024-09-12T17:11:06.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:06.663+0000 7fbf4a9cb640 1 -- 172.21.15.193:0/1631863706 wait complete. 2024-09-12T17:11:06.701 DEBUG:tasks.rgw:Pools created 2024-09-12T17:11:06.701 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:11:06.701 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:11:06.702 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:11:06.702 DEBUG:teuthology.orchestra.run.smithi193:> sudo echo -n http://smithi193.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:11:06.717 INFO:teuthology.orchestra.run.smithi193.stdout:http://smithi193.front.sepia.ceph.com:80 2024-09-12T17:11:06.717 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:11:06.767 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:11:06.767 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:11:06.811 INFO:tasks.rgw.client.0:Started 2024-09-12T17:11:06.811 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:06.811 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:06.841 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:06.841 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:06.842 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:06.842 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:06.842 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:11:07.843 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:07.855 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:07.855 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:07.855 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:07.855 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:11:07.856 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:09.857 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:09.869 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:09.869 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:09.869 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:09.869 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:11:09.870 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:13.872 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:13.883 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:13.883 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:13.884 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:11:13.884 INFO:teuthology.orchestra.run.smithi193.stderr:curl: (7) Failed to connect to smithi193.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:11:13.884 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:11:21.886 DEBUG:teuthology.orchestra.run.smithi193:> curl http://smithi193.front.sepia.ceph.com:80/ 2024-09-12T17:11:21.898 INFO:teuthology.orchestra.run.smithi193.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:11:21.898 INFO:teuthology.orchestra.run.smithi193.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:11:21.901 INFO:teuthology.orchestra.run.smithi193.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 54838 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T17:11:21.902 INFO:teuthology.orchestra.run.smithi193.stdout:anonymous 2024-09-12T17:11:21.902 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-12T17:11:22.253 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-12T17:11:22.253 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T17:11:22.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T17:11:22.254 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T17:11:22.290 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:22.290 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:22.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8a8189c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d00a1af210 0x55d00a23ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8a8189c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d00a0ef9c0 con 0x55d00a1af5f0 2024-09-12T17:11:22.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8a8189c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d00a13f6d0 con 0x55d00a1af210 2024-09-12T17:11:22.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8831e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d00a1af210 0x55d00a23ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab87b1d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d00a1af5f0 0x55d00a242510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35888/0 (socket says 172.21.15.193:35888) 2024-09-12T17:11:22.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab87b1d640 1 -- 172.21.15.193:0/4051386108 learned_addr learned my addr 172.21.15.193:0/4051386108 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:22.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8831e640 1 -- 172.21.15.193:0/4051386108 >> v1:172.21.15.62:6789/0 conn(0x55d00a1af5f0 legacy=0x55d00a242510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.287+0000 7fab8831e640 1 -- 172.21.15.193:0/4051386108 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a0e3ca0 con 0x55d00a1af210 2024-09-12T17:11:22.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8831e640 1 --2- 172.21.15.193:0/4051386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a23ffc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab7800a480 tx=0x7fab7801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632aa735fde6a593 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8731c640 1 -- 172.21.15.193:0/4051386108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780b0070 con 0x55d00a1af210 2024-09-12T17:11:22.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8731c640 1 -- 172.21.15.193:0/4051386108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab780ab540 con 0x55d00a1af210 2024-09-12T17:11:22.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8731c640 1 -- 172.21.15.193:0/4051386108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780ab840 con 0x55d00a1af210 2024-09-12T17:11:22.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8a8189c0 1 -- 172.21.15.193:0/4051386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 msgr2=0x55d00a23ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/4051386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a23ffc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab7800a480 tx=0x7fab7801b280 comp rx=0 tx=0).stop 2024-09-12T17:11:22.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8a8189c0 1 -- 172.21.15.193:0/4051386108 shutdown_connections 2024-09-12T17:11:22.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/4051386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a23ffc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.291+0000 7fab8a8189c0 1 -- 172.21.15.193:0/4051386108 >> 172.21.15.193:0/4051386108 conn(0x55d00a2358f0 msgr2=0x55d00a237d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.295+0000 7fab8a8189c0 1 -- 172.21.15.193:0/4051386108 shutdown_connections 2024-09-12T17:11:22.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.295+0000 7fab8a8189c0 1 -- 172.21.15.193:0/4051386108 wait complete. 2024-09-12T17:11:22.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8a8189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8a8189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d00a143680 con 0x55d00a1af210 2024-09-12T17:11:22.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8831e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8831e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50076/0 (socket says 172.21.15.193:50076) 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8831e640 1 -- 172.21.15.193:0/295798376 learned_addr learned my addr 172.21.15.193:0/295798376 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8831e640 1 -- 172.21.15.193:0/295798376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a0beda0 con 0x55d00a1af210 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7fab8831e640 1 --2- 172.21.15.193:0/295798376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab78018eb0 tx=0x7fab78003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac2653475fce4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7faa7660c640 1 -- 172.21.15.193:0/295798376 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780b0040 con 0x55d00a1af210 2024-09-12T17:11:22.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7faa7660c640 1 -- 172.21.15.193:0/295798376 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab780bb070 con 0x55d00a1af210 2024-09-12T17:11:22.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.311+0000 7faa7660c640 1 -- 172.21.15.193:0/295798376 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780ab6f0 con 0x55d00a1af210 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/295798376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 msgr2=0x55d00a328850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/295798376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab78018eb0 tx=0x7fab78003030 comp rx=0 tx=0).stop 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/295798376 shutdown_connections 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/295798376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a328850 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/295798376 >> 172.21.15.193:0/295798376 conn(0x55d00a2358f0 msgr2=0x55d00a3244a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/295798376 shutdown_connections 2024-09-12T17:11:22.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/295798376 wait complete. 2024-09-12T17:11:22.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d00a0e5a50 con 0x55d00a1af210 2024-09-12T17:11:22.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8831e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8831e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50082/0 (socket says 172.21.15.193:50082) 2024-09-12T17:11:22.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8831e640 1 -- 172.21.15.193:0/3058491260 learned_addr learned my addr 172.21.15.193:0/3058491260 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8831e640 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a330360 con 0x55d00a1af210 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8831e640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab780b8040 tx=0x7fab78018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7faa74e09640 1 -- 172.21.15.193:0/3058491260 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780b0030 con 0x55d00a1af210 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d00a3305f0 con 0x55d00a1af210 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7faa74e09640 1 -- 172.21.15.193:0/3058491260 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab780bb070 con 0x55d00a1af210 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7faa74e09640 1 -- 172.21.15.193:0/3058491260 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab780b68e0 con 0x55d00a1af210 2024-09-12T17:11:22.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.315+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00a330fa0 con 0x55d00a1af210 2024-09-12T17:11:22.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7faa74e09640 1 -- 172.21.15.193:0/3058491260 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab780b6a80 con 0x55d00a1af210 2024-09-12T17:11:22.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7faa74e09640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 0x7faa7003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7faa74e09640 1 -- 172.21.15.193:0/3058491260 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab780a8070 con 0x55d00a1af210 2024-09-12T17:11:22.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab87b1d640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 0x7faa7003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 0x55d00a336f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3374b0 con 0x55d00a1af5f0 2024-09-12T17:11:22.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 0x55d00a336f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab87b1d640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 0x7faa7003bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab70004500 tx=0x7fab70006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 0x55d00a336f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 -- 172.21.15.193:0/3058491260 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab800083f0 con 0x55d00a1af5f0 2024-09-12T17:11:22.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3312e0 con 0x55d00a1af5f0 2024-09-12T17:11:22.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 -- 172.21.15.193:0/3058491260 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab800083f0 con 0x55d00a1af5f0 2024-09-12T17:11:22.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a339210 con 0x55d00a1af5f0 2024-09-12T17:11:22.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 -- 172.21.15.193:0/3058491260 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab800083f0 con 0x55d00a1af5f0 2024-09-12T17:11:22.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a338470 con 0x55d00a1af5f0 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 -- 172.21.15.193:0/3058491260 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab800083f0 con 0x55d00a1af5f0 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3388c0 con 0x55d00a1af5f0 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.319+0000 7fab88b1f640 1 -- 172.21.15.193:0/3058491260 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab800083f0 con 0x55d00a1af5f0 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d00a150450 con 0x55d00a3474d0 2024-09-12T17:11:22.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50086/0 (socket says 172.21.15.193:50086) 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab87b1d640 1 -- 172.21.15.193:0/3503264372 learned_addr learned my addr 172.21.15.193:0/3503264372 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab87b1d640 1 -- 172.21.15.193:0/3503264372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a347f30 con 0x55d00a3474d0 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab87b1d640 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab70002260 tx=0x7fab70015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7faa6dffb640 1 -- 172.21.15.193:0/3503264372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab70015e60 con 0x55d00a3474d0 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d00a348790 con 0x55d00a3474d0 2024-09-12T17:11:22.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7faa6dffb640 1 -- 172.21.15.193:0/3503264372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70011440 con 0x55d00a3474d0 2024-09-12T17:11:22.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7faa6dffb640 1 -- 172.21.15.193:0/3503264372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab70011720 con 0x55d00a3474d0 2024-09-12T17:11:22.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00a348d00 con 0x55d00a3474d0 2024-09-12T17:11:22.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.323+0000 7faa6dffb640 1 -- 172.21.15.193:0/3503264372 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab700118c0 con 0x55d00a3474d0 2024-09-12T17:11:22.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7faa6dffb640 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 0x7faa6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7faa6dffb640 1 -- 172.21.15.193:0/3503264372 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab7001b030 con 0x55d00a3474d0 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab88b1f640 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 0x7faa6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab88b1f640 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 0x7faa6003bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55d00a337f90 tx=0x7fab80003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d00a328fe0 con 0x55d00a354e60 2024-09-12T17:11:22.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50088/0 (socket says 172.21.15.193:50088) 2024-09-12T17:11:22.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab87b1d640 1 -- 172.21.15.193:0/2732940896 learned_addr learned my addr 172.21.15.193:0/2732940896 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab87b1d640 1 -- 172.21.15.193:0/2732940896 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a355850 con 0x55d00a354e60 2024-09-12T17:11:22.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab87b1d640 1 --2- 172.21.15.193:0/2732940896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab70004f90 tx=0x7fab70043110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8204ff46241842a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7faa677fe640 1 -- 172.21.15.193:0/2732940896 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7001e460 con 0x55d00a354e60 2024-09-12T17:11:22.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7faa677fe640 1 -- 172.21.15.193:0/2732940896 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab70020430 con 0x55d00a354e60 2024-09-12T17:11:22.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7faa677fe640 1 -- 172.21.15.193:0/2732940896 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab7001e6b0 con 0x55d00a354e60 2024-09-12T17:11:22.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- 172.21.15.193:0/2732940896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 msgr2=0x55d00a355260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/2732940896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab70004f90 tx=0x7fab70043110 comp rx=0 tx=0).stop 2024-09-12T17:11:22.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- 172.21.15.193:0/2732940896 shutdown_connections 2024-09-12T17:11:22.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/2732940896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a355260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- 172.21.15.193:0/2732940896 >> 172.21.15.193:0/2732940896 conn(0x55d00a350280 msgr2=0x55d00a34e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- 172.21.15.193:0/2732940896 shutdown_connections 2024-09-12T17:11:22.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- 172.21.15.193:0/2732940896 wait complete. 2024-09-12T17:11:22.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 Processor -- start 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- start start 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.327+0000 7fab8a8189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d00a353db0 con 0x55d00a354e60 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab87b1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50100/0 (socket says 172.21.15.193:50100) 2024-09-12T17:11:22.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 learned_addr learned my addr 172.21.15.193:0/1564293369 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d00a35b910 con 0x55d00a354e60 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab87b1d640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab7004f030 tx=0x7fab700500f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 -- 172.21.15.193:0/1564293369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab70039070 con 0x55d00a354e60 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d00a35bba0 con 0x55d00a354e60 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 -- 172.21.15.193:0/1564293369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab7001fe00 con 0x55d00a354e60 2024-09-12T17:11:22.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 -- 172.21.15.193:0/1564293369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab70051460 con 0x55d00a354e60 2024-09-12T17:11:22.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d00a35c550 con 0x55d00a354e60 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 -- 172.21.15.193:0/1564293369 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fab7003c070 con 0x55d00a354e60 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa58039a70 0x7faa5803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7faa65ffb640 1 -- 172.21.15.193:0/1564293369 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fab70035ca0 con 0x55d00a354e60 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab88b1f640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa58039a70 0x7faa5803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a366680 0x55d00a368b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a369260 con 0x55d00a366680 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8831e640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a366680 0x55d00a368b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab88b1f640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa58039a70 0x7faa5803bf30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f010 tx=0x7fab8001c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.331+0000 7fab8831e640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a366680 0x55d00a368b10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 realm 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a369670 con 0x55d00a366680 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a369f40 con 0x55d00a366680 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36a2e0 con 0x55d00a366680 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36a780 con 0x55d00a366680 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 20 searching for the correct realm 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d00a36c6f0 0x55d00a36eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab87b1d640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d00a36c6f0 0x55d00a36eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab87b1d640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d00a36c6f0 0x55d00a36eae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab87b1d640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fab70046070 0x7fab70033820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab70046070 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab88b1f640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fab70046070 0x7fab70033820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab88b1f640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fab70046070 0x7fab70033820 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab88b1f640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fab8001a940 0x7fab80011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.335+0000 7fab8831e640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fab8001a940 0x7fab80011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fab8001a940 0x7fab80011430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab70046070 2024-09-12T17:11:22.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.339+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab70046070 2024-09-12T17:11:22.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.343+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab70046070 2024-09-12T17:11:22.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a366680 2024-09-12T17:11:22.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.347+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab70046070 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x55d00a36c6f0 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36f110 con 0x7fab8001a940 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fab780fe040 con 0x55d00a366680 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fab780fe040 con 0x7fab70046070 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:22.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b060 con 0x55d00a366680 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b450 con 0x55d00a366680 2024-09-12T17:11:22.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b450 con 0x55d00a366680 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 zone default found 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 4 Realm: () 2024-09-12T17:11:22.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 zonegroup default 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.351+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b870 con 0x7fab8001a940 2024-09-12T17:11:22.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b870 con 0x55d00a36c6f0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370f80 con 0x55d00a36c6f0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 started sync module instance, tier type = 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94352012937232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a371820 con 0x7fab70046070 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a372070 con 0x55d00a366680 2024-09-12T17:11:22.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.355+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94352012937232] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94352012940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a371d20 con 0x55d00a366680 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a372840 con 0x55d00a36c6f0 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94352012940144] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94352012944144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a372c30 con 0x55d00a36c6f0 2024-09-12T17:11:22.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.359+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3735f0 con 0x7fab70046070 2024-09-12T17:11:22.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94352012948048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a373ce0 con 0x7fab70046070 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a374800 con 0x55d00a366680 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94352012944144] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94352012948048] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94352012952272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3747c0 con 0x55d00a366680 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.363+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a3750a0 con 0x7fab8001a940 2024-09-12T17:11:22.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.367+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94352012952272] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.367+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.367+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94352012941200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a374c70 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.367+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375520 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94352012941200] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94352012953536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375700 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375f50 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94352012953536] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94352012957440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375fd0 con 0x7fab8001a940 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=0 2024-09-12T17:11:22.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=1 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=2 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=3 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=4 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=5 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.371+0000 7fab8a8189c0 20 add_watcher() i=6 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94352012957440] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8a8189c0 20 add_watcher() i=7 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8a8189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d00a379290 con 0x55d00a366680 2024-09-12T17:11:22.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94352012958864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a376560 con 0x55d00a366680 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94352012958864] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.375+0000 7faa3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 5 note: GC not initialized 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7faa3d7e2640 20 reqs_thread_entry: start 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 20 Filter name: none 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fa9aeffd640 20 reqs_thread_entry: start 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a39be10 con 0x55d00a36c6f0 2024-09-12T17:11:22.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a39be10 con 0x55d00a36c6f0 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a39be10 con 0x55d00a366680 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b060 con 0x55d00a366680 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b060 con 0x7fab70046070 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.379+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.383+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.387+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab8001a940 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a366680 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x55d00a36c6f0 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d00a370420 con 0x7fab70046070 2024-09-12T17:11:22.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7faa3e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.391+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94352012958864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a36b060 con 0x55d00a366680 2024-09-12T17:11:22.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94352012958864] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94352012937232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375c90 con 0x7fab70046070 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94352012937232] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab8a8189c0 20 remove_watcher() i=0 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab8a8189c0 2 removed watcher, disabling cache 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.395+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94352012940144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375c90 con 0x55d00a366680 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94352012940144] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab8a8189c0 20 remove_watcher() i=1 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94352012944144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a371370 con 0x55d00a36c6f0 2024-09-12T17:11:22.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab87b1d640 1 -- 172.21.15.193:0/1564293369 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94352012944144] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab7003b030 con 0x55d00a36c6f0 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab8a8189c0 20 remove_watcher() i=2 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.399+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94352012948048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375c90 con 0x7fab70046070 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab88b1f640 1 -- 172.21.15.193:0/1564293369 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94352012948048] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab80030040 con 0x7fab70046070 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab8a8189c0 20 remove_watcher() i=3 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94352012952272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a372310 con 0x55d00a366680 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94352012952272] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x55d00a366680 2024-09-12T17:11:22.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab8a8189c0 20 remove_watcher() i=4 2024-09-12T17:11:22.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.403+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94352012941200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a373250 con 0x7fab8001a940 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94352012941200] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8a8189c0 20 remove_watcher() i=5 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94352012953536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a375c90 con 0x7fab8001a940 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94352012953536] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8a8189c0 20 remove_watcher() i=6 2024-09-12T17:11:22.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.407+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94352012957440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d00a372310 con 0x7fab8001a940 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94352012957440] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab780b3040 con 0x7fab8001a940 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 20 remove_watcher() i=7 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fab8001a940 msgr2=0x7fab80011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fab8001a940 0x7fab80011430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a366680 msgr2=0x55d00a368b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a366680 0x55d00a368b10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fab70046070 msgr2=0x7fab70033820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fab70046070 0x7fab70033820 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d00a36c6f0 msgr2=0x55d00a36eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d00a36c6f0 0x55d00a36eae0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa58039a70 msgr2=0x7faa5803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa58039a70 0x7faa5803bf30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f010 tx=0x7fab8001c070 comp rx=0 tx=0).stop 2024-09-12T17:11:22.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 msgr2=0x55d00a35b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8831e640 1 -- 172.21.15.193:0/1564293369 reap_dead start 2024-09-12T17:11:22.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fab7004f030 tx=0x7fab700500f0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 shutdown_connections 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/1564293369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a354e60 0x55d00a35b3b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 >> 172.21.15.193:0/1564293369 conn(0x55d00a350280 msgr2=0x55d00a34e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 shutdown_connections 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/1564293369 wait complete. 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 msgr2=0x7faa6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 0x7faa6003bf30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55d00a337f90 tx=0x7fab80003070 comp rx=0 tx=0).stop 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 msgr2=0x55d00a3478f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fab70002260 tx=0x7fab70015820 comp rx=0 tx=0).stop 2024-09-12T17:11:22.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 shutdown_connections 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa60039a70 0x7faa6003bf30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3503264372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a3474d0 0x55d00a3478f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 >> 172.21.15.193:0/3503264372 conn(0x55d00a33ce80 msgr2=0x55d00a33d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 shutdown_connections 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3503264372 wait complete. 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 msgr2=0x55d00a336f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 0x55d00a336f70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 msgr2=0x7faa7003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 0x7faa7003bf30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fab70004500 tx=0x7fab70006720 comp rx=0 tx=0).stop 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 msgr2=0x55d00a32fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fab780b8040 tx=0x7fab78018020 comp rx=0 tx=0).stop 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 shutdown_connections 2024-09-12T17:11:22.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d00a1af5f0 0x55d00a336f70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7faa70039a70 0x7faa7003bf30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 --2- 172.21.15.193:0/3058491260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d00a1af210 0x55d00a32fe00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 >> 172.21.15.193:0/3058491260 conn(0x55d00a2358f0 msgr2=0x55d00a322f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 shutdown_connections 2024-09-12T17:11:22.420 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.411+0000 7fab8a8189c0 1 -- 172.21.15.193:0/3058491260 wait complete. 2024-09-12T17:11:22.428 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-09-12T17:11:22.429 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:11:22.429 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-12T17:11:22.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-12T17:11:22.431 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-12T17:11:22.505 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:22.505 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:22.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f03696389c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560ee9200200 0x560ee9291030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f03696389c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ee91409c0 con 0x560ee92005e0 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f03696389c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560ee91906d0 con 0x560ee9200200 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036713e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560ee9200200 0x560ee9291030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036693d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x560ee92005e0 0x560ee9293580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35898/0 (socket says 172.21.15.193:35898) 2024-09-12T17:11:22.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036693d640 1 -- 172.21.15.193:0/2089640176 learned_addr learned my addr 172.21.15.193:0/2089640176 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:22.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036713e640 1 -- 172.21.15.193:0/2089640176 >> v1:172.21.15.62:6789/0 conn(0x560ee92005e0 legacy=0x560ee9293580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036713e640 1 -- 172.21.15.193:0/2089640176 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee9134ca0 con 0x560ee9200200 2024-09-12T17:11:22.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.503+0000 7f036713e640 1 --2- 172.21.15.193:0/2089640176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9291030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f035800a480 tx=0x7f035801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4719ec78d33c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f036613c640 1 -- 172.21.15.193:0/2089640176 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580b0070 con 0x560ee9200200 2024-09-12T17:11:22.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f036613c640 1 -- 172.21.15.193:0/2089640176 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03580ab540 con 0x560ee9200200 2024-09-12T17:11:22.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f036613c640 1 -- 172.21.15.193:0/2089640176 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580ab840 con 0x560ee9200200 2024-09-12T17:11:22.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 -- 172.21.15.193:0/2089640176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 msgr2=0x560ee9291030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 --2- 172.21.15.193:0/2089640176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9291030 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f035800a480 tx=0x7f035801b280 comp rx=0 tx=0).stop 2024-09-12T17:11:22.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 -- 172.21.15.193:0/2089640176 shutdown_connections 2024-09-12T17:11:22.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 --2- 172.21.15.193:0/2089640176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9291030 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 -- 172.21.15.193:0/2089640176 >> 172.21.15.193:0/2089640176 conn(0x560ee9286920 msgr2=0x560ee9288d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 -- 172.21.15.193:0/2089640176 shutdown_connections 2024-09-12T17:11:22.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.507+0000 7f03696389c0 1 -- 172.21.15.193:0/2089640176 wait complete. 2024-09-12T17:11:22.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ee9194680 con 0x560ee9200200 2024-09-12T17:11:22.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f036713e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f036713e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50112/0 (socket says 172.21.15.193:50112) 2024-09-12T17:11:22.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f036713e640 1 -- 172.21.15.193:0/2033571021 learned_addr learned my addr 172.21.15.193:0/2033571021 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f036713e640 1 -- 172.21.15.193:0/2033571021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee910fda0 con 0x560ee9200200 2024-09-12T17:11:22.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f036713e640 1 --2- 172.21.15.193:0/2033571021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0358018eb0 tx=0x7f0358003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336f7149e5305573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f025560a640 1 -- 172.21.15.193:0/2033571021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580b0040 con 0x560ee9200200 2024-09-12T17:11:22.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f025560a640 1 -- 172.21.15.193:0/2033571021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03580bb070 con 0x560ee9200200 2024-09-12T17:11:22.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f025560a640 1 -- 172.21.15.193:0/2033571021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580ab6f0 con 0x560ee9200200 2024-09-12T17:11:22.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- 172.21.15.193:0/2033571021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 msgr2=0x560ee93798d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 --2- 172.21.15.193:0/2033571021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0358018eb0 tx=0x7f0358003030 comp rx=0 tx=0).stop 2024-09-12T17:11:22.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- 172.21.15.193:0/2033571021 shutdown_connections 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 --2- 172.21.15.193:0/2033571021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee93798d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- 172.21.15.193:0/2033571021 >> 172.21.15.193:0/2033571021 conn(0x560ee9286920 msgr2=0x560ee9375510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- 172.21.15.193:0/2033571021 shutdown_connections 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- 172.21.15.193:0/2033571021 wait complete. 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.523+0000 7f03696389c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ee9136a50 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036713e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036713e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50126/0 (socket says 172.21.15.193:50126) 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036713e640 1 -- 172.21.15.193:0/2317510130 learned_addr learned my addr 172.21.15.193:0/2317510130 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036713e640 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee9381390 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036713e640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03580b8040 tx=0x7f0358018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 -- 172.21.15.193:0/2317510130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580b0030 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ee9381620 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee9381fd0 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 -- 172.21.15.193:0/2317510130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03580bb070 con 0x560ee9200200 2024-09-12T17:11:22.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 -- 172.21.15.193:0/2317510130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03580b68e0 con 0x560ee9200200 2024-09-12T17:11:22.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 -- 172.21.15.193:0/2317510130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f03580b6a80 con 0x560ee9200200 2024-09-12T17:11:22.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 0x7f024c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f0253e07640 1 -- 172.21.15.193:0/2317510130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f03580a8070 con 0x560ee9200200 2024-09-12T17:11:22.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036693d640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 0x7f024c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 0x560ee9387fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93884e0 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036793f640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 0x560ee9387fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036693d640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 0x7f024c03bf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0350001d80 tx=0x7f03500012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.527+0000 7f036793f640 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 0x560ee9387fa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036793f640 1 -- 172.21.15.193:0/2317510130 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f036000a4d0 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee9388930 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036793f640 1 -- 172.21.15.193:0/2317510130 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f036000a4d0 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee938a230 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036793f640 1 -- 172.21.15.193:0/2317510130 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f036000a4d0 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee9389460 con 0x560ee92005e0 2024-09-12T17:11:22.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036793f640 1 -- 172.21.15.193:0/2317510130 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f036000a4d0 con 0x560ee92005e0 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93898b0 con 0x560ee92005e0 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036793f640 1 -- 172.21.15.193:0/2317510130 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f036000a4d0 con 0x560ee92005e0 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ee91a1450 con 0x560ee9398540 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50138/0 (socket says 172.21.15.193:50138) 2024-09-12T17:11:22.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036693d640 1 -- 172.21.15.193:0/4155963714 learned_addr learned my addr 172.21.15.193:0/4155963714 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036693d640 1 -- 172.21.15.193:0/4155963714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee9398fa0 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f036693d640 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f035000d660 tx=0x7f035000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f0251602640 1 -- 172.21.15.193:0/4155963714 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035000c6b0 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ee9399800 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee9399d70 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f0251602640 1 -- 172.21.15.193:0/4155963714 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035000c850 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.531+0000 7f0251602640 1 -- 172.21.15.193:0/4155963714 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035000cb30 con 0x560ee9398540 2024-09-12T17:11:22.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f0251602640 1 -- 172.21.15.193:0/4155963714 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0350023020 con 0x560ee9398540 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f0251602640 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 0x7f024003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f0251602640 1 -- 172.21.15.193:0/4155963714 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0350021020 con 0x560ee9398540 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036793f640 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 0x7f024003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036793f640 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 0x7f024003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x560ee9388f80 tx=0x7f0360005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f03696389c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f03696389c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ee937a060 con 0x560ee93a4f00 2024-09-12T17:11:22.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50154/0 (socket says 172.21.15.193:50154) 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036693d640 1 -- 172.21.15.193:0/2272363633 learned_addr learned my addr 172.21.15.193:0/2272363633 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036693d640 1 -- 172.21.15.193:0/2272363633 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee93a58b0 con 0x560ee93a4f00 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f036693d640 1 --2- 172.21.15.193:0/2272363633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0350050f20 tx=0x7f03500233d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c950ea5b9953eff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f024affd640 1 -- 172.21.15.193:0/2272363633 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350047070 con 0x560ee93a4f00 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f024affd640 1 -- 172.21.15.193:0/2272363633 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035000ccd0 con 0x560ee93a4f00 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.535+0000 7f024affd640 1 -- 172.21.15.193:0/2272363633 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f035001bcc0 con 0x560ee93a4f00 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/2272363633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 msgr2=0x560ee93a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 --2- 172.21.15.193:0/2272363633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0350050f20 tx=0x7f03500233d0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/2272363633 shutdown_connections 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 --2- 172.21.15.193:0/2272363633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93a52e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/2272363633 >> 172.21.15.193:0/2272363633 conn(0x560ee93a1330 msgr2=0x560ee939f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/2272363633 shutdown_connections 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/2272363633 wait complete. 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 Processor -- start 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- start start 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ee93a5f10 con 0x560ee93a4f00 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036693d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50170/0 (socket says 172.21.15.193:50170) 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 learned_addr learned my addr 172.21.15.193:0/1552977295 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee93ac9e0 con 0x560ee93a4f00 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036693d640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f035000dfb0 tx=0x7f0350050eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 -- 172.21.15.193:0/1552977295 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350047070 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ee93acc70 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 -- 172.21.15.193:0/1552977295 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03500236e0 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 -- 172.21.15.193:0/1552977295 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0350025410 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee93acc70 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 -- 172.21.15.193:0/1552977295 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f035001b420 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f02300399d0 0x7f023003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f02497fa640 1 -- 172.21.15.193:0/1552977295 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0350005030 con 0x560ee93a4f00 2024-09-12T17:11:22.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.539+0000 7f036793f640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f02300399d0 0x7f023003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee93b7520 0x560ee93b9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93ba0e0 con 0x560ee93b7520 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee93b7520 0x560ee93b9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f02300399d0 0x7f023003be90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x560ee9382f90 tx=0x7f036001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee93b7520 0x560ee93b9990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 realm 2024-09-12T17:11:22.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93ba4f0 con 0x560ee93b7520 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93badc0 con 0x560ee93b7520 2024-09-12T17:11:22.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93bb160 con 0x560ee93b7520 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93bb9b0 con 0x560ee93b7520 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 20 searching for the correct realm 2024-09-12T17:11:22.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560ee93bd720 0x560ee93bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036693d640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560ee93bd720 0x560ee93bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036693d640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560ee93bd720 0x560ee93bfb10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036693d640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f03500152e0 0x7f0350015760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f03500152e0 0x7f0350015760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f03500152e0 0x7f0350015760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0360031040 0x7f0360032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.543+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0360031040 0x7f0360032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0360031040 0x7f0360032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.547+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.551+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93bd720 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.555+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f0360031040 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x560ee93b7520 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0050 con 0x7f03500152e0 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f036001f070 con 0x7f03500152e0 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:22.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93bc300 con 0x560ee93b7520 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93bcba0 con 0x560ee93b7520 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93bcba0 con 0x560ee93b7520 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 zone default found 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 4 Realm: () 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:22.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 zonegroup default 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c03f0 con 0x7f0360031040 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c1ee0 con 0x560ee93bd720 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c2360 con 0x560ee93bd720 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 started sync module instance, tier type = 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.559+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c1280 con 0x7f03500152e0 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622042560112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c0ee0 con 0x7f03500152e0 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c3290 con 0x560ee93b7520 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622042566112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c3200 con 0x560ee93b7520 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c41f0 con 0x560ee93bd720 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.563+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622042560112] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622042564544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c4610 con 0x560ee93bd720 2024-09-12T17:11:22.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c4fd0 con 0x7f03500152e0 2024-09-12T17:11:22.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622042566112] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622042573600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c53f0 con 0x7f03500152e0 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c5cc0 con 0x560ee93b7520 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.567+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622042564544] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622042569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c58a0 con 0x560ee93b7520 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c66d0 con 0x7f0360031040 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622042573600] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622042569984] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622042574928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c6220 con 0x7f0360031040 2024-09-12T17:11:22.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.571+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c6a70 con 0x7f0360031040 2024-09-12T17:11:22.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.575+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622042574928] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.575+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.575+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622042579488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c6af0 con 0x7f0360031040 2024-09-12T17:11:22.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.575+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c7380 con 0x7f0360031040 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622042579488] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622042580544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c7560 con 0x7f0360031040 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=0 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=1 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=2 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=3 2024-09-12T17:11:22.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=4 2024-09-12T17:11:22.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=5 2024-09-12T17:11:22.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=6 2024-09-12T17:11:22.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622042580544] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 20 add_watcher() i=7 2024-09-12T17:11:22.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:22.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93ca930 con 0x560ee93b7520 2024-09-12T17:11:22.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.579+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622042584144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93c7d20 con 0x560ee93b7520 2024-09-12T17:11:22.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622042584144] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f021dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f03696389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:22.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f03696389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:22.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d3100 con 0x560ee93b7520 2024-09-12T17:11:22.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.583+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d35b0 con 0x7f0360031040 2024-09-12T17:11:22.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.587+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.587+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d35b0 con 0x560ee93bd720 2024-09-12T17:11:22.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.587+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.587+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d35b0 con 0x560ee93b7520 2024-09-12T17:11:22.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d35b0 con 0x7f03500152e0 2024-09-12T17:11:22.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d3b40 con 0x560ee93bd720 2024-09-12T17:11:22.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.591+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d3b20 con 0x560ee93b7520 2024-09-12T17:11:22.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.595+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.595+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d3c10 con 0x7f0360031040 2024-09-12T17:11:22.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.595+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.595+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d3c10 con 0x7f03500152e0 2024-09-12T17:11:22.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.599+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.599+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4240 con 0x560ee93bd720 2024-09-12T17:11:22.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.599+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.599+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4220 con 0x7f03500152e0 2024-09-12T17:11:22.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.603+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.603+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4790 con 0x7f0360031040 2024-09-12T17:11:22.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.603+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.603+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4790 con 0x7f03500152e0 2024-09-12T17:11:22.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.607+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.607+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f0360031040 2024-09-12T17:11:22.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.607+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.607+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93b7520 2024-09-12T17:11:22.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.611+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.611+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.611+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.611+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f03500152e0 2024-09-12T17:11:22.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93b7520 2024-09-12T17:11:22.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.615+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93b7520 2024-09-12T17:11:22.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.619+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.619+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.619+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.619+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f03500152e0 2024-09-12T17:11:22.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.623+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.623+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.623+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.623+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.627+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f0360031040 2024-09-12T17:11:22.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.631+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.631+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.631+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.631+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f0360031040 2024-09-12T17:11:22.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.635+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.635+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x560ee93bd720 2024-09-12T17:11:22.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.639+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.639+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f0360031040 2024-09-12T17:11:22.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.639+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.639+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d4c40 con 0x7f03500152e0 2024-09-12T17:11:22.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f021cfe1640 20 reqs_thread_entry: start 2024-09-12T17:11:22.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 20 Filter name: none 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f01967fc640 20 reqs_thread_entry: start 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17f0 con 0x7f03500152e0 2024-09-12T17:11:22.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f021dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.643+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622042584144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17f0 con 0x560ee93b7520 2024-09-12T17:11:22.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94622042584144] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622042560112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17f0 con 0x7f03500152e0 2024-09-12T17:11:22.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94622042560112] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f03696389c0 20 remove_watcher() i=0 2024-09-12T17:11:22.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f03696389c0 2 removed watcher, disabling cache 2024-09-12T17:11:22.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.647+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622042566112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x560ee93b7520 2024-09-12T17:11:22.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94622042566112] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f03696389c0 20 remove_watcher() i=1 2024-09-12T17:11:22.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622042564544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x560ee93bd720 2024-09-12T17:11:22.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f036693d640 1 -- 172.21.15.193:0/1552977295 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94622042564544] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0350049070 con 0x560ee93bd720 2024-09-12T17:11:22.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f03696389c0 20 remove_watcher() i=2 2024-09-12T17:11:22.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.651+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622042573600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x7f03500152e0 2024-09-12T17:11:22.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f036793f640 1 -- 172.21.15.193:0/1552977295 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94622042573600] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0360040040 con 0x7f03500152e0 2024-09-12T17:11:22.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f03696389c0 20 remove_watcher() i=3 2024-09-12T17:11:22.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622042569984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x560ee93b7520 2024-09-12T17:11:22.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94622042569984] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x560ee93b7520 2024-09-12T17:11:22.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f03696389c0 20 remove_watcher() i=4 2024-09-12T17:11:22.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.655+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622042574928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x7f0360031040 2024-09-12T17:11:22.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94622042574928] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f03696389c0 20 remove_watcher() i=5 2024-09-12T17:11:22.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622042579488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x7f0360031040 2024-09-12T17:11:22.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94622042579488] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f03696389c0 20 remove_watcher() i=6 2024-09-12T17:11:22.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.659+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622042580544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ee93d17b0 con 0x7f0360031040 2024-09-12T17:11:22.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94622042580544] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f03580b3040 con 0x7f0360031040 2024-09-12T17:11:22.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 20 remove_watcher() i=7 2024-09-12T17:11:22.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0360031040 msgr2=0x7f0360032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0360031040 0x7f0360032940 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee93b7520 msgr2=0x560ee93b9990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee93b7520 0x560ee93b9990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f03500152e0 msgr2=0x7f0350015760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f03500152e0 0x7f0350015760 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560ee93bd720 msgr2=0x560ee93bfb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560ee93bd720 0x560ee93bfb10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f02300399d0 msgr2=0x7f023003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f02300399d0 0x7f023003be90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x560ee9382f90 tx=0x7f036001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 msgr2=0x560ee93ac480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f036713e640 1 -- 172.21.15.193:0/1552977295 reap_dead start 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f035000dfb0 tx=0x7f0350050eb0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 shutdown_connections 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/1552977295 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee93a4f00 0x560ee93ac480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 >> 172.21.15.193:0/1552977295 conn(0x560ee93a1330 msgr2=0x560ee939f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 shutdown_connections 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/1552977295 wait complete. 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 msgr2=0x7f024003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 0x7f024003bf30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x560ee9388f80 tx=0x7f0360005850 comp rx=0 tx=0).stop 2024-09-12T17:11:22.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 msgr2=0x560ee9398960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f035000d660 tx=0x7f035000da60 comp rx=0 tx=0).stop 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 shutdown_connections 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0240039a70 0x7f024003bf30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/4155963714 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9398540 0x560ee9398960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 >> 172.21.15.193:0/4155963714 conn(0x560ee938def0 msgr2=0x560ee938e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 shutdown_connections 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/4155963714 wait complete. 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 msgr2=0x560ee9387fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 0x560ee9387fa0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 msgr2=0x7f024c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 0x7f024c03bf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0350001d80 tx=0x7f03500012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 msgr2=0x560ee9380e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f03580b8040 tx=0x7f0358018020 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 shutdown_connections 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ee92005e0 0x560ee9387fa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f024c039a70 0x7f024c03bf30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 --2- 172.21.15.193:0/2317510130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ee9200200 0x560ee9380e30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 >> 172.21.15.193:0/2317510130 conn(0x560ee9286920 msgr2=0x560ee9373fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 shutdown_connections 2024-09-12T17:11:22.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.663+0000 7f03696389c0 1 -- 172.21.15.193:0/2317510130 wait complete. 2024-09-12T17:11:22.680 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:11:22.681 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-12T17:11:22.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-12T17:11:22.681 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-12T17:11:22.759 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:22.759 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:22.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4615e4c9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557db6826020 0x557db6824ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4615e4c9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557db67639c0 con 0x557db6825af0 2024-09-12T17:11:22.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4615e4c9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x557db67b36d0 con 0x557db6826020 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613151640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557db6826020 0x557db6824ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613151640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557db6826020 0x557db6824ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50186/0 (socket says 172.21.15.193:50186) 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613151640 1 -- 172.21.15.193:0/2992365056 learned_addr learned my addr 172.21.15.193:0/2992365056 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613952640 1 --1- 172.21.15.193:0/2992365056 >> v1:172.21.15.62:6789/0 conn(0x557db6825af0 0x557db6824490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35900/0 (socket says 172.21.15.193:35900) 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613151640 1 -- 172.21.15.193:0/2992365056 >> v1:172.21.15.62:6789/0 conn(0x557db6825af0 legacy=0x557db6824490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.755+0000 7f4613151640 1 -- 172.21.15.193:0/2992365056 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db6757ca0 con 0x557db6826020 2024-09-12T17:11:22.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4613151640 1 --2- 172.21.15.193:0/2992365056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6826020 0x557db6824ba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f460800a5c0 tx=0x7f460801b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fab8d79d117507 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4612950640 1 -- 172.21.15.193:0/2992365056 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080aa540 con 0x557db6826020 2024-09-12T17:11:22.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4612950640 1 -- 172.21.15.193:0/2992365056 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46080af070 con 0x557db6826020 2024-09-12T17:11:22.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4612950640 1 -- 172.21.15.193:0/2992365056 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080aa830 con 0x557db6826020 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/2992365056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6826020 msgr2=0x557db6824ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/2992365056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6826020 0x557db6824ba0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f460800a5c0 tx=0x7f460801b2e0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/2992365056 shutdown_connections 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/2992365056 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6826020 0x557db6824ba0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/2992365056 >> 172.21.15.193:0/2992365056 conn(0x557db68aaad0 msgr2=0x557db68acef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.759+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/2992365056 shutdown_connections 2024-09-12T17:11:22.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.763+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/2992365056 wait complete. 2024-09-12T17:11:22.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557db67b7680 con 0x557db6825af0 2024-09-12T17:11:22.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4613952640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4613952640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50202/0 (socket says 172.21.15.193:50202) 2024-09-12T17:11:22.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4613952640 1 -- 172.21.15.193:0/4240853699 learned_addr learned my addr 172.21.15.193:0/4240853699 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4613952640 1 -- 172.21.15.193:0/4240853699 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db6732da0 con 0x557db6825af0 2024-09-12T17:11:22.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4613952640 1 --2- 172.21.15.193:0/4240853699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f460400b270 tx=0x7f460400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa81149156fb3df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4501e0b640 1 -- 172.21.15.193:0/4240853699 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460400e5d0 con 0x557db6825af0 2024-09-12T17:11:22.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4501e0b640 1 -- 172.21.15.193:0/4240853699 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460400e770 con 0x557db6825af0 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4501e0b640 1 -- 172.21.15.193:0/4240853699 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460400ea70 con 0x557db6825af0 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/4240853699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 msgr2=0x557db699cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/4240853699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f460400b270 tx=0x7f460400b670 comp rx=0 tx=0).stop 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/4240853699 shutdown_connections 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/4240853699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db699cb50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/4240853699 >> 172.21.15.193:0/4240853699 conn(0x557db68aaad0 msgr2=0x557db69987f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/4240853699 shutdown_connections 2024-09-12T17:11:22.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.779+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/4240853699 wait complete. 2024-09-12T17:11:22.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557db6759a50 con 0x557db6825af0 2024-09-12T17:11:22.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613952640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613952640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50216/0 (socket says 172.21.15.193:50216) 2024-09-12T17:11:22.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613952640 1 -- 172.21.15.193:0/699341378 learned_addr learned my addr 172.21.15.193:0/699341378 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613952640 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db69a4720 con 0x557db6825af0 2024-09-12T17:11:22.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613952640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x557db699db40 tx=0x7f4604000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 -- 172.21.15.193:0/699341378 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460400be70 con 0x557db6825af0 2024-09-12T17:11:22.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557db69a49b0 con 0x557db6825af0 2024-09-12T17:11:22.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 -- 172.21.15.193:0/699341378 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f460400f9f0 con 0x557db6825af0 2024-09-12T17:11:22.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 -- 172.21.15.193:0/699341378 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f460400fd10 con 0x557db6825af0 2024-09-12T17:11:22.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557db69a5360 con 0x557db6825af0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 -- 172.21.15.193:0/699341378 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4604017070 con 0x557db6825af0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 0x7f44fc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f44fbfff640 1 -- 172.21.15.193:0/699341378 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4604015020 con 0x557db6825af0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4613151640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 0x7f44fc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 0x557db69ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69ab870 con 0x557db6826020 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.783+0000 7f4614153640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 0x557db69ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 0x7f44fc03bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46080ae000 tx=0x7f46080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 0x557db69ab330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 -- 172.21.15.193:0/699341378 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f460c00a4d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69a56a0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 -- 172.21.15.193:0/699341378 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f460c00a4d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69ad5d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 -- 172.21.15.193:0/699341378 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f460c00a4d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69ac830 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 -- 172.21.15.193:0/699341378 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f460c00a4d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69acc80 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4614153640 1 -- 172.21.15.193:0/699341378 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f460c00a4d0 con 0x557db6826020 2024-09-12T17:11:22.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4615e4c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557db67c4450 con 0x557db69bb890 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50224/0 (socket says 172.21.15.193:50224) 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 -- 172.21.15.193:0/1582261399 learned_addr learned my addr 172.21.15.193:0/1582261399 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 -- 172.21.15.193:0/1582261399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db69bc2f0 con 0x557db69bb890 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.787+0000 7f4613151640 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f46080ac040 tx=0x7f46080180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 -- 172.21.15.193:0/1582261399 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080b48f0 con 0x557db69bb890 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557db69bcb50 con 0x557db69bb890 2024-09-12T17:11:22.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 -- 172.21.15.193:0/1582261399 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46080b4a90 con 0x557db69bb890 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 -- 172.21.15.193:0/1582261399 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080b4d70 con 0x557db69bb890 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557db69bd060 con 0x557db69bb890 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 -- 172.21.15.193:0/1582261399 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f46080c9430 con 0x557db69bb890 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 0x7f44ec03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f44f97fa640 1 -- 172.21.15.193:0/1582261399 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f46080ed980 con 0x557db69bb890 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4614153640 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 0x7f44ec03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4614153640 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 0x7f44ec03bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x557db69ac350 tx=0x7f460c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4615e4c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557db699d380 con 0x557db69c8090 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50228/0 (socket says 172.21.15.193:50228) 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4613151640 1 -- 172.21.15.193:0/3553069883 learned_addr learned my addr 172.21.15.193:0/3553069883 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4613151640 1 -- 172.21.15.193:0/3553069883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db69c8a60 con 0x557db69c8090 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.791+0000 7f4613151640 1 --2- 172.21.15.193:0/3553069883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46080c84b0 tx=0x7f4608008300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f31a6bf2cb937f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f2ffd640 1 -- 172.21.15.193:0/3553069883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080bd3b0 con 0x557db69c8090 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f2ffd640 1 -- 172.21.15.193:0/3553069883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46080bd550 con 0x557db69c8090 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f2ffd640 1 -- 172.21.15.193:0/3553069883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080d2c10 con 0x557db69c8090 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/3553069883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 msgr2=0x557db69c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/3553069883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f46080c84b0 tx=0x7f4608008300 comp rx=0 tx=0).stop 2024-09-12T17:11:22.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/3553069883 shutdown_connections 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/3553069883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69c8470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/3553069883 >> 172.21.15.193:0/3553069883 conn(0x557db69c44c0 msgr2=0x557db69c2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/3553069883 shutdown_connections 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/3553069883 wait complete. 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 Processor -- start 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- start start 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557db69c90a0 con 0x557db69c8090 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4613151640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50234/0 (socket says 172.21.15.193:50234) 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 learned_addr learned my addr 172.21.15.193:0/1225390559 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557db69cfb30 con 0x557db69c8090 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4613151640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46080eac60 tx=0x7f46080ebd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f17fa640 1 -- 172.21.15.193:0/1225390559 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080bdad0 con 0x557db69c8090 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f17fa640 1 -- 172.21.15.193:0/1225390559 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46080f2070 con 0x557db69c8090 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557db69cfdc0 con 0x557db69c8090 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f44f17fa640 1 -- 172.21.15.193:0/1225390559 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46080c0a20 con 0x557db69c8090 2024-09-12T17:11:22.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.795+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557db69d0770 con 0x557db69c8090 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f44f17fa640 1 -- 172.21.15.193:0/1225390559 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f46080bea50 con 0x557db69c8090 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f44f17fa640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44dc039a70 0x7f44dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f44f17fa640 1 -- 172.21.15.193:0/1225390559 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f46080de0c0 con 0x557db69c8090 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4614153640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44dc039a70 0x7f44dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db69da880 0x557db69dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69dd490 con 0x557db69da880 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db69da880 0x557db69dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4614153640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44dc039a70 0x7f44dc03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x557db69a55e0 tx=0x7f460c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db69da880 0x557db69dcd40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 realm 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69dd8a0 con 0x557db69da880 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69de170 con 0x557db69da880 2024-09-12T17:11:22.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69de510 con 0x557db69da880 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69ded60 con 0x557db69da880 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 20 searching for the correct realm 2024-09-12T17:11:22.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557db69e0ad0 0x557db69e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613151640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557db69e0ad0 0x557db69e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.799+0000 7f4613151640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557db69e0ad0 0x557db69e2ec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613151640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4608009040 0x7f46080ed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f4608009040 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4614153640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4608009040 0x7f46080ed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4614153640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4608009040 0x7f46080ed240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4614153640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f460c031040 0x7f460c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:22.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f460c031040 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f460c031040 0x7f460c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f460c031040 0x7f460c032940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69da880 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69da880 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.803+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f460c031040 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f460c031040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f4608009040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69da880 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f460c031040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69da880 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f4608009040 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.807+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x7f460c031040 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69e0ad0 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3400 con 0x557db69da880 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69da880 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f460c031040 2024-09-12T17:11:22.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69e0ad0 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f4608009040 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69da880 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f460c031040 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69e0ad0 2024-09-12T17:11:22.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.811+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f460c031040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f4608009040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69e0ad0 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f460c031040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x557db69da880 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4604058040 con 0x7f4608009040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f460c01f070 con 0x7f4608009040 2024-09-12T17:11:22.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69df670 con 0x557db69da880 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69dff10 con 0x557db69da880 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69dff10 con 0x557db69da880 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 zone default found 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 4 Realm: () 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 zonegroup default 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69e3830 con 0x7f460c031040 2024-09-12T17:11:22.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.815+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69e5320 con 0x557db69e0ad0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69e5740 con 0x557db69e0ad0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 20 started sync module instance, tier type = 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69dfb20 con 0x7f4608009040 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93998423099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e5be0 con 0x7f4608009040 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.819+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e66c0 con 0x557db69da880 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93998423105904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e6680 con 0x557db69da880 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e75d0 con 0x557db69e0ad0 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93998423099248] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93998423105904] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93998423108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e4ca0 con 0x557db69e0ad0 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.823+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e7ea0 con 0x7f4608009040 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93998423112448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e8530 con 0x7f4608009040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e9050 con 0x557db69da880 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93998423108272] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93998423112448] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93998423116576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e9010 con 0x557db69da880 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.827+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e98f0 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93998423116576] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93998423109888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e9010 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e9d90 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93998423109888] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93998423118832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e9cc0 con 0x7f460c031040 2024-09-12T17:11:22.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.831+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea740 con 0x7f460c031040 2024-09-12T17:11:22.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93998423118832] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93998423122480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea920 con 0x7f460c031040 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=0 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=1 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=2 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=3 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=4 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=5 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.835+0000 7f4615e4c9c0 20 add_watcher() i=6 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93998423122480] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 20 add_watcher() i=7 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69edcf0 con 0x557db69da880 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93998423123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69eb0e0 con 0x557db69da880 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93998423123984] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f44c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.839+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f6470 con 0x557db69da880 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.843+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.843+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f6920 con 0x7f460c031040 2024-09-12T17:11:22.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.843+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.843+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f6920 con 0x557db69e0ad0 2024-09-12T17:11:22.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.847+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.847+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f6ce0 con 0x557db69da880 2024-09-12T17:11:22.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.847+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.847+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f6cc0 con 0x7f4608009040 2024-09-12T17:11:22.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f7230 con 0x557db69e0ad0 2024-09-12T17:11:22.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f7a80 con 0x557db69da880 2024-09-12T17:11:22.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.851+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f7a80 con 0x7f460c031040 2024-09-12T17:11:22.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.855+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.855+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f7a80 con 0x7f4608009040 2024-09-12T17:11:22.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4b00 con 0x557db69e0ad0 2024-09-12T17:11:22.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4ad0 con 0x7f4608009040 2024-09-12T17:11:22.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.859+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4ad0 con 0x7f460c031040 2024-09-12T17:11:22.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.863+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.863+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4ad0 con 0x7f4608009040 2024-09-12T17:11:22.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.863+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.863+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x7f460c031040 2024-09-12T17:11:22.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.867+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.867+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x557db69da880 2024-09-12T17:11:22.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.867+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.867+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x557db69e0ad0 2024-09-12T17:11:22.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.871+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.871+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x7f4608009040 2024-09-12T17:11:22.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.871+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.871+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x557db69e0ad0 2024-09-12T17:11:22.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f87b0 con 0x557db69da880 2024-09-12T17:11:22.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f87b0 con 0x557db69da880 2024-09-12T17:11:22.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.875+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x557db69e0ad0 2024-09-12T17:11:22.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.879+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.879+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f85e0 con 0x7f4608009040 2024-09-12T17:11:22.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.879+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.879+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8810 con 0x557db69e0ad0 2024-09-12T17:11:22.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.883+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.883+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4490 con 0x557db69e0ad0 2024-09-12T17:11:22.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.883+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.883+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4660 con 0x557db69e0ad0 2024-09-12T17:11:22.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.887+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.887+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f4660 con 0x557db69e0ad0 2024-09-12T17:11:22.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.887+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.887+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8b70 con 0x7f460c031040 2024-09-12T17:11:22.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.891+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.891+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8af0 con 0x557db69e0ad0 2024-09-12T17:11:22.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.891+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.891+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8af0 con 0x7f460c031040 2024-09-12T17:11:22.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.895+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.895+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8ad0 con 0x557db69e0ad0 2024-09-12T17:11:22.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.899+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.899+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8ad0 con 0x7f460c031040 2024-09-12T17:11:22.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f8ad0 con 0x7f4608009040 2024-09-12T17:11:22.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f44c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:22.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f4615e4c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:22.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f4615e4c9c0 20 Filter name: none 2024-09-12T17:11:22.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.903+0000 7f44427fc640 20 reqs_thread_entry: start 2024-09-12T17:11:22.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:11:22.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:22.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557db69f3f90 con 0x7f460c031040 2024-09-12T17:11:22.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:22.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T17:11:22.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:11:22.911 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:11:22.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f44c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:22.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.907+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93998423123984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69f2930 con 0x557db69da880 2024-09-12T17:11:22.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93998423123984] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93998423099248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x7f4608009040 2024-09-12T17:11:22.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93998423099248] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4615e4c9c0 20 remove_watcher() i=0 2024-09-12T17:11:22.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4615e4c9c0 2 removed watcher, disabling cache 2024-09-12T17:11:22.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93998423105904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x557db69da880 2024-09-12T17:11:22.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.911+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93998423105904] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.915+0000 7f4615e4c9c0 20 remove_watcher() i=1 2024-09-12T17:11:22.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.915+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93998423108272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x557db69e0ad0 2024-09-12T17:11:22.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.915+0000 7f4613151640 1 -- 172.21.15.193:0/1225390559 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93998423108272] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46080e5050 con 0x557db69e0ad0 2024-09-12T17:11:22.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.915+0000 7f4615e4c9c0 20 remove_watcher() i=2 2024-09-12T17:11:22.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.915+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93998423112448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e6ab0 con 0x7f4608009040 2024-09-12T17:11:22.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4614153640 1 -- 172.21.15.193:0/1225390559 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93998423112448] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460c040040 con 0x7f4608009040 2024-09-12T17:11:22.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4615e4c9c0 20 remove_watcher() i=3 2024-09-12T17:11:22.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93998423116576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x557db69da880 2024-09-12T17:11:22.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93998423116576] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x557db69da880 2024-09-12T17:11:22.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4615e4c9c0 20 remove_watcher() i=4 2024-09-12T17:11:22.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.919+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93998423109888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69e7b00 con 0x7f460c031040 2024-09-12T17:11:22.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93998423109888] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4615e4c9c0 20 remove_watcher() i=5 2024-09-12T17:11:22.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93998423118832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x7f460c031040 2024-09-12T17:11:22.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93998423118832] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4615e4c9c0 20 remove_watcher() i=6 2024-09-12T17:11:22.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.923+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93998423122480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557db69ea810 con 0x7f460c031040 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93998423122480] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f460402e070 con 0x7f460c031040 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 20 remove_watcher() i=7 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f460c031040 msgr2=0x7f460c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f460c031040 0x7f460c032940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db69da880 msgr2=0x557db69dcd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db69da880 0x557db69dcd40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4608009040 msgr2=0x7f46080ed240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4608009040 0x7f46080ed240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557db69e0ad0 msgr2=0x557db69e2ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557db69e0ad0 0x557db69e2ec0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44dc039a70 msgr2=0x7f44dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44dc039a70 0x7f44dc03bf30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x557db69a55e0 tx=0x7f460c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4613952640 1 -- 172.21.15.193:0/1225390559 reap_dead start 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 msgr2=0x557db69cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46080eac60 tx=0x7f46080ebd20 comp rx=0 tx=0).stop 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 shutdown_connections 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1225390559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69c8090 0x557db69cf5d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 >> 172.21.15.193:0/1225390559 conn(0x557db69c44c0 msgr2=0x557db69c26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 shutdown_connections 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1225390559 wait complete. 2024-09-12T17:11:22.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 msgr2=0x7f44ec03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 0x7f44ec03bf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x557db69ac350 tx=0x7f460c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 msgr2=0x557db69bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f46080ac040 tx=0x7f46080180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 shutdown_connections 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44ec039ac0 0x7f44ec03bf80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/1582261399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db69bb890 0x557db69bbcb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 >> 172.21.15.193:0/1582261399 conn(0x557db69b1240 msgr2=0x557db69b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 shutdown_connections 2024-09-12T17:11:22.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/1582261399 wait complete. 2024-09-12T17:11:22.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 msgr2=0x557db69ab330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.927+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 0x557db69ab330 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 msgr2=0x7f44fc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 0x7f44fc03bf30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46080ae000 tx=0x7f46080a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 msgr2=0x557db69a41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x557db699db40 tx=0x7f4604000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 shutdown_connections 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557db6826020 0x557db69ab330 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f44fc039a70 0x7f44fc03bf30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 --2- 172.21.15.193:0/699341378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557db6825af0 0x557db69a41c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 >> 172.21.15.193:0/699341378 conn(0x557db68aaad0 msgr2=0x557db6997280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 shutdown_connections 2024-09-12T17:11:22.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:22.931+0000 7f4615e4c9c0 1 -- 172.21.15.193:0/699341378 wait complete. 2024-09-12T17:11:22.945 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:11:22.946 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:22.946 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:22.946 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:11:23.026 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:23.027 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:23.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe1117799c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9dd9a6350 0x55c9dd9a8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe1117799c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9dd8549c0 con 0x55c9dd9a2200 2024-09-12T17:11:23.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe1117799c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c9dd8a46d0 con 0x55c9dd9a6350 2024-09-12T17:11:23.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10f27f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c9dd9a2200 0x55c9dd9a25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35912/0 (socket says 172.21.15.193:35912) 2024-09-12T17:11:23.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10f27f640 1 -- 172.21.15.193:0/4068812847 learned_addr learned my addr 172.21.15.193:0/4068812847 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:23.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/4068812847 >> v2:172.21.15.62:3300/0 conn(0x55c9dd9a6350 0x55c9dd9a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10e27d640 1 -- 172.21.15.193:0/4068812847 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568197380 0 0) 0x55c9dd8549c0 con 0x55c9dd9a2200 2024-09-12T17:11:23.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10e27d640 1 -- 172.21.15.193:0/4068812847 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0fc001e20 con 0x55c9dd9a2200 2024-09-12T17:11:23.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10ea7e640 1 -- 172.21.15.193:0/4068812847 >> v1:172.21.15.62:6789/0 conn(0x55c9dd9a2200 legacy=0x55c9dd9a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.023+0000 7fe10ea7e640 1 -- 172.21.15.193:0/4068812847 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9dd848ca0 con 0x55c9dd9a6350 2024-09-12T17:11:23.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/4068812847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dd9a8740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a480 tx=0x7fe0f801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91082d231cfbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe10e27d640 1 -- 172.21.15.193:0/4068812847 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80aa570 con 0x55c9dd9a6350 2024-09-12T17:11:23.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe10e27d640 1 -- 172.21.15.193:0/4068812847 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80af070 con 0x55c9dd9a6350 2024-09-12T17:11:23.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe10e27d640 1 -- 172.21.15.193:0/4068812847 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80aa840 con 0x55c9dd9a6350 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 -- 172.21.15.193:0/4068812847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 msgr2=0x55c9dd9a8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 --2- 172.21.15.193:0/4068812847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dd9a8740 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a480 tx=0x7fe0f801b310 comp rx=0 tx=0).stop 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 -- 172.21.15.193:0/4068812847 shutdown_connections 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 --2- 172.21.15.193:0/4068812847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dd9a8740 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 -- 172.21.15.193:0/4068812847 >> 172.21.15.193:0/4068812847 conn(0x55c9dd915b10 msgr2=0x55c9dd915f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 -- 172.21.15.193:0/4068812847 shutdown_connections 2024-09-12T17:11:23.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.027+0000 7fe1117799c0 1 -- 172.21.15.193:0/4068812847 wait complete. 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe1117799c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe1117799c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9dd8a8680 con 0x55c9dd9a2200 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe10f27f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe10f27f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50248/0 (socket says 172.21.15.193:50248) 2024-09-12T17:11:23.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.043+0000 7fe10f27f640 1 -- 172.21.15.193:0/2547568757 learned_addr learned my addr 172.21.15.193:0/2547568757 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 -- 172.21.15.193:0/2547568757 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9dd823da0 con 0x55c9dd9a2200 2024-09-12T17:11:23.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 --2- 172.21.15.193:0/2547568757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1000016a0 tx=0x7fe100001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4916bb03c278afe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fdffd60a640 1 -- 172.21.15.193:0/2547568757 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe100004530 con 0x55c9dd9a2200 2024-09-12T17:11:23.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fdffd60a640 1 -- 172.21.15.193:0/2547568757 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000046d0 con 0x55c9dd9a2200 2024-09-12T17:11:23.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fdffd60a640 1 -- 172.21.15.193:0/2547568757 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1000049f0 con 0x55c9dd9a2200 2024-09-12T17:11:23.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- 172.21.15.193:0/2547568757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 msgr2=0x55c9dda8d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2547568757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe1000016a0 tx=0x7fe100001b60 comp rx=0 tx=0).stop 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- 172.21.15.193:0/2547568757 shutdown_connections 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2547568757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a2200 0x55c9dda8d6d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- 172.21.15.193:0/2547568757 >> 172.21.15.193:0/2547568757 conn(0x55c9dd915b10 msgr2=0x55c9dda89310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- 172.21.15.193:0/2547568757 shutdown_connections 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- 172.21.15.193:0/2547568757 wait complete. 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe1117799c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9dd84aa50 con 0x55c9dd9a6350 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50262/0 (socket says 172.21.15.193:50262) 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 -- 172.21.15.193:0/911744299 learned_addr learned my addr 172.21.15.193:0/911744299 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9dda955c0 con 0x55c9dd9a6350 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.047+0000 7fe10f27f640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe100001ba0 tx=0x7fe100004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 -- 172.21.15.193:0/911744299 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe100013630 con 0x55c9dd9a6350 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9dda95850 con 0x55c9dd9a6350 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 -- 172.21.15.193:0/911744299 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1000137d0 con 0x55c9dd9a6350 2024-09-12T17:11:23.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 -- 172.21.15.193:0/911744299 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe100013ab0 con 0x55c9dd9a6350 2024-09-12T17:11:23.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9dda96110 con 0x55c9dd9a6350 2024-09-12T17:11:23.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 -- 172.21.15.193:0/911744299 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe100010070 con 0x55c9dd9a6350 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 0x7fdff403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fdffbe07640 1 -- 172.21.15.193:0/911744299 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe100018070 con 0x55c9dd9a6350 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 0x7fdff403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 0x55c9dda9c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9dda9ca00 con 0x55c9dda9a0d0 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10fa80640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 0x55c9dda9c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 0x7fdff403bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ae000 tx=0x7fe0f80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10fa80640 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 0x55c9dda9c4c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10fa80640 1 -- 172.21.15.193:0/911744299 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe1080083f0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9dda96540 con 0x55c9dda9a0d0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10fa80640 1 -- 172.21.15.193:0/911744299 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe1080083f0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9dda9e790 con 0x55c9dda9a0d0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe10fa80640 1 -- 172.21.15.193:0/911744299 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe1080083f0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.051+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9dda9d9c0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10fa80640 1 -- 172.21.15.193:0/911744299 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe1080083f0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9dda9de10 con 0x55c9dda9a0d0 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10fa80640 1 -- 172.21.15.193:0/911744299 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe1080083f0 con 0x55c9dda9a0d0 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9dd8b5450 con 0x55c9ddaacaa0 2024-09-12T17:11:23.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50270/0 (socket says 172.21.15.193:50270) 2024-09-12T17:11:23.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10ea7e640 1 -- 172.21.15.193:0/2731057567 learned_addr learned my addr 172.21.15.193:0/2731057567 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10ea7e640 1 -- 172.21.15.193:0/2731057567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ddaad500 con 0x55c9ddaacaa0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8018f40 tx=0x7fe0f80180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fdff9602640 1 -- 172.21.15.193:0/2731057567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80c5070 con 0x55c9ddaacaa0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fdff9602640 1 -- 172.21.15.193:0/2731057567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80b59a0 con 0x55c9ddaacaa0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ddaadd60 con 0x55c9ddaacaa0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fdff9602640 1 -- 172.21.15.193:0/2731057567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80b5c80 con 0x55c9ddaacaa0 2024-09-12T17:11:23.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.055+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ddaae270 con 0x55c9ddaacaa0 2024-09-12T17:11:23.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff9602640 1 -- 172.21.15.193:0/2731057567 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe0f80c1410 con 0x55c9ddaacaa0 2024-09-12T17:11:23.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff9602640 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 0x7fdfe803bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff9602640 1 -- 172.21.15.193:0/2731057567 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe0f80edbd0 con 0x55c9ddaacaa0 2024-09-12T17:11:23.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10fa80640 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 0x7fdfe803bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10fa80640 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 0x7fdfe803bfd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe10800e3f0 tx=0x7fe108003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9dda8df20 con 0x55c9ddaba290 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50286/0 (socket says 172.21.15.193:50286) 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10ea7e640 1 -- 172.21.15.193:0/1147958862 learned_addr learned my addr 172.21.15.193:0/1147958862 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10ea7e640 1 -- 172.21.15.193:0/1147958862 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ddabac80 con 0x55c9ddaba290 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/1147958862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b5430 tx=0x7fe0f80c0ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a144d466d6988bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff2ffd640 1 -- 172.21.15.193:0/1147958862 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80b2aa0 con 0x55c9ddaba290 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff2ffd640 1 -- 172.21.15.193:0/1147958862 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80b2c40 con 0x55c9ddaba290 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fdff2ffd640 1 -- 172.21.15.193:0/1147958862 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80d4c80 con 0x55c9ddaba290 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 -- 172.21.15.193:0/1147958862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 msgr2=0x55c9ddaba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 --2- 172.21.15.193:0/1147958862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b5430 tx=0x7fe0f80c0ca0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 -- 172.21.15.193:0/1147958862 shutdown_connections 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.059+0000 7fe1117799c0 1 --2- 172.21.15.193:0/1147958862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddaba690 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- 172.21.15.193:0/1147958862 >> 172.21.15.193:0/1147958862 conn(0x55c9ddab56b0 msgr2=0x55c9ddab38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- 172.21.15.193:0/1147958862 shutdown_connections 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- 172.21.15.193:0/1147958862 wait complete. 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 Processor -- start 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- start start 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddac07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9ddab91e0 con 0x55c9ddaba290 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddac07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe10ea7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddac07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50294/0 (socket says 172.21.15.193:50294) 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 learned_addr learned my addr 172.21.15.193:0/594730666 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9ddac0d30 con 0x55c9ddaba290 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddac07d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80eadf0 tx=0x7fe0f80ebeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fdff17fa640 1 -- 172.21.15.193:0/594730666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80ede60 con 0x55c9ddaba290 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9ddac0fc0 con 0x55c9ddaba290 2024-09-12T17:11:23.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fdff17fa640 1 -- 172.21.15.193:0/594730666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80f2070 con 0x55c9ddaba290 2024-09-12T17:11:23.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fdff17fa640 1 -- 172.21.15.193:0/594730666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80c1700 con 0x55c9ddaba290 2024-09-12T17:11:23.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9ddac1970 con 0x55c9ddaba290 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.063+0000 7fdff17fa640 1 -- 172.21.15.193:0/594730666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe0f80c18a0 con 0x55c9ddaba290 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fdff17fa640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd8039a70 0x7fdfd803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fdff17fa640 1 -- 172.21.15.193:0/594730666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe0f80e3070 con 0x55c9ddaba290 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10fa80640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd8039a70 0x7fdfd803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9ddacbad0 0x55c9ddacdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddace6b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9ddacbad0 0x55c9ddacdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10fa80640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd8039a70 0x7fdfd803bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10800f010 tx=0x7fe10801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9ddacbad0 0x55c9ddacdf60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 realm 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddaceac0 con 0x55c9ddacbad0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacf390 con 0x55c9ddacbad0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacf730 con 0x55c9ddacbad0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 20 searching for the correct realm 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c9ddad1cf0 0x55c9ddad40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad4620 con 0x55c9ddad1cf0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c9ddad1cf0 0x55c9ddad40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c9ddad1cf0 0x55c9ddad40e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10ea7e640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f8009040 0x7fe0f80d5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad4620 con 0x7fe0f8009040 2024-09-12T17:11:23.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.067+0000 7fe10fa80640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f8009040 0x7fe0f80d5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10fa80640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f8009040 0x7fe0f80d5a80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10fa80640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe108019040 0x7fe108019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad4620 con 0x7fe108019040 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe108019040 0x7fe108019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe108019040 0x7fe108019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.071+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe0f8009040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe0f8009040 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.075+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe0f8009040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.079+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe0f8009040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddad1cf0 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe108019040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x55c9ddacbad0 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddacff80 con 0x7fe0f8009040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad07d0 con 0x55c9ddacbad0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad0bc0 con 0x55c9ddacbad0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad0bc0 con 0x55c9ddacbad0 2024-09-12T17:11:23.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 zone default found 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 4 Realm: () 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 zonegroup default 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad1090 con 0x7fe108019040 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad6440 con 0x55c9ddad1cf0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.083+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad67e0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 20 started sync module instance, tier type = 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad58e0 con 0x7fe0f8009040 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94325495911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad6b80 con 0x7fe0f8009040 2024-09-12T17:11:23.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7410 con 0x55c9ddacbad0 2024-09-12T17:11:23.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.087+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94325495911472] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94325495913728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7030 con 0x55c9ddacbad0 2024-09-12T17:11:23.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7e20 con 0x55c9ddad1cf0 2024-09-12T17:11:23.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94325495921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad86c0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9080 con 0x7fe0f8009040 2024-09-12T17:11:23.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94325495913728] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94325495925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad8ff0 con 0x7fe0f8009040 2024-09-12T17:11:23.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.091+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9e30 con 0x55c9ddacbad0 2024-09-12T17:11:23.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94325495921008] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94325495925712] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94325495929120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9df0 con 0x55c9ddacbad0 2024-09-12T17:11:23.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9470 con 0x7fe108019040 2024-09-12T17:11:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94325495930352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddada840 con 0x7fe108019040 2024-09-12T17:11:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.095+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddadb0d0 con 0x7fe108019040 2024-09-12T17:11:23.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94325495929120] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94325495930352] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94325495931792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddadac60 con 0x7fe108019040 2024-09-12T17:11:23.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddadb510 con 0x7fe108019040 2024-09-12T17:11:23.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94325495934560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddadb980 con 0x7fe108019040 2024-09-12T17:11:23.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=0 2024-09-12T17:11:23.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=1 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=2 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=3 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=4 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.099+0000 7fe1117799c0 20 add_watcher() i=5 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94325495931792] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 20 add_watcher() i=6 2024-09-12T17:11:23.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94325495934560] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 20 add_watcher() i=7 2024-09-12T17:11:23.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:23.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddada7b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94325495932848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddadbea0 con 0x55c9ddacbad0 2024-09-12T17:11:23.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94325495932848] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fdfc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:23.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:23.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.103+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae72d0 con 0x55c9ddacbad0 2024-09-12T17:11:23.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.107+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.107+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae7890 con 0x7fe108019040 2024-09-12T17:11:23.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae7890 con 0x55c9ddad1cf0 2024-09-12T17:11:23.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae7c30 con 0x55c9ddacbad0 2024-09-12T17:11:23.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.111+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae7c30 con 0x7fe0f8009040 2024-09-12T17:11:23.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae81e0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae8580 con 0x55c9ddacbad0 2024-09-12T17:11:23.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.115+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae8580 con 0x7fe108019040 2024-09-12T17:11:23.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.119+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.119+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae8580 con 0x7fe0f8009040 2024-09-12T17:11:23.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae8b30 con 0x55c9ddad1cf0 2024-09-12T17:11:23.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae8f60 con 0x7fe0f8009040 2024-09-12T17:11:23.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.123+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae94d0 con 0x7fe108019040 2024-09-12T17:11:23.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.131+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.131+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae94d0 con 0x7fe0f8009040 2024-09-12T17:11:23.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.131+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.131+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x7fe108019040 2024-09-12T17:11:23.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.135+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.135+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.135+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.135+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.139+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.139+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x7fe0f8009040 2024-09-12T17:11:23.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.143+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.143+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.143+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.143+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.147+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.147+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.147+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.147+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.151+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.151+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x7fe0f8009040 2024-09-12T17:11:23.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.151+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.151+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae97b0 con 0x55c9ddad1cf0 2024-09-12T17:11:23.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.155+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x55c9ddad1cf0 2024-09-12T17:11:23.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.159+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.159+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x7fe108019040 2024-09-12T17:11:23.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.159+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.159+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x55c9ddad1cf0 2024-09-12T17:11:23.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.163+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.163+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x7fe108019040 2024-09-12T17:11:23.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.163+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.163+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x55c9ddad1cf0 2024-09-12T17:11:23.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.167+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.167+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae9980 con 0x7fe108019040 2024-09-12T17:11:23.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddae6940 con 0x7fe0f8009040 2024-09-12T17:11:23.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fdfc57e2640 20 reqs_thread_entry: start 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 20 Filter name: none 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fdfbe7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.171+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddb047e0 con 0x7fe108019040 2024-09-12T17:11:23.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:11:23.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:23.178 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:11:23.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fdfc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94325495932848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddb044b0 con 0x55c9ddacbad0 2024-09-12T17:11:23.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94325495932848] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94325495911472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddada7b0 con 0x7fe0f8009040 2024-09-12T17:11:23.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94325495911472] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 20 remove_watcher() i=0 2024-09-12T17:11:23.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 2 removed watcher, disabling cache 2024-09-12T17:11:23.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.175+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94325495913728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad5430 con 0x55c9ddacbad0 2024-09-12T17:11:23.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.179+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94325495913728] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.179+0000 7fe1117799c0 20 remove_watcher() i=1 2024-09-12T17:11:23.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.179+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94325495921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad5430 con 0x55c9ddad1cf0 2024-09-12T17:11:23.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe10ea7e640 1 -- 172.21.15.193:0/594730666 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94325495921008] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80a8070 con 0x55c9ddad1cf0 2024-09-12T17:11:23.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe1117799c0 20 remove_watcher() i=2 2024-09-12T17:11:23.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94325495925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7970 con 0x7fe0f8009040 2024-09-12T17:11:23.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe10fa80640 1 -- 172.21.15.193:0/594730666 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94325495925712] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10802f040 con 0x7fe0f8009040 2024-09-12T17:11:23.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe1117799c0 20 remove_watcher() i=3 2024-09-12T17:11:23.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.183+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94325495929120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7970 con 0x55c9ddacbad0 2024-09-12T17:11:23.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94325495929120] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x55c9ddacbad0 2024-09-12T17:11:23.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe1117799c0 20 remove_watcher() i=4 2024-09-12T17:11:23.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94325495930352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9920 con 0x7fe108019040 2024-09-12T17:11:23.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94325495930352] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe1117799c0 20 remove_watcher() i=5 2024-09-12T17:11:23.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.187+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94325495931792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad7970 con 0x7fe108019040 2024-09-12T17:11:23.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.191+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94325495931792] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.191+0000 7fe1117799c0 20 remove_watcher() i=6 2024-09-12T17:11:23.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.191+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94325495934560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9ddad9920 con 0x7fe108019040 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.191+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94325495934560] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe10001b030 con 0x7fe108019040 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 20 remove_watcher() i=7 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe108019040 msgr2=0x7fe108019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe108019040 0x7fe108019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9ddacbad0 msgr2=0x55c9ddacdf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9ddacbad0 0x55c9ddacdf60 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f8009040 msgr2=0x7fe0f80d5a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f8009040 0x7fe0f80d5a80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c9ddad1cf0 msgr2=0x55c9ddad40e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c9ddad1cf0 0x55c9ddad40e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd8039a70 msgr2=0x7fdfd803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd8039a70 0x7fdfd803bf30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10800f010 tx=0x7fe10801b070 comp rx=0 tx=0).stop 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 msgr2=0x55c9ddac07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/594730666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaba290 0x55c9ddac07d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80eadf0 tx=0x7fe0f80ebeb0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 reap_dead start 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe10f27f640 1 -- 172.21.15.193:0/594730666 reap_dead start 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 shutdown_connections 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 >> 172.21.15.193:0/594730666 conn(0x55c9ddab56b0 msgr2=0x55c9ddab38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 shutdown_connections 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/594730666 wait complete. 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 msgr2=0x7fdfe803bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 0x7fdfe803bfd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe10800e3f0 tx=0x7fe108003070 comp rx=0 tx=0).stop 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 msgr2=0x55c9ddaacec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8018f40 tx=0x7fe0f80180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 shutdown_connections 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe8039b10 0x7fdfe803bfd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/2731057567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9ddaacaa0 0x55c9ddaacec0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 >> 172.21.15.193:0/2731057567 conn(0x55c9ddaa2450 msgr2=0x55c9ddaa2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 shutdown_connections 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/2731057567 wait complete. 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 msgr2=0x55c9dda9c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 0x55c9dda9c4c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 msgr2=0x7fdff403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 0x7fdff403bf30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ae000 tx=0x7fe0f80a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 msgr2=0x55c9dda95060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe100001ba0 tx=0x7fe100004470 comp rx=0 tx=0).stop 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 shutdown_connections 2024-09-12T17:11:23.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9dda9a0d0 0x55c9dda9c4c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff4039a70 0x7fdff403bf30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 --2- 172.21.15.193:0/911744299 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9dd9a6350 0x55c9dda95060 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 >> 172.21.15.193:0/911744299 conn(0x55c9dd915b10 msgr2=0x55c9dda87da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 shutdown_connections 2024-09-12T17:11:23.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.195+0000 7fe1117799c0 1 -- 172.21.15.193:0/911744299 wait complete. 2024-09-12T17:11:23.211 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:11:23.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:23.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:23.211 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:11:23.291 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:23.291 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:23.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb8a058b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55662453be00 0x55662453c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb8a058b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566243f19c0 con 0x55662453efe0 2024-09-12T17:11:23.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb8a058b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5566244416d0 con 0x55662453be00 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89e091640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55662453be00 0x55662453c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89e091640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55662453be00 0x55662453c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50308/0 (socket says 172.21.15.193:50308) 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89e091640 1 -- 172.21.15.193:0/116345667 learned_addr learned my addr 172.21.15.193:0/116345667 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89d890640 1 --1- 172.21.15.193:0/116345667 >> v1:172.21.15.62:6789/0 conn(0x55662453efe0 0x5566245413d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35920/0 (socket says 172.21.15.193:35920) 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89e091640 1 -- 172.21.15.193:0/116345667 >> v1:172.21.15.62:6789/0 conn(0x55662453efe0 legacy=0x5566245413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.287+0000 7fb89e091640 1 -- 172.21.15.193:0/116345667 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566243e5ca0 con 0x55662453be00 2024-09-12T17:11:23.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb89e091640 1 --2- 172.21.15.193:0/116345667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662453c1e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb89001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52864caf141112d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb89d08f640 1 -- 172.21.15.193:0/116345667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900a6070 con 0x55662453be00 2024-09-12T17:11:23.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb89d08f640 1 -- 172.21.15.193:0/116345667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900af070 con 0x55662453be00 2024-09-12T17:11:23.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb89d08f640 1 -- 172.21.15.193:0/116345667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aa5c0 con 0x55662453be00 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/116345667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 msgr2=0x55662453c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/116345667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662453c1e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb89000a5c0 tx=0x7fb89001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/116345667 shutdown_connections 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/116345667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662453c1e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/116345667 >> 172.21.15.193:0/116345667 conn(0x556624537920 msgr2=0x556624539d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/116345667 shutdown_connections 2024-09-12T17:11:23.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.291+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/116345667 wait complete. 2024-09-12T17:11:23.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.307+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.307+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.307+0000 7fb8a058b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.307+0000 7fb8a058b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556624445680 con 0x55662453be00 2024-09-12T17:11:23.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.307+0000 7fb89e091640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50316/0 (socket says 172.21.15.193:50316) 2024-09-12T17:11:23.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 -- 172.21.15.193:0/3578764526 learned_addr learned my addr 172.21.15.193:0/3578764526 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 -- 172.21.15.193:0/3578764526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566243c0da0 con 0x55662453be00 2024-09-12T17:11:23.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 --2- 172.21.15.193:0/3578764526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8900ac040 tx=0x7fb890003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107270675099c6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb78c608640 1 -- 172.21.15.193:0/3578764526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aa970 con 0x55662453be00 2024-09-12T17:11:23.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb78c608640 1 -- 172.21.15.193:0/3578764526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900aab10 con 0x55662453be00 2024-09-12T17:11:23.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb78c608640 1 -- 172.21.15.193:0/3578764526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900aae30 con 0x55662453be00 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3578764526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 msgr2=0x5566246286b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3578764526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb8900ac040 tx=0x7fb890003030 comp rx=0 tx=0).stop 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3578764526 shutdown_connections 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3578764526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x5566246286b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3578764526 >> 172.21.15.193:0/3578764526 conn(0x556624537920 msgr2=0x5566244b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3578764526 shutdown_connections 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3578764526 wait complete. 2024-09-12T17:11:23.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb8a058b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5566243e7a50 con 0x55662453be00 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50328/0 (socket says 172.21.15.193:50328) 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 -- 172.21.15.193:0/3138696397 learned_addr learned my addr 172.21.15.193:0/3138696397 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556624630170 con 0x55662453be00 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.311+0000 7fb89e091640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb89001b170 tx=0x7fb8900180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 -- 172.21.15.193:0/3138696397 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900c6690 con 0x55662453be00 2024-09-12T17:11:23.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556624630400 con 0x55662453be00 2024-09-12T17:11:23.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 -- 172.21.15.193:0/3138696397 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8900cc070 con 0x55662453be00 2024-09-12T17:11:23.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 -- 172.21.15.193:0/3138696397 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8900c6960 con 0x55662453be00 2024-09-12T17:11:23.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556624630d60 con 0x55662453be00 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 -- 172.21.15.193:0/3138696397 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8900c6c10 con 0x55662453be00 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 0x7fb78403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb78ae05640 1 -- 172.21.15.193:0/3138696397 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb8900ebe20 con 0x55662453be00 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89d890640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 0x7fb78403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 0x556624636d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624637270 con 0x55662453efe0 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89e892640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 0x556624636d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89d890640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 0x7fb78403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb894001e90 tx=0x7fb8940013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89e892640 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 0x556624636d30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89e892640 1 -- 172.21.15.193:0/3138696397 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb89800a4d0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566246376c0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89e892640 1 -- 172.21.15.193:0/3138696397 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb89800a4d0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624638fc0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb89e892640 1 -- 172.21.15.193:0/3138696397 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb89800a4d0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.315+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566246381f0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89e892640 1 -- 172.21.15.193:0/3138696397 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb89800a4d0 con 0x55662453efe0 2024-09-12T17:11:23.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624638610 con 0x55662453efe0 2024-09-12T17:11:23.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89e892640 1 -- 172.21.15.193:0/3138696397 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb89800a4d0 con 0x55662453efe0 2024-09-12T17:11:23.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556624452450 con 0x556624647320 2024-09-12T17:11:23.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50334/0 (socket says 172.21.15.193:50334) 2024-09-12T17:11:23.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89d890640 1 -- 172.21.15.193:0/34180169 learned_addr learned my addr 172.21.15.193:0/34180169 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89d890640 1 -- 172.21.15.193:0/34180169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556624647d80 con 0x556624647320 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb89d890640 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb89400e670 tx=0x7fb89400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb783fff640 1 -- 172.21.15.193:0/34180169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb894022070 con 0x556624647320 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566246485e0 con 0x556624647320 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb783fff640 1 -- 172.21.15.193:0/34180169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89400d660 con 0x556624647320 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb783fff640 1 -- 172.21.15.193:0/34180169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb894006070 con 0x556624647320 2024-09-12T17:11:23.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.319+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556624648b50 con 0x556624647320 2024-09-12T17:11:23.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb783fff640 1 -- 172.21.15.193:0/34180169 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb894025070 con 0x556624647320 2024-09-12T17:11:23.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb783fff640 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 0x7fb77803bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb783fff640 1 -- 172.21.15.193:0/34180169 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb894051cb0 con 0x556624647320 2024-09-12T17:11:23.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89e892640 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 0x7fb77803bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89e892640 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 0x7fb77803bf70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x556624638590 tx=0x7fb898005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556624628e40 con 0x556624654c90 2024-09-12T17:11:23.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50344/0 (socket says 172.21.15.193:50344) 2024-09-12T17:11:23.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89d890640 1 -- 172.21.15.193:0/3885823968 learned_addr learned my addr 172.21.15.193:0/3885823968 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89d890640 1 -- 172.21.15.193:0/3885823968 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556624655680 con 0x556624654c90 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb89d890640 1 --2- 172.21.15.193:0/3885823968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb894050030 tx=0x7fb89400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0ceef86408998f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb781ffb640 1 -- 172.21.15.193:0/3885823968 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89404e030 con 0x556624654c90 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb781ffb640 1 -- 172.21.15.193:0/3885823968 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89401a320 con 0x556624654c90 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb781ffb640 1 -- 172.21.15.193:0/3885823968 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8940268d0 con 0x556624654c90 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3885823968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 msgr2=0x556624655090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3885823968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb894050030 tx=0x7fb89400df30 comp rx=0 tx=0).stop 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3885823968 shutdown_connections 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3885823968 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x556624655090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3885823968 >> 172.21.15.193:0/3885823968 conn(0x5566246500b0 msgr2=0x55662464e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3885823968 shutdown_connections 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.323+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3885823968 wait complete. 2024-09-12T17:11:23.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 Processor -- start 2024-09-12T17:11:23.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 -- start start 2024-09-12T17:11:23.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556624653be0 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89d890640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50348/0 (socket says 172.21.15.193:50348) 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 learned_addr learned my addr 172.21.15.193:0/3523835646 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662465b760 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89d890640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb89400df70 tx=0x7fb89404ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 -- 172.21.15.193:0/3523835646 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb894036070 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55662465b760 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 -- 172.21.15.193:0/3523835646 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb89401a540 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662465b760 con 0x556624654c90 2024-09-12T17:11:23.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 -- 172.21.15.193:0/3523835646 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb89401a6f0 con 0x556624654c90 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 -- 172.21.15.193:0/3523835646 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb89401a890 con 0x556624654c90 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb768039a70 0x7fb76803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb76ffff640 1 -- 172.21.15.193:0/3523835646 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb89401f080 con 0x556624654c90 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb89e892640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb768039a70 0x7fb76803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556624666200 0x556624668690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.327+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624668de0 con 0x556624666200 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556624666200 0x556624668690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb768039a70 0x7fb76803bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556624637d10 tx=0x7fb89801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556624666200 0x556624668690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 realm 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566246691f0 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624669ac0 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624669e60 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55662466a6b0 con 0x556624666200 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 20 searching for the correct realm 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55662466c420 0x55662466e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x55662466c420 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89d890640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55662466c420 0x55662466e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89d890640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55662466c420 0x55662466e810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb894024030 con 0x55662466c420 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89d890640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb894027060 0x7fb89403aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb894027060 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb894027060 0x7fb89403aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb894027060 0x7fb89403aa40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb898031040 0x7fb898032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb898031040 2024-09-12T17:11:23.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.331+0000 7fb89e091640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb898031040 0x7fb898032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb898031040 0x7fb898032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x556624666200 2024-09-12T17:11:23.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x556624666200 2024-09-12T17:11:23.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb894027060 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x55662466c420 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x556624666200 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.335+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x556624666200 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb894027060 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb898031040 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x556624666200 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x556624666200 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.339+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb898031040 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb894027060 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x556624666200 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb898031040 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb898031040 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb894027060 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x55662466c420 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.343+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb898031040 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x556624666200 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb8900f1040 con 0x7fb894027060 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb89801f070 con 0x7fb894027060 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:23.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55662466b0f0 con 0x556624666200 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55662466b990 con 0x556624666200 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55662466b990 con 0x556624666200 2024-09-12T17:11:23.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 zone default found 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 4 Realm: () 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 zonegroup default 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55662466ed50 con 0x7fb898031040 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5566246708d0 con 0x55662466c420 2024-09-12T17:11:23.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624670d80 con 0x55662466c420 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 started sync module instance, tier type = 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:23.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.347+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55662466fbe0 con 0x7fb894027060 2024-09-12T17:11:23.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93897185755088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566246703f0 con 0x7fb894027060 2024-09-12T17:11:23.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624671cb0 con 0x556624666200 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93897185755088] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93897185761280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566246720d0 con 0x556624666200 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.351+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624672a90 con 0x55662466c420 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93897185764832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566246732e0 con 0x55662466c420 2024-09-12T17:11:23.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624673ca0 con 0x7fb894027060 2024-09-12T17:11:23.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93897185769728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566246743f0 con 0x7fb894027060 2024-09-12T17:11:23.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624674f10 con 0x556624666200 2024-09-12T17:11:23.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93897185761280] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.355+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93897185769728] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.359+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93897185764832] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.359+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.359+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93897185762336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624674ed0 con 0x556624666200 2024-09-12T17:11:23.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.359+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624673e40 con 0x7fb898031040 2024-09-12T17:11:23.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.363+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93897185762336] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.363+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.363+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93897185774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624673e40 con 0x7fb898031040 2024-09-12T17:11:23.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.363+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624675760 con 0x7fb898031040 2024-09-12T17:11:23.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.363+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93897185774048] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93897185766960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624675760 con 0x7fb898031040 2024-09-12T17:11:23.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624676120 con 0x7fb898031040 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93897185778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624676540 con 0x7fb898031040 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=0 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=1 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=2 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=3 2024-09-12T17:11:23.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=4 2024-09-12T17:11:23.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=5 2024-09-12T17:11:23.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93897185766960] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.367+0000 7fb8a058b9c0 20 add_watcher() i=6 2024-09-12T17:11:23.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93897185778800] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 20 add_watcher() i=7 2024-09-12T17:11:23.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:23.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624676540 con 0x556624666200 2024-09-12T17:11:23.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93897185779856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5566246764b0 con 0x556624666200 2024-09-12T17:11:23.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93897185779856] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb754fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:23.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:23.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.371+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681da0 con 0x556624666200 2024-09-12T17:11:23.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.375+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.375+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682360 con 0x7fb898031040 2024-09-12T17:11:23.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.375+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.375+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682360 con 0x55662466c420 2024-09-12T17:11:23.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682700 con 0x556624666200 2024-09-12T17:11:23.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682700 con 0x7fb894027060 2024-09-12T17:11:23.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.379+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682c70 con 0x55662466c420 2024-09-12T17:11:23.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.383+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.383+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682c70 con 0x556624666200 2024-09-12T17:11:23.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.383+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.383+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682d00 con 0x7fb898031040 2024-09-12T17:11:23.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.387+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.387+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624682d00 con 0x7fb894027060 2024-09-12T17:11:23.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.387+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.387+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683330 con 0x55662466c420 2024-09-12T17:11:23.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.391+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.391+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683310 con 0x7fb894027060 2024-09-12T17:11:23.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.391+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.391+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683960 con 0x7fb898031040 2024-09-12T17:11:23.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683910 con 0x7fb894027060 2024-09-12T17:11:23.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683da0 con 0x7fb898031040 2024-09-12T17:11:23.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.395+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683cf0 con 0x556624666200 2024-09-12T17:11:23.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.399+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.399+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683cd0 con 0x55662466c420 2024-09-12T17:11:23.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.399+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.399+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683a80 con 0x7fb894027060 2024-09-12T17:11:23.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.403+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.403+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bb0 con 0x55662466c420 2024-09-12T17:11:23.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.403+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.403+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bb0 con 0x556624666200 2024-09-12T17:11:23.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.407+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.407+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bb0 con 0x556624666200 2024-09-12T17:11:23.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.407+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.407+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bb0 con 0x55662466c420 2024-09-12T17:11:23.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.411+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.411+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bb0 con 0x7fb894027060 2024-09-12T17:11:23.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.411+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.411+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683bf0 con 0x55662466c420 2024-09-12T17:11:23.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c50 con 0x55662466c420 2024-09-12T17:11:23.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c50 con 0x55662466c420 2024-09-12T17:11:23.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.415+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c50 con 0x55662466c420 2024-09-12T17:11:23.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.419+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.419+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c50 con 0x7fb898031040 2024-09-12T17:11:23.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.419+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.419+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c80 con 0x55662466c420 2024-09-12T17:11:23.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.423+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.423+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c80 con 0x7fb898031040 2024-09-12T17:11:23.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.427+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.427+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683c80 con 0x55662466c420 2024-09-12T17:11:23.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.427+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.427+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683ca0 con 0x7fb898031040 2024-09-12T17:11:23.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.431+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.431+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624683d10 con 0x7fb894027060 2024-09-12T17:11:23.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb6cf7fe640 20 reqs_thread_entry: start 2024-09-12T17:11:23.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:23.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 20 Filter name: none 2024-09-12T17:11:23.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb6cd7fa640 20 reqs_thread_entry: start 2024-09-12T17:11:23.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:23.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556624681a40 con 0x556624666200 2024-09-12T17:11:23.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T17:11:23.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:23.440 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, user does not exist 2024-09-12T17:11:23.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb754fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.435+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93897185779856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a40 con 0x556624666200 2024-09-12T17:11:23.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93897185779856] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93897185755088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a40 con 0x7fb894027060 2024-09-12T17:11:23.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93897185755088] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb8a058b9c0 20 remove_watcher() i=0 2024-09-12T17:11:23.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb8a058b9c0 2 removed watcher, disabling cache 2024-09-12T17:11:23.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93897185761280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x556624666200 2024-09-12T17:11:23.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.439+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93897185761280] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 20 remove_watcher() i=1 2024-09-12T17:11:23.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93897185764832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x55662466c420 2024-09-12T17:11:23.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb89d890640 1 -- 172.21.15.193:0/3523835646 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93897185764832] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb89405c040 con 0x55662466c420 2024-09-12T17:11:23.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 20 remove_watcher() i=2 2024-09-12T17:11:23.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93897185769728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x7fb894027060 2024-09-12T17:11:23.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb89e892640 1 -- 172.21.15.193:0/3523835646 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93897185769728] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb898040040 con 0x7fb894027060 2024-09-12T17:11:23.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 20 remove_watcher() i=3 2024-09-12T17:11:23.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.443+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93897185762336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x556624666200 2024-09-12T17:11:23.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93897185762336] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x556624666200 2024-09-12T17:11:23.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb8a058b9c0 20 remove_watcher() i=4 2024-09-12T17:11:23.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93897185774048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x7fb898031040 2024-09-12T17:11:23.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93897185774048] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb8a058b9c0 20 remove_watcher() i=5 2024-09-12T17:11:23.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.447+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93897185766960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x7fb898031040 2024-09-12T17:11:23.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.451+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93897185766960] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.451+0000 7fb8a058b9c0 20 remove_watcher() i=6 2024-09-12T17:11:23.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.451+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93897185778800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556624681a00 con 0x7fb898031040 2024-09-12T17:11:23.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93897185778800] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8900b3cd0 con 0x7fb898031040 2024-09-12T17:11:23.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 20 remove_watcher() i=7 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb898031040 msgr2=0x7fb898032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb898031040 0x7fb898032940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556624666200 msgr2=0x556624668690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556624666200 0x556624668690 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb894027060 msgr2=0x7fb89403aa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb894027060 0x7fb89403aa40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55662466c420 msgr2=0x55662466e810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55662466c420 0x55662466e810 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb768039a70 msgr2=0x7fb76803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb768039a70 0x7fb76803bf30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556624637d10 tx=0x7fb89801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb89e091640 1 -- 172.21.15.193:0/3523835646 reap_dead start 2024-09-12T17:11:23.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 msgr2=0x55662465b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb89400df70 tx=0x7fb89404ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 shutdown_connections 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3523835646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624654c90 0x55662465b200 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb89400df70 tx=0x7fb89404ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 >> 172.21.15.193:0/3523835646 conn(0x5566246500b0 msgr2=0x55662464e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 shutdown_connections 2024-09-12T17:11:23.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3523835646 wait complete. 2024-09-12T17:11:23.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 msgr2=0x7fb77803bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 0x7fb77803bf70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x556624638590 tx=0x7fb898005850 comp rx=0 tx=0).stop 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 msgr2=0x556624647740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb89400e670 tx=0x7fb89400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 shutdown_connections 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb778039ab0 0x7fb77803bf70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/34180169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556624647320 0x556624647740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 >> 172.21.15.193:0/34180169 conn(0x55662463ccd0 msgr2=0x55662463d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 shutdown_connections 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/34180169 wait complete. 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 msgr2=0x556624636d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 0x556624636d30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 msgr2=0x7fb78403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 0x7fb78403bf30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb894001e90 tx=0x7fb8940013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 msgr2=0x55662462fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb89001b170 tx=0x7fb8900180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 shutdown_connections 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55662453efe0 0x556624636d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb784039a70 0x7fb78403bf30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 --2- 172.21.15.193:0/3138696397 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55662453be00 0x55662462fc10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 >> 172.21.15.193:0/3138696397 conn(0x556624537920 msgr2=0x556624621c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 shutdown_connections 2024-09-12T17:11:23.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.455+0000 7fb8a058b9c0 1 -- 172.21.15.193:0/3138696397 wait complete. 2024-09-12T17:11:23.474 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-12T17:11:23.475 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:11:23.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:11:23.475 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T17:11:23.558 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:23.558 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:23.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075e6ef9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560ed5bbe6b0 0x560ed5c527c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075e6ef9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ed5afe9c0 con 0x560ed5bbe2d0 2024-09-12T17:11:23.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075e6ef9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560ed5b4e6d0 con 0x560ed5bbe6b0 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075b9f4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560ed5bbe6b0 0x560ed5c527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075b9f4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560ed5bbe6b0 0x560ed5c527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50358/0 (socket says 172.21.15.193:50358) 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075b9f4640 1 -- 172.21.15.193:0/335246765 learned_addr learned my addr 172.21.15.193:0/335246765 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075c1f5640 1 --1- 172.21.15.193:0/335246765 >> v1:172.21.15.62:6789/0 conn(0x560ed5bbe2d0 0x560ed5c4f090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35926/0 (socket says 172.21.15.193:35926) 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075b9f4640 1 -- 172.21.15.193:0/335246765 >> v1:172.21.15.62:6789/0 conn(0x560ed5bbe2d0 legacy=0x560ed5c4f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.555+0000 7f075b9f4640 1 -- 172.21.15.193:0/335246765 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5af2ca0 con 0x560ed5bbe6b0 2024-09-12T17:11:23.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075b9f4640 1 --2- 172.21.15.193:0/335246765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe6b0 0x560ed5c527c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f075000a5c0 tx=0x7f075001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a26d5b1eebf4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075b1f3640 1 -- 172.21.15.193:0/335246765 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07500a6070 con 0x560ed5bbe6b0 2024-09-12T17:11:23.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075b1f3640 1 -- 172.21.15.193:0/335246765 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07500af070 con 0x560ed5bbe6b0 2024-09-12T17:11:23.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075b1f3640 1 -- 172.21.15.193:0/335246765 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07500aa5c0 con 0x560ed5bbe6b0 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/335246765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe6b0 msgr2=0x560ed5c527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/335246765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe6b0 0x560ed5c527c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f075000a5c0 tx=0x7f075001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/335246765 shutdown_connections 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/335246765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe6b0 0x560ed5c527c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/335246765 >> 172.21.15.193:0/335246765 conn(0x560ed5c44980 msgr2=0x560ed5c46da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/335246765 shutdown_connections 2024-09-12T17:11:23.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.559+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/335246765 wait complete. 2024-09-12T17:11:23.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075e6ef9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075e6ef9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ed5b52680 con 0x560ed5bbe2d0 2024-09-12T17:11:23.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50364/0 (socket says 172.21.15.193:50364) 2024-09-12T17:11:23.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075c1f5640 1 -- 172.21.15.193:0/272864145 learned_addr learned my addr 172.21.15.193:0/272864145 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075c1f5640 1 -- 172.21.15.193:0/272864145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5acdda0 con 0x560ed5bbe2d0 2024-09-12T17:11:23.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f075c1f5640 1 --2- 172.21.15.193:0/272864145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f074c00b270 tx=0x7f074c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e21ca47a048c861 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f064a60c640 1 -- 172.21.15.193:0/272864145 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c00e5d0 con 0x560ed5bbe2d0 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f064a60c640 1 -- 172.21.15.193:0/272864145 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c00e770 con 0x560ed5bbe2d0 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.575+0000 7f064a60c640 1 -- 172.21.15.193:0/272864145 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c00ea70 con 0x560ed5bbe2d0 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/272864145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 msgr2=0x560ed5d379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/272864145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f074c00b270 tx=0x7f074c00b670 comp rx=0 tx=0).stop 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/272864145 shutdown_connections 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/272864145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d379e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/272864145 >> 172.21.15.193:0/272864145 conn(0x560ed5c44980 msgr2=0x560ed5d33680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/272864145 shutdown_connections 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/272864145 wait complete. 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ed5af4a50 con 0x560ed5bbe2d0 2024-09-12T17:11:23.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50372/0 (socket says 172.21.15.193:50372) 2024-09-12T17:11:23.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075c1f5640 1 -- 172.21.15.193:0/3272507689 learned_addr learned my addr 172.21.15.193:0/3272507689 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075c1f5640 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5d3f600 con 0x560ed5bbe2d0 2024-09-12T17:11:23.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075c1f5640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x560ed5d389d0 tx=0x7f074c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f0648e09640 1 -- 172.21.15.193:0/3272507689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c00be70 con 0x560ed5bbe2d0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f0648e09640 1 -- 172.21.15.193:0/3272507689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c00f9f0 con 0x560ed5bbe2d0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f0648e09640 1 -- 172.21.15.193:0/3272507689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c00fcf0 con 0x560ed5bbe2d0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed5d3f890 con 0x560ed5bbe2d0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed5d40240 con 0x560ed5bbe2d0 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.579+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ed5b5f450 con 0x560ed5d4bcc0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50380/0 (socket says 172.21.15.193:50380) 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 -- 172.21.15.193:0/1000196165 learned_addr learned my addr 172.21.15.193:0/1000196165 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f0648e09640 1 -- 172.21.15.193:0/3272507689 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f074c017070 con 0x560ed5bbe2d0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f0648e09640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 0x7f064403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f0648e09640 1 -- 172.21.15.193:0/3272507689 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f074c015020 con 0x560ed5bbe2d0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 -- 172.21.15.193:0/1000196165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5d4c6b0 con 0x560ed5d4bcc0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c1f5640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 0x7f064403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 --2- 172.21.15.193:0/1000196165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f075400a430 tx=0x7f075400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1cb1cb7948e39d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c1f5640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 0x7f064403bf80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f074c00ffd0 tx=0x7f074c019ef0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f06427fc640 1 -- 172.21.15.193:0/1000196165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f075400f6e0 con 0x560ed5d4bcc0 2024-09-12T17:11:23.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f06427fc640 1 -- 172.21.15.193:0/1000196165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0754015070 con 0x560ed5d4bcc0 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f06427fc640 1 -- 172.21.15.193:0/1000196165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f075400fa10 con 0x560ed5d4bcc0 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/1000196165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 msgr2=0x560ed5d4c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/1000196165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f075400a430 tx=0x7f075400a8f0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/1000196165 shutdown_connections 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/1000196165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d4c0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/1000196165 >> 172.21.15.193:0/1000196165 conn(0x560ed5bbe6b0 msgr2=0x560ed5d47700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/1000196165 shutdown_connections 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/1000196165 wait complete. 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075e6ef9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ed5d4cea0 con 0x560ed5d4bcc0 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50386/0 (socket says 172.21.15.193:50386) 2024-09-12T17:11:23.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.583+0000 7f075c9f6640 1 -- 172.21.15.193:0/2531844109 learned_addr learned my addr 172.21.15.193:0/2531844109 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c9f6640 1 -- 172.21.15.193:0/2531844109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5d53680 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c9f6640 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f075400adf0 tx=0x7f0754003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 -- 172.21.15.193:0/2531844109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0754010a10 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 -- 172.21.15.193:0/2531844109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0754020070 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed5d53910 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 -- 172.21.15.193:0/2531844109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0754010d40 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed5d542c0 con 0x560ed5d4bcc0 2024-09-12T17:11:23.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 -- 172.21.15.193:0/2531844109 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f075401b420 con 0x560ed5d4bcc0 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 Processor -- start 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 -- start start 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f0640ff9640 1 -- 172.21.15.193:0/2531844109 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0754050c60 con 0x560ed5d4bcc0 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075e6ef9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560ed5d38210 con 0x560ed5d6c810 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c9f6640 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c1f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50394/0 (socket says 172.21.15.193:50394) 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c1f5640 1 -- 172.21.15.193:0/2517900105 learned_addr learned my addr 172.21.15.193:0/2517900105 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c9f6640 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 0x7f063403bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f075401c920 tx=0x7f075401c7b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.587+0000 7f075c1f5640 1 -- 172.21.15.193:0/2517900105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed5d6d200 con 0x560ed5d6c810 2024-09-12T17:11:23.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075c1f5640 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c10 tx=0x7f074c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 -- 172.21.15.193:0/2517900105 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c024d10 con 0x560ed5d6c810 2024-09-12T17:11:23.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 -- 172.21.15.193:0/2517900105 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c017df0 con 0x560ed5d6c810 2024-09-12T17:11:23.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ed5d6dad0 con 0x560ed5d6c810 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 -- 172.21.15.193:0/2517900105 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074c01dd00 con 0x560ed5d6c810 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed5d6dad0 con 0x560ed5d6c810 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 -- 172.21.15.193:0/2517900105 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f074c022230 con 0x560ed5d6c810 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 0x7f059803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f0620fe1640 1 -- 172.21.15.193:0/2517900105 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f074c038070 con 0x560ed5d6c810 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075b9f4640 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 0x7f059803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f05a27fc640 20 reqs_thread_entry: start 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 0x560ed5d744b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ed5d74b80 con 0x560ed5d72040 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075b9f4640 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 0x7f059803bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07500ae000 tx=0x7f07500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075c9f6640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 0x560ed5d744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075c9f6640 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 0x560ed5d744b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075c9f6640 1 -- 172.21.15.193:0/3272507689 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f075400e070 con 0x560ed5d72040 2024-09-12T17:11:23.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560ed5d76420 con 0x560ed5d72040 2024-09-12T17:11:23.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.591+0000 7f075c9f6640 1 -- 172.21.15.193:0/3272507689 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f075400e070 con 0x560ed5d72040 2024-09-12T17:11:23.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560ed5d7ae80 con 0x560ed5d72040 2024-09-12T17:11:23.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075c9f6640 1 -- 172.21.15.193:0/3272507689 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f075400e070 con 0x560ed5d72040 2024-09-12T17:11:23.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 msgr2=0x7f063403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 0x7f063403bf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f075401c920 tx=0x7f075401c7b0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 msgr2=0x560ed5d53120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f075400adf0 tx=0x7f0754003380 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 shutdown_connections 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0634039a70 0x7f063403bf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2531844109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d4bcc0 0x560ed5d53120 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 >> 172.21.15.193:0/2531844109 conn(0x560ed5bbe6b0 msgr2=0x560ed5d47250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 shutdown_connections 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2531844109 wait complete. 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 msgr2=0x7f059803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 0x7f059803bf30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07500ae000 tx=0x7f07500a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 msgr2=0x560ed5d6cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f074c000c10 tx=0x7f074c01beb0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 shutdown_connections 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0598039a70 0x7f059803bf30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/2517900105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5d6c810 0x560ed5d6cc30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 >> 172.21.15.193:0/2517900105 conn(0x560ed5d61e10 msgr2=0x560ed5d621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 shutdown_connections 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/2517900105 wait complete. 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 msgr2=0x560ed5d744b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 0x560ed5d744b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 msgr2=0x7f064403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 0x7f064403bf80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f074c00ffd0 tx=0x7f074c019ef0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 msgr2=0x560ed5d3f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x560ed5d389d0 tx=0x7f074c000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 shutdown_connections 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560ed5d72040 0x560ed5d744b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0644039ac0 0x7f064403bf80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 --2- 172.21.15.193:0/3272507689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560ed5bbe2d0 0x560ed5d3f0a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 >> 172.21.15.193:0/3272507689 conn(0x560ed5c44980 msgr2=0x560ed5d32110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 shutdown_connections 2024-09-12T17:11:23.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.595+0000 7f075e6ef9c0 1 -- 172.21.15.193:0/3272507689 wait complete. 2024-09-12T17:11:23.612 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:11:23.612 DEBUG:tasks.util.rgw: json result: {'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:11:23.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T17:11:23.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T17:11:23.615 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T17:11:23.687 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:23.688 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:23.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2e53b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561e959c1320 0x561e959c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2e53b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e9586f9c0 con 0x561e959bd1d0 2024-09-12T17:11:23.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2e53b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561e958bf6d0 con 0x561e959c1320 2024-09-12T17:11:23.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2b840640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561e959c1320 0x561e959c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2c041640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561e959bd1d0 0x561e959bd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35942/0 (socket says 172.21.15.193:35942) 2024-09-12T17:11:23.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.683+0000 7fef2c041640 1 -- 172.21.15.193:0/4122968202 learned_addr learned my addr 172.21.15.193:0/4122968202 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:23.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b840640 1 -- 172.21.15.193:0/4122968202 >> v1:172.21.15.62:6789/0 conn(0x561e959bd1d0 legacy=0x561e959bd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b840640 1 -- 172.21.15.193:0/4122968202 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95863ca0 con 0x561e959c1320 2024-09-12T17:11:23.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b840640 1 --2- 172.21.15.193:0/4122968202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959c1320 0x561e959c3710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a480 tx=0x7fef2001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ba1319c7903ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b03f640 1 -- 172.21.15.193:0/4122968202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200aa570 con 0x561e959c1320 2024-09-12T17:11:23.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b03f640 1 -- 172.21.15.193:0/4122968202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200af070 con 0x561e959c1320 2024-09-12T17:11:23.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2b03f640 1 -- 172.21.15.193:0/4122968202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200aa860 con 0x561e959c1320 2024-09-12T17:11:23.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/4122968202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959c1320 msgr2=0x561e959c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/4122968202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959c1320 0x561e959c3710 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fef2000a480 tx=0x7fef2001b310 comp rx=0 tx=0).stop 2024-09-12T17:11:23.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/4122968202 shutdown_connections 2024-09-12T17:11:23.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/4122968202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959c1320 0x561e959c3710 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/4122968202 >> 172.21.15.193:0/4122968202 conn(0x561e95930ae0 msgr2=0x561e95930ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.687+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/4122968202 shutdown_connections 2024-09-12T17:11:23.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.691+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/4122968202 wait complete. 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.703+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.703+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561e958c3680 con 0x561e959bd1d0 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50414/0 (socket says 172.21.15.193:50414) 2024-09-12T17:11:23.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 -- 172.21.15.193:0/2873348170 learned_addr learned my addr 172.21.15.193:0/2873348170 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 -- 172.21.15.193:0/2873348170 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e9583eda0 con 0x561e959bd1d0 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 --2- 172.21.15.193:0/2873348170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef1c001e00 tx=0x7fef1c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11c9c46b63ff254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fee1a60c640 1 -- 172.21.15.193:0/2873348170 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef1c012020 con 0x561e959bd1d0 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fee1a60c640 1 -- 172.21.15.193:0/2873348170 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c00e690 con 0x561e959bd1d0 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fee1a60c640 1 -- 172.21.15.193:0/2873348170 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef1c00ea10 con 0x561e959bd1d0 2024-09-12T17:11:23.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2873348170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 msgr2=0x561e95aa8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2873348170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef1c001e00 tx=0x7fef1c00b6d0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2873348170 shutdown_connections 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2873348170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aa8870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2873348170 >> 172.21.15.193:0/2873348170 conn(0x561e95930ae0 msgr2=0x561e95aa44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2873348170 shutdown_connections 2024-09-12T17:11:23.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2873348170 wait complete. 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2e53b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561e95865a50 con 0x561e959bd1d0 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50422/0 (socket says 172.21.15.193:50422) 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.707+0000 7fef2c041640 1 -- 172.21.15.193:0/1035348802 learned_addr learned my addr 172.21.15.193:0/1035348802 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2c041640 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95ab04a0 con 0x561e959bd1d0 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2c041640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x561e95aa9800 tx=0x7fef1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 -- 172.21.15.193:0/1035348802 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef1c012030 con 0x561e959bd1d0 2024-09-12T17:11:23.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e95ab0730 con 0x561e959bd1d0 2024-09-12T17:11:23.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 -- 172.21.15.193:0/1035348802 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c01a750 con 0x561e959bd1d0 2024-09-12T17:11:23.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 -- 172.21.15.193:0/1035348802 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef1c01aa50 con 0x561e959bd1d0 2024-09-12T17:11:23.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e95ab10e0 con 0x561e959bd1d0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 -- 172.21.15.193:0/1035348802 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fef1c015020 con 0x561e959bd1d0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 0x7fee1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fee18e09640 1 -- 172.21.15.193:0/1035348802 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef1c020030 con 0x561e959bd1d0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2b840640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 0x7fee1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 0x561e95ab70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ab75f0 con 0x561e959c1320 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2c842640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 0x561e95ab70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2b840640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 0x7fee1403bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef200ae000 tx=0x7fef200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2c842640 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 0x561e95ab70b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2c842640 1 -- 172.21.15.193:0/1035348802 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef2400a4d0 con 0x561e959c1320 2024-09-12T17:11:23.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.711+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ab7a40 con 0x561e959c1320 2024-09-12T17:11:23.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2c842640 1 -- 172.21.15.193:0/1035348802 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef2400a4d0 con 0x561e959c1320 2024-09-12T17:11:23.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ab9340 con 0x561e959c1320 2024-09-12T17:11:23.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2c842640 1 -- 172.21.15.193:0/1035348802 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef2400a4d0 con 0x561e959c1320 2024-09-12T17:11:23.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ab8570 con 0x561e959c1320 2024-09-12T17:11:23.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2c842640 1 -- 172.21.15.193:0/1035348802 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef2400a4d0 con 0x561e959c1320 2024-09-12T17:11:23.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ab8990 con 0x561e959c1320 2024-09-12T17:11:23.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2c842640 1 -- 172.21.15.193:0/1035348802 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef2400a4d0 con 0x561e959c1320 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561e958d0450 con 0x561e95ac76a0 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50432/0 (socket says 172.21.15.193:50432) 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2b840640 1 -- 172.21.15.193:0/2446197275 learned_addr learned my addr 172.21.15.193:0/2446197275 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2b840640 1 -- 172.21.15.193:0/2446197275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95ac8100 con 0x561e95ac76a0 2024-09-12T17:11:23.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2b840640 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef20000c10 tx=0x7fef200180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fee11ffb640 1 -- 172.21.15.193:0/2446197275 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200c5030 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e95ac8960 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fee11ffb640 1 -- 172.21.15.193:0/2446197275 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200b5950 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fee11ffb640 1 -- 172.21.15.193:0/2446197275 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200b5c50 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.715+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e95ac8ed0 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee11ffb640 1 -- 172.21.15.193:0/2446197275 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fef200c8030 con 0x561e95ac76a0 2024-09-12T17:11:23.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee11ffb640 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 0x7fee0403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee11ffb640 1 -- 172.21.15.193:0/2446197275 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef200c6070 con 0x561e95ac76a0 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2c842640 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 0x7fee0403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2c842640 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 0x7fee0403bf20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561e95ab8910 tx=0x7fef24005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561e95aa90c0 con 0x561e95ad3ee0 2024-09-12T17:11:23.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50440/0 (socket says 172.21.15.193:50440) 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2b840640 1 -- 172.21.15.193:0/3998982495 learned_addr learned my addr 172.21.15.193:0/3998982495 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2b840640 1 -- 172.21.15.193:0/3998982495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95ad4890 con 0x561e95ad3ee0 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2b840640 1 --2- 172.21.15.193:0/3998982495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef200eb760 tx=0x7fef200b5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89aacbfa31f4c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee0b7fe640 1 -- 172.21.15.193:0/3998982495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200d8070 con 0x561e95ad3ee0 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee0b7fe640 1 -- 172.21.15.193:0/3998982495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200ed1a0 con 0x561e95ad3ee0 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fee0b7fe640 1 -- 172.21.15.193:0/3998982495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200c1ad0 con 0x561e95ad3ee0 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3998982495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 msgr2=0x561e95ad42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3998982495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fef200eb760 tx=0x7fef200b5f60 comp rx=0 tx=0).stop 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3998982495 shutdown_connections 2024-09-12T17:11:23.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3998982495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95ad42c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3998982495 >> 172.21.15.193:0/3998982495 conn(0x561e95ad0310 msgr2=0x561e95ace550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3998982495 shutdown_connections 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.719+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3998982495 wait complete. 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 Processor -- start 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 -- start start 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561e95ad4ef0 con 0x561e95ad3ee0 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2b840640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50456/0 (socket says 172.21.15.193:50456) 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 learned_addr learned my addr 172.21.15.193:0/3136043819 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e95adb9a0 con 0x561e95ad3ee0 2024-09-12T17:11:23.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2b840640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fc0 tx=0x7fef200eb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 -- 172.21.15.193:0/3136043819 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200f2070 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e95adbc30 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e95adc5e0 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 -- 172.21.15.193:0/3136043819 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef200c1440 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 -- 172.21.15.193:0/3136043819 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef200d2770 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 -- 172.21.15.193:0/3136043819 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fef200f5070 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc039a70 0x7fedfc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.723+0000 7fee09ffb640 1 -- 172.21.15.193:0/3136043819 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fef200e7030 con 0x561e95ad3ee0 2024-09-12T17:11:23.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc039a70 0x7fedfc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e95ae6700 0x561e95ae8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ae92e0 con 0x561e95ae6700 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e95ae6700 0x561e95ae8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc039a70 0x7fedfc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561e95ab8090 tx=0x7fef2401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e95ae6700 0x561e95ae8b90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 realm 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ae96f0 con 0x561e95ae6700 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95ae9fc0 con 0x561e95ae6700 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aea360 con 0x561e95ae6700 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aea800 con 0x561e95ae6700 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 20 searching for the correct realm 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561e95aec770 0x561e95aeeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2b840640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561e95aec770 0x561e95aeeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2b840640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561e95aec770 0x561e95aeeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2b840640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fef200f7060 0x7fef200f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fef200f7060 0x7fef200f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fef200f7060 0x7fef200f69e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fef24031040 0x7fef24032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.727+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fef24031040 0x7fef24032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fef24031040 0x7fef24032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.731+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.735+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95aec770 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef24031040 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.739+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x561e95ae6700 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561e95aef1e0 con 0x7fef200f7060 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef2401f070 con 0x7fef200f7060 2024-09-12T17:11:23.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aeb1e0 con 0x561e95ae6700 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aeba80 con 0x561e95ae6700 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aeae20 con 0x561e95ae6700 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 zone default found 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 4 Realm: () 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:23.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 zonegroup default 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95aeba80 con 0x7fef24031040 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95af1030 con 0x561e95aec770 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95af13d0 con 0x561e95aec770 2024-09-12T17:11:23.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 started sync module instance, tier type = 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af04d0 con 0x7fef200f7060 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.743+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94689360283888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af1c70 con 0x7fef200f7060 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af24c0 con 0x561e95ae6700 2024-09-12T17:11:23.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94689360283888] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94689360287680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af2150 con 0x561e95ae6700 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.747+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af2c70 con 0x561e95aec770 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94689360287680] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94689360291648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af3060 con 0x561e95aec770 2024-09-12T17:11:23.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af3a20 con 0x7fef200f7060 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94689360295552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af4110 con 0x7fef200f7060 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af4c30 con 0x561e95ae6700 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94689360291648] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.751+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94689360295552] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94689360299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af4bf0 con 0x561e95ae6700 2024-09-12T17:11:23.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af54d0 con 0x7fef24031040 2024-09-12T17:11:23.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94689360299776] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94689360288736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af50a0 con 0x7fef24031040 2024-09-12T17:11:23.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.755+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af5930 con 0x7fef24031040 2024-09-12T17:11:23.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.759+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94689360288736] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.759+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.759+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94689360301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af5b10 con 0x7fef24031040 2024-09-12T17:11:23.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.759+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af6360 con 0x7fef24031040 2024-09-12T17:11:23.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.759+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94689360301040] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94689360304912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af63e0 con 0x7fef24031040 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=0 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=1 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=2 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=3 2024-09-12T17:11:23.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=4 2024-09-12T17:11:23.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=5 2024-09-12T17:11:23.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=6 2024-09-12T17:11:23.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94689360304912] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 20 add_watcher() i=7 2024-09-12T17:11:23.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:23.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95af96d0 con 0x561e95ae6700 2024-09-12T17:11:23.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.763+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94689360306336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95af6970 con 0x561e95ae6700 2024-09-12T17:11:23.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94689360306336] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fede27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 5 note: GC not initialized 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fede17e2640 20 reqs_thread_entry: start 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 20 Filter name: none 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fed52ffd640 20 reqs_thread_entry: start 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d020 con 0x561e95ae6700 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d020 con 0x7fef200f7060 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d4a0 con 0x561e95ae6700 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d4a0 con 0x561e95aec770 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.767+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef200f7060 2024-09-12T17:11:23.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.771+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef200f7060 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.775+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fede27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94689360306336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94689360306336] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.779+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94689360283888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef200f7060 2024-09-12T17:11:23.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94689360283888] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2e53b9c0 20 remove_watcher() i=0 2024-09-12T17:11:23.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2e53b9c0 2 removed watcher, disabling cache 2024-09-12T17:11:23.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94689360287680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94689360287680] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2e53b9c0 20 remove_watcher() i=1 2024-09-12T17:11:23.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.783+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94689360291648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95aec770 2024-09-12T17:11:23.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2b840640 1 -- 172.21.15.193:0/3136043819 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94689360291648] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef200f4030 con 0x561e95aec770 2024-09-12T17:11:23.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2e53b9c0 20 remove_watcher() i=2 2024-09-12T17:11:23.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94689360295552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef200f7060 2024-09-12T17:11:23.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2c842640 1 -- 172.21.15.193:0/3136043819 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94689360295552] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef24040040 con 0x7fef200f7060 2024-09-12T17:11:23.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2e53b9c0 20 remove_watcher() i=3 2024-09-12T17:11:23.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.787+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94689360299776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x561e95ae6700 2024-09-12T17:11:23.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94689360299776] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x561e95ae6700 2024-09-12T17:11:23.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2e53b9c0 20 remove_watcher() i=4 2024-09-12T17:11:23.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94689360288736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94689360288736] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2e53b9c0 20 remove_watcher() i=5 2024-09-12T17:11:23.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.791+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94689360301040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.795+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94689360301040] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.795+0000 7fef2e53b9c0 20 remove_watcher() i=6 2024-09-12T17:11:23.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.795+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94689360304912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561e95b1d840 con 0x7fef24031040 2024-09-12T17:11:23.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.795+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94689360304912] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef1c008030 con 0x7fef24031040 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.795+0000 7fef2e53b9c0 20 remove_watcher() i=7 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fef24031040 msgr2=0x7fef24032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fef24031040 0x7fef24032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e95ae6700 msgr2=0x561e95ae8b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e95ae6700 0x561e95ae8b90 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fef200f7060 msgr2=0x7fef200f69e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fef200f7060 0x7fef200f69e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561e95aec770 msgr2=0x561e95aeeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561e95aec770 0x561e95aeeb60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc039a70 msgr2=0x7fedfc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc039a70 0x7fedfc03bf30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x561e95ab8090 tx=0x7fef2401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 msgr2=0x561e95adb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2c041640 1 -- 172.21.15.193:0/3136043819 reap_dead start 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fef20006fc0 tx=0x7fef200eb6c0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 shutdown_connections 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/3136043819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ad3ee0 0x561e95adb440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 >> 172.21.15.193:0/3136043819 conn(0x561e95ad0310 msgr2=0x561e95ace520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 shutdown_connections 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/3136043819 wait complete. 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 msgr2=0x7fee0403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 0x7fee0403bf20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x561e95ab8910 tx=0x7fef24005850 comp rx=0 tx=0).stop 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 msgr2=0x561e95ac7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef20000c10 tx=0x7fef200180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 shutdown_connections 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee04039a60 0x7fee0403bf20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/2446197275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e95ac76a0 0x561e95ac7ac0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 >> 172.21.15.193:0/2446197275 conn(0x561e95abd050 msgr2=0x561e95abd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 shutdown_connections 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/2446197275 wait complete. 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 msgr2=0x561e95ab70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 0x561e95ab70b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 msgr2=0x7fee1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 0x7fee1403bf30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef200ae000 tx=0x7fef200a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 msgr2=0x561e95aaff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x561e95aa9800 tx=0x7fef1c000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 shutdown_connections 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561e959c1320 0x561e95ab70b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fee14039a70 0x7fee1403bf30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 --2- 172.21.15.193:0/1035348802 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561e959bd1d0 0x561e95aaff40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 >> 172.21.15.193:0/1035348802 conn(0x561e95930ae0 msgr2=0x561e95aa2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 shutdown_connections 2024-09-12T17:11:23.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.799+0000 7fef2e53b9c0 1 -- 172.21.15.193:0/1035348802 wait complete. 2024-09-12T17:11:23.815 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[],"summary":[]} 2024-09-12T17:11:23.815 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T17:11:23.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:23.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:23.815 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:23.894 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:23.894 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:23.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f512abad9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56534738aff0 0x56534738d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f512abad9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56534723c9c0 con 0x565347386e00 2024-09-12T17:11:23.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f512abad9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56534728c6d0 con 0x56534738aff0 2024-09-12T17:11:23.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f5127eb2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56534738aff0 0x56534738d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f5127eb2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56534738aff0 0x56534738d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50468/0 (socket says 172.21.15.193:50468) 2024-09-12T17:11:23.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f5127eb2640 1 -- 172.21.15.193:0/1194412050 learned_addr learned my addr 172.21.15.193:0/1194412050 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f5127eb2640 1 -- 172.21.15.193:0/1194412050 >> v1:172.21.15.62:6789/0 conn(0x565347386e00 legacy=0x5653473871e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.891+0000 7f5127eb2640 1 -- 172.21.15.193:0/1194412050 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565347230ca0 con 0x56534738aff0 2024-09-12T17:11:23.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1194412050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534738aff0 0x56534738d3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f511000a5c0 tx=0x7f511001b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7a115afe2be84c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f51276b1640 1 -- 172.21.15.193:0/1194412050 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100a9590 con 0x56534738aff0 2024-09-12T17:11:23.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f51276b1640 1 -- 172.21.15.193:0/1194412050 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100ae070 con 0x56534738aff0 2024-09-12T17:11:23.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f51276b1640 1 -- 172.21.15.193:0/1194412050 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100a9880 con 0x56534738aff0 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 -- 172.21.15.193:0/1194412050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534738aff0 msgr2=0x56534738d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1194412050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534738aff0 0x56534738d3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f511000a5c0 tx=0x7f511001b3d0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 -- 172.21.15.193:0/1194412050 shutdown_connections 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1194412050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534738aff0 0x56534738d3e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 -- 172.21.15.193:0/1194412050 >> 172.21.15.193:0/1194412050 conn(0x565347382920 msgr2=0x565347384d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 -- 172.21.15.193:0/1194412050 shutdown_connections 2024-09-12T17:11:23.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.895+0000 7f512abad9c0 1 -- 172.21.15.193:0/1194412050 wait complete. 2024-09-12T17:11:23.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f512abad9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f512abad9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565347290680 con 0x565347386e00 2024-09-12T17:11:23.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f51286b3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f51286b3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50484/0 (socket says 172.21.15.193:50484) 2024-09-12T17:11:23.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f51286b3640 1 -- 172.21.15.193:0/1255511037 learned_addr learned my addr 172.21.15.193:0/1255511037 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f51286b3640 1 -- 172.21.15.193:0/1255511037 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534720bda0 con 0x565347386e00 2024-09-12T17:11:23.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f51286b3640 1 --2- 172.21.15.193:0/1255511037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5118001690 tx=0x7f5118001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe7228bffa1666 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.911+0000 7f501660c640 1 -- 172.21.15.193:0/1255511037 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5118016070 con 0x565347386e00 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f501660c640 1 -- 172.21.15.193:0/1255511037 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511800f640 con 0x565347386e00 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f501660c640 1 -- 172.21.15.193:0/1255511037 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f511800f960 con 0x565347386e00 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/1255511037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 msgr2=0x565347473760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1255511037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5118001690 tx=0x7f5118001b50 comp rx=0 tx=0).stop 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/1255511037 shutdown_connections 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1255511037 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x565347473760 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/1255511037 >> 172.21.15.193:0/1255511037 conn(0x565347382920 msgr2=0x5653472fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/1255511037 shutdown_connections 2024-09-12T17:11:23.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/1255511037 wait complete. 2024-09-12T17:11:23.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565347232a50 con 0x565347386e00 2024-09-12T17:11:23.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f51286b3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f51286b3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50498/0 (socket says 172.21.15.193:50498) 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f51286b3640 1 -- 172.21.15.193:0/162676318 learned_addr learned my addr 172.21.15.193:0/162676318 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f51286b3640 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534747b2f0 con 0x565347386e00 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f51286b3640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x565347474660 tx=0x7f5118001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f5014e09640 1 -- 172.21.15.193:0/162676318 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5118021020 con 0x565347386e00 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56534747b580 con 0x565347386e00 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f5014e09640 1 -- 172.21.15.193:0/162676318 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51180115f0 con 0x565347386e00 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f5014e09640 1 -- 172.21.15.193:0/162676318 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5118016040 con 0x565347386e00 2024-09-12T17:11:23.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.915+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56534747bf30 con 0x565347386e00 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5014e09640 1 -- 172.21.15.193:0/162676318 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5118024020 con 0x565347386e00 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5014e09640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 0x7f501003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5014e09640 1 -- 172.21.15.193:0/162676318 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f511804fcf0 con 0x565347386e00 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5127eb2640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 0x7f501003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 0x565347481f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565347482440 con 0x56534738aff0 2024-09-12T17:11:23.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 0x565347481f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5127eb2640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 0x7f501003bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51100ad000 tx=0x7f51100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 0x565347481f00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 -- 172.21.15.193:0/162676318 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51200083f0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565347482870 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 -- 172.21.15.193:0/162676318 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51200083f0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565347484170 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 -- 172.21.15.193:0/162676318 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51200083f0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474833a0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 -- 172.21.15.193:0/162676318 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51200083f0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474837f0 con 0x56534738aff0 2024-09-12T17:11:23.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f5128eb4640 1 -- 172.21.15.193:0/162676318 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51200083f0 con 0x56534738aff0 2024-09-12T17:11:23.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.919+0000 7f512abad9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56534729d450 con 0x565347492480 2024-09-12T17:11:23.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50506/0 (socket says 172.21.15.193:50506) 2024-09-12T17:11:23.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5127eb2640 1 -- 172.21.15.193:0/1928150570 learned_addr learned my addr 172.21.15.193:0/1928150570 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5127eb2640 1 -- 172.21.15.193:0/1928150570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565347492ee0 con 0x565347492480 2024-09-12T17:11:23.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51100ab040 tx=0x7f5110018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 -- 172.21.15.193:0/1928150570 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100b3ba0 con 0x565347492480 2024-09-12T17:11:23.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565347493740 con 0x565347492480 2024-09-12T17:11:23.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 -- 172.21.15.193:0/1928150570 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100b3d40 con 0x565347492480 2024-09-12T17:11:23.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 -- 172.21.15.193:0/1928150570 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100c8580 con 0x565347492480 2024-09-12T17:11:23.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565347493c50 con 0x565347492480 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 -- 172.21.15.193:0/1928150570 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f51100d1440 con 0x565347492480 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 0x7f500003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f500dffb640 1 -- 172.21.15.193:0/1928150570 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f51100edc70 con 0x565347492480 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 0x7f500003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.923+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 0x7f500003bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x565347482ec0 tx=0x7f5120003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565347473fb0 con 0x56534749ecc0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50516/0 (socket says 172.21.15.193:50516) 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 -- 172.21.15.193:0/2834358524 learned_addr learned my addr 172.21.15.193:0/2834358524 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 -- 172.21.15.193:0/2834358524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56534749f670 con 0x56534749ecc0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 --2- 172.21.15.193:0/2834358524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51100c73d0 tx=0x7f51100c74c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30121381256ab1d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f50077fe640 1 -- 172.21.15.193:0/2834358524 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100be540 con 0x56534749ecc0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f50077fe640 1 -- 172.21.15.193:0/2834358524 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100bc3b0 con 0x56534749ecc0 2024-09-12T17:11:23.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f50077fe640 1 -- 172.21.15.193:0/2834358524 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100bc740 con 0x56534749ecc0 2024-09-12T17:11:23.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- 172.21.15.193:0/2834358524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 msgr2=0x56534749f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 --2- 172.21.15.193:0/2834358524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51100c73d0 tx=0x7f51100c74c0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- 172.21.15.193:0/2834358524 shutdown_connections 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 --2- 172.21.15.193:0/2834358524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x56534749f0a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- 172.21.15.193:0/2834358524 >> 172.21.15.193:0/2834358524 conn(0x56534749b0f0 msgr2=0x565347499330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- 172.21.15.193:0/2834358524 shutdown_connections 2024-09-12T17:11:23.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- 172.21.15.193:0/2834358524 wait complete. 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 Processor -- start 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- start start 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f512abad9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56534749fcd0 con 0x56534749ecc0 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50526/0 (socket says 172.21.15.193:50526) 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 learned_addr learned my addr 172.21.15.193:0/1451688107 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.927+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653474a6800 con 0x56534749ecc0 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51100eaf50 tx=0x7f51100ec010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 -- 172.21.15.193:0/1451688107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100bc950 con 0x56534749ecc0 2024-09-12T17:11:23.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653474a6a90 con 0x56534749ecc0 2024-09-12T17:11:23.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 -- 172.21.15.193:0/1451688107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51100bf8f0 con 0x56534749ecc0 2024-09-12T17:11:23.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653474a7440 con 0x56534749ecc0 2024-09-12T17:11:23.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 -- 172.21.15.193:0/1451688107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51100bfaa0 con 0x56534749ecc0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 -- 172.21.15.193:0/1451688107 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f51100d8020 con 0x56534749ecc0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4ff8039a70 0x7f4ff803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5005ffb640 1 -- 172.21.15.193:0/1451688107 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f51100d30b0 con 0x56534749ecc0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4ff8039a70 0x7f4ff803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653474b14c0 0x5653474b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b40a0 con 0x5653474b14c0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f51286b3640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653474b14c0 0x5653474b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4ff8039a70 0x7f4ff803bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f512000f010 tx=0x7f512001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f51286b3640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653474b14c0 0x5653474b3950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 realm 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b44b0 con 0x5653474b14c0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b4d80 con 0x5653474b14c0 2024-09-12T17:11:23.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.931+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b5120 con 0x5653474b14c0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b55c0 con 0x5653474b14c0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:23.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 20 searching for the correct realm 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653474b7530 0x5653474b9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653474b7530 0x5653474b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653474b7530 0x5653474b9920 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5127eb2640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5110009040 0x7f51100bda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5110009040 0x7f51100bda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5110009040 0x7f51100bda50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5128eb4640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5120019040 0x7f5120019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:23.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5120019040 0x7f5120019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:23.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5120019040 0x7f5120019930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:23.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.935+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.939+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.943+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b7530 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5120019040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x5653474b14c0 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5653474b9fa0 con 0x7f5110009040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.947+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b5fa0 con 0x5653474b14c0 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b6840 con 0x5653474b14c0 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474b5be0 con 0x5653474b14c0 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 zone default found 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 4 Realm: () 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:23.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 zonegroup default 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474ba400 con 0x7f5120019040 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474bbf50 con 0x5653474b7530 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474bc460 con 0x5653474b7530 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 started sync module instance, tier type = 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bb290 con 0x7f5110009040 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94915678418560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bcd70 con 0x7f5110009040 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.951+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bd5c0 con 0x5653474b14c0 2024-09-12T17:11:23.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.955+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94915678418560] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.955+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.955+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94915678423232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bd1d0 con 0x5653474b14c0 2024-09-12T17:11:23.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.955+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bdcc0 con 0x5653474b7530 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94915678427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474be590 con 0x5653474b7530 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bef90 con 0x7f5110009040 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94915678423232] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94915678424288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bf380 con 0x7f5110009040 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bfd40 con 0x5653474b14c0 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94915678427024] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94915678424288] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94915678431904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bf890 con 0x5653474b14c0 2024-09-12T17:11:23.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.959+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c05e0 con 0x7f5120019040 2024-09-12T17:11:23.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.963+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.963+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94915678436896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c06f0 con 0x7f5120019040 2024-09-12T17:11:23.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.963+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c10b0 con 0x7f5120019040 2024-09-12T17:11:23.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.963+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94915678431904] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94915678436896] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94915678437952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c0660 con 0x7f5120019040 2024-09-12T17:11:23.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c1560 con 0x7f5120019040 2024-09-12T17:11:23.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94915678441648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c1980 con 0x7f5120019040 2024-09-12T17:11:23.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=0 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=1 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=2 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=3 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=4 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.967+0000 7f512abad9c0 20 add_watcher() i=5 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94915678437952] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 add_watcher() i=6 2024-09-12T17:11:23.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94915678441648] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 add_watcher() i=7 2024-09-12T17:11:23.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:23.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474c1980 con 0x5653474b14c0 2024-09-12T17:11:23.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94915678442704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474c18f0 con 0x5653474b14c0 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94915678442704] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f4fde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 5 note: GC not initialized 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f4fdd7e2640 20 reqs_thread_entry: start 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.971+0000 7f512abad9c0 20 Filter name: none 2024-09-12T17:11:23.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f4f4effd640 20 reqs_thread_entry: start 2024-09-12T17:11:23.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:23.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5653474e7730 con 0x5653474b14c0 2024-09-12T17:11:23.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:23.979 INFO:teuthology.orchestra.run.smithi193.stderr:could not fetch user info: no user info saved 2024-09-12T17:11:23.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f4fde7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:23.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94915678442704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474e76f0 con 0x5653474b14c0 2024-09-12T17:11:23.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94915678442704] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94915678418560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474e76f0 con 0x7f5110009040 2024-09-12T17:11:23.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94915678418560] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 20 remove_watcher() i=0 2024-09-12T17:11:23.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 2 removed watcher, disabling cache 2024-09-12T17:11:23.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.975+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94915678423232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474e76f0 con 0x5653474b14c0 2024-09-12T17:11:23.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.979+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94915678423232] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.979+0000 7f512abad9c0 20 remove_watcher() i=1 2024-09-12T17:11:23.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.979+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94915678427024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474e76f0 con 0x5653474b7530 2024-09-12T17:11:23.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f5127eb2640 1 -- 172.21.15.193:0/1451688107 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94915678427024] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51100ce020 con 0x5653474b7530 2024-09-12T17:11:23.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 20 remove_watcher() i=2 2024-09-12T17:11:23.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94915678424288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bb680 con 0x7f5110009040 2024-09-12T17:11:23.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f5128eb4640 1 -- 172.21.15.193:0/1451688107 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94915678424288] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512002f040 con 0x7f5110009040 2024-09-12T17:11:23.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 20 remove_watcher() i=3 2024-09-12T17:11:23.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94915678431904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bd790 con 0x5653474b14c0 2024-09-12T17:11:23.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94915678431904] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x5653474b14c0 2024-09-12T17:11:23.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 20 remove_watcher() i=4 2024-09-12T17:11:23.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.983+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94915678436896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bb680 con 0x7f5120019040 2024-09-12T17:11:23.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94915678436896] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f512abad9c0 20 remove_watcher() i=5 2024-09-12T17:11:23.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94915678437952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474beaa0 con 0x7f5120019040 2024-09-12T17:11:23.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94915678437952] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f512abad9c0 20 remove_watcher() i=6 2024-09-12T17:11:23.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.987+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94915678441648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5653474bd790 con 0x7f5120019040 2024-09-12T17:11:23.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94915678441648] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f511800f070 con 0x7f5120019040 2024-09-12T17:11:23.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 20 remove_watcher() i=7 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5120019040 msgr2=0x7f5120019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5120019040 0x7f5120019930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653474b14c0 msgr2=0x5653474b3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653474b14c0 0x5653474b3950 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5110009040 msgr2=0x7f51100bda50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5110009040 0x7f51100bda50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653474b7530 msgr2=0x5653474b9920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653474b7530 0x5653474b9920 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4ff8039a70 msgr2=0x7f4ff803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4ff8039a70 0x7f4ff803bf30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f512000f010 tx=0x7f512001b070 comp rx=0 tx=0).stop 2024-09-12T17:11:23.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 msgr2=0x5653474a62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f51100eaf50 tx=0x7f51100ec010 comp rx=0 tx=0).stop 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f51286b3640 1 -- 172.21.15.193:0/1451688107 reap_dead start 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 shutdown_connections 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1451688107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56534749ecc0 0x5653474a62a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 >> 172.21.15.193:0/1451688107 conn(0x56534749b0f0 msgr2=0x565347499300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 shutdown_connections 2024-09-12T17:11:23.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1451688107 wait complete. 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 msgr2=0x7f500003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 0x7f500003bf30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x565347482ec0 tx=0x7f5120003070 comp rx=0 tx=0).stop 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 msgr2=0x5653474928a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f51100ab040 tx=0x7f5110018170 comp rx=0 tx=0).stop 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 shutdown_connections 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5000039a70 0x7f500003bf30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/1928150570 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347492480 0x5653474928a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 >> 172.21.15.193:0/1928150570 conn(0x565347487e30 msgr2=0x565347488210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 shutdown_connections 2024-09-12T17:11:23.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/1928150570 wait complete. 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 msgr2=0x565347481f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 0x565347481f00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 msgr2=0x7f501003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 0x7f501003bf30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f51100ad000 tx=0x7f51100a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 msgr2=0x56534747ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x565347474660 tx=0x7f5118001260 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 shutdown_connections 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56534738aff0 0x565347481f00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5010039a70 0x7f501003bf30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 --2- 172.21.15.193:0/162676318 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565347386e00 0x56534747ad90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 >> 172.21.15.193:0/162676318 conn(0x565347382920 msgr2=0x5653474749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 shutdown_connections 2024-09-12T17:11:24.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:23.991+0000 7f512abad9c0 1 -- 172.21.15.193:0/162676318 wait complete. 2024-09-12T17:11:24.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T17:11:24.007 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T17:11:24.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-12T17:11:24.007 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-12T17:11:24.093 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:24.094 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:24.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f523c0f89c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bc67d8cd80 0x55bc67d8d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f523c0f89c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc67c429c0 con 0x55bc67d8ff60 2024-09-12T17:11:24.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f523c0f89c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55bc67c926d0 con 0x55bc67d8cd80 2024-09-12T17:11:24.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f5239bfe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bc67d8cd80 0x55bc67d8d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f5239bfe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bc67d8cd80 0x55bc67d8d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50534/0 (socket says 172.21.15.193:50534) 2024-09-12T17:11:24.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f5239bfe640 1 -- 172.21.15.193:0/1552037809 learned_addr learned my addr 172.21.15.193:0/1552037809 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f5239bfe640 1 -- 172.21.15.193:0/1552037809 >> v1:172.21.15.62:6789/0 conn(0x55bc67d8ff60 legacy=0x55bc67d92350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.091+0000 7f5239bfe640 1 -- 172.21.15.193:0/1552037809 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67c36ca0 con 0x55bc67d8cd80 2024-09-12T17:11:24.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f5239bfe640 1 --2- 172.21.15.193:0/1552037809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67d8d160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a5c0 tx=0x7f522c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d187c3f48a882997 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f5238bfc640 1 -- 172.21.15.193:0/1552037809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0a6070 con 0x55bc67d8cd80 2024-09-12T17:11:24.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f5238bfc640 1 -- 172.21.15.193:0/1552037809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c0af070 con 0x55bc67d8cd80 2024-09-12T17:11:24.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f5238bfc640 1 -- 172.21.15.193:0/1552037809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0aa5c0 con 0x55bc67d8cd80 2024-09-12T17:11:24.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1552037809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 msgr2=0x55bc67d8d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1552037809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67d8d160 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f522c00a5c0 tx=0x7f522c01b340 comp rx=0 tx=0).stop 2024-09-12T17:11:24.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1552037809 shutdown_connections 2024-09-12T17:11:24.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1552037809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67d8d160 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1552037809 >> 172.21.15.193:0/1552037809 conn(0x55bc67d888a0 msgr2=0x55bc67d8acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1552037809 shutdown_connections 2024-09-12T17:11:24.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.095+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1552037809 wait complete. 2024-09-12T17:11:24.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bc67c96680 con 0x55bc67d8cd80 2024-09-12T17:11:24.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5239bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5239bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50546/0 (socket says 172.21.15.193:50546) 2024-09-12T17:11:24.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5239bfe640 1 -- 172.21.15.193:0/991069018 learned_addr learned my addr 172.21.15.193:0/991069018 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5239bfe640 1 -- 172.21.15.193:0/991069018 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67c11da0 con 0x55bc67d8cd80 2024-09-12T17:11:24.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5239bfe640 1 --2- 172.21.15.193:0/991069018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f522c018f70 tx=0x7f522c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dead7d43a543768f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5127e07640 1 -- 172.21.15.193:0/991069018 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0aa9e0 con 0x55bc67d8cd80 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5127e07640 1 -- 172.21.15.193:0/991069018 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c0aab80 con 0x55bc67d8cd80 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f5127e07640 1 -- 172.21.15.193:0/991069018 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0aae60 con 0x55bc67d8cd80 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- 172.21.15.193:0/991069018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 msgr2=0x55bc67e796c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/991069018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f522c018f70 tx=0x7f522c003030 comp rx=0 tx=0).stop 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- 172.21.15.193:0/991069018 shutdown_connections 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/991069018 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e796c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- 172.21.15.193:0/991069018 >> 172.21.15.193:0/991069018 conn(0x55bc67d888a0 msgr2=0x55bc67e75310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- 172.21.15.193:0/991069018 shutdown_connections 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.111+0000 7f523c0f89c0 1 -- 172.21.15.193:0/991069018 wait complete. 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bc67c38a50 con 0x55bc67d8cd80 2024-09-12T17:11:24.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5239bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5239bfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50548/0 (socket says 172.21.15.193:50548) 2024-09-12T17:11:24.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5239bfe640 1 -- 172.21.15.193:0/2474318949 learned_addr learned my addr 172.21.15.193:0/2474318949 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5239bfe640 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67e811d0 con 0x55bc67d8cd80 2024-09-12T17:11:24.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5239bfe640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f522c000c10 tx=0x7f522c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 -- 172.21.15.193:0/2474318949 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0c6750 con 0x55bc67d8cd80 2024-09-12T17:11:24.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 -- 172.21.15.193:0/2474318949 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c0c68f0 con 0x55bc67d8cd80 2024-09-12T17:11:24.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc67e81460 con 0x55bc67d8cd80 2024-09-12T17:11:24.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 -- 172.21.15.193:0/2474318949 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f522c0c6bf0 con 0x55bc67d8cd80 2024-09-12T17:11:24.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc67e81e10 con 0x55bc67d8cd80 2024-09-12T17:11:24.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 -- 172.21.15.193:0/2474318949 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f522c0ce030 con 0x55bc67d8cd80 2024-09-12T17:11:24.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 0x7f512003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f5126604640 1 -- 172.21.15.193:0/2474318949 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f522c0cc020 con 0x55bc67d8cd80 2024-09-12T17:11:24.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f52393fd640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 0x7f512003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 0x55bc67e87de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67e88320 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.115+0000 7f523a3ff640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 0x55bc67e87de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 0x7f512003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5230001ec0 tx=0x7f5230001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 0x55bc67e87de0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 -- 172.21.15.193:0/2474318949 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f523400a4d0 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67e88790 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 -- 172.21.15.193:0/2474318949 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f523400a4d0 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67e8a090 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 -- 172.21.15.193:0/2474318949 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f523400a4d0 con 0x55bc67d8ff60 2024-09-12T17:11:24.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67e892c0 con 0x55bc67d8ff60 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 -- 172.21.15.193:0/2474318949 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f523400a4d0 con 0x55bc67d8ff60 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67e89710 con 0x55bc67d8ff60 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523a3ff640 1 -- 172.21.15.193:0/2474318949 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f523400a4d0 con 0x55bc67d8ff60 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f523c0f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bc67ca3450 con 0x55bc67e983a0 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50560/0 (socket says 172.21.15.193:50560) 2024-09-12T17:11:24.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 -- 172.21.15.193:0/726582107 learned_addr learned my addr 172.21.15.193:0/726582107 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 -- 172.21.15.193:0/726582107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67e98e00 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.119+0000 7f52393fd640 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5230010fd0 tx=0x7f523000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 -- 172.21.15.193:0/726582107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f523000a040 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc67e99660 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 -- 172.21.15.193:0/726582107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5230017050 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 -- 172.21.15.193:0/726582107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f523000e6b0 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc67e99bd0 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 -- 172.21.15.193:0/726582107 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f523000e8e0 con 0x55bc67e983a0 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 0x7f511403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f511f7fe640 1 -- 172.21.15.193:0/726582107 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5230052100 con 0x55bc67e983a0 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523a3ff640 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 0x7f511403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523a3ff640 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 0x7f511403bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bc67e88de0 tx=0x7f5234005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f523c0f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bc67e79e50 con 0x55bc67d96470 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50562/0 (socket says 172.21.15.193:50562) 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f52393fd640 1 -- 172.21.15.193:0/3231593285 learned_addr learned my addr 172.21.15.193:0/3231593285 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f52393fd640 1 -- 172.21.15.193:0/3231593285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67d96db0 con 0x55bc67d96470 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.123+0000 7f52393fd640 1 --2- 172.21.15.193:0/3231593285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5230050510 tx=0x7f5230024360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b483d079a49565 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f511d7fa640 1 -- 172.21.15.193:0/3231593285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f523001a310 con 0x55bc67d96470 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f511d7fa640 1 -- 172.21.15.193:0/3231593285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f523001c410 con 0x55bc67d96470 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f511d7fa640 1 -- 172.21.15.193:0/3231593285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f523001a4b0 con 0x55bc67d96470 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/3231593285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 msgr2=0x55bc67d96870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/3231593285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5230050510 tx=0x7f5230024360 comp rx=0 tx=0).stop 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/3231593285 shutdown_connections 2024-09-12T17:11:24.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/3231593285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67d96870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/3231593285 >> 172.21.15.193:0/3231593285 conn(0x55bc67ea1130 msgr2=0x55bc67e9f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/3231593285 shutdown_connections 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/3231593285 wait complete. 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 Processor -- start 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- start start 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bc67d97330 con 0x55bc67d96470 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f52393fd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50578/0 (socket says 172.21.15.193:50578) 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 learned_addr learned my addr 172.21.15.193:0/1205800176 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc67eb2eb0 con 0x55bc67d96470 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f52393fd640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f523000fcf0 tx=0x7f52300504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f510b7fe640 1 -- 172.21.15.193:0/1205800176 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5230034070 con 0x55bc67d96470 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc67eb3140 con 0x55bc67d96470 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f510b7fe640 1 -- 172.21.15.193:0/1205800176 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5230048040 con 0x55bc67d96470 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f510b7fe640 1 -- 172.21.15.193:0/1205800176 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5230047050 con 0x55bc67d96470 2024-09-12T17:11:24.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.127+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc67eb3af0 con 0x55bc67d96470 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f510b7fe640 1 -- 172.21.15.193:0/1205800176 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5230037070 con 0x55bc67d96470 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f510b7fe640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5104039a70 0x7f510403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f510b7fe640 1 -- 172.21.15.193:0/1205800176 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f52300312d0 con 0x55bc67d96470 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523a3ff640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5104039a70 0x7f510403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67ebdca0 0x55bc67ec0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec0880 con 0x55bc67ebdca0 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67ebdca0 0x55bc67ec0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523a3ff640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5104039a70 0x7f510403bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55bc67e82df0 tx=0x7f523401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67ebdca0 0x55bc67ec0130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 realm 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec0c90 con 0x55bc67ebdca0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec1560 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec1900 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec2150 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:24.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 20 searching for the correct realm 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bc67ec3ec0 0x55bc67ec62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f52393fd640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bc67ec3ec0 0x55bc67ec62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f52393fd640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bc67ec3ec0 0x55bc67ec62b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f52393fd640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5230039060 0x7f523002e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.131+0000 7f523a3ff640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5230039060 0x7f523002e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f523a3ff640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5230039060 0x7f523002e9e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f523a3ff640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5234031040 0x7f5234032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5234031040 0x7f5234032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5234031040 0x7f5234032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.135+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.139+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.143+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5234031040 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec67f0 con 0x7f5230039060 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f523401f070 con 0x7f5230039060 2024-09-12T17:11:24.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec2b00 con 0x55bc67ebdca0 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec33a0 con 0x55bc67ebdca0 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec2740 con 0x55bc67ebdca0 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 zone default found 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 4 Realm: () 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:24.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 zonegroup default 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.147+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec6c00 con 0x7f5234031040 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec8a30 con 0x55bc67ec3ec0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec8ec0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 started sync module instance, tier type = 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec7ed0 con 0x7f5230039060 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94267685765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec97d0 con 0x7f5230039060 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca020 con 0x55bc67ebdca0 2024-09-12T17:11:24.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.151+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94267685765824] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94267685770016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ec9c30 con 0x55bc67ebdca0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca700 con 0x55bc67ec3ec0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94267685773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecafd0 con 0x55bc67ec3ec0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecb9d0 con 0x7f5230039060 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.155+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94267685770016] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94267685771072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecbdc0 con 0x7f5230039060 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecc780 con 0x55bc67ebdca0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94267685773808] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94267685771072] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94267685778656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecc2d0 con 0x55bc67ebdca0 2024-09-12T17:11:24.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.159+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eccb20 con 0x7f5234031040 2024-09-12T17:11:24.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94267685778656] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94267685782224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eccba0 con 0x7f5234031040 2024-09-12T17:11:24.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecd3f0 con 0x7f5234031040 2024-09-12T17:11:24.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94267685782224] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94267685783760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecd2c0 con 0x7f5234031040 2024-09-12T17:11:24.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.163+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecddc0 con 0x7f5234031040 2024-09-12T17:11:24.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94267685783760] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94267685787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecdd80 con 0x7f5234031040 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=0 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=1 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=2 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=3 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=4 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=5 2024-09-12T17:11:24.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.167+0000 7f523c0f89c0 20 add_watcher() i=6 2024-09-12T17:11:24.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94267685787824] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 add_watcher() i=7 2024-09-12T17:11:24.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:24.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ed1210 con 0x55bc67ebdca0 2024-09-12T17:11:24.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94267685784880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ece6d0 con 0x55bc67ebdca0 2024-09-12T17:11:24.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94267685784880] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f50eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:24.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:24.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 5 note: GC not initialized 2024-09-12T17:11:24.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f50ea7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:24.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 Filter name: none 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f505bfff640 20 reqs_thread_entry: start 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef4510 con 0x55bc67ebdca0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2bb0 con 0x55bc67ebdca0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.171+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2fa0 con 0x7f5234031040 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-12T17:11:24.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef3ef0 con 0x55bc67ebdca0 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94267685942208 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef7fa0 con 0x55bc67ebdca0 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify (1) cookie 94267685778656 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55bc67ef3990 con 0x55bc67ebdca0 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f511d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94267685778656 notifier 4293 bl.length()=567 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f511d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f511d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 notify.4 [notify cookie 94267685942208 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f511d7fa640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50fc003eb0 con 0x55bc67ebdca0 2024-09-12T17:11:24.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify_complete (2) cookie 94267685942208 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc67ef3170 con 0x55bc67ebdca0 2024-09-12T17:11:24.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.175+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef3340 con 0x55bc67ebdca0 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523c0f89c0 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523c0f89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94267685942080 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef83d0 con 0x7f5230039060 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== watch-notify(notify (1) cookie 94267685771072 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7f52340247c0 con 0x7f5230039060 2024-09-12T17:11:24.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f511cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94267685771072 notifier 4293 bl.length()=169 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f511cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f511cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f511cff9640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5064003410 con 0x7f5230039060 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(69 notify.3 [notify cookie 94267685942080 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== watch-notify(notify_complete (2) cookie 94267685942080 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5234024990 con 0x7f5230039060 2024-09-12T17:11:24.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.179+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef3340 con 0x7f5234031040 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94267685942080 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef83d0 con 0x7f5230039060 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== watch-notify(notify (1) cookie 94267685771072 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f5234024990 con 0x7f5230039060 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f511d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94267685771072 notifier 4293 bl.length()=177 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f511d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f511d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f511d7fa640 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f50fc003eb0 con 0x7f5230039060 2024-09-12T17:11:24.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(72 notify.3 [notify cookie 94267685942080 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== watch-notify(notify_complete (2) cookie 94267685942080 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5234043420 con 0x7f5230039060 2024-09-12T17:11:24.188 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:24.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f50eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94267685784880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2290 con 0x55bc67ebdca0 2024-09-12T17:11:24.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94267685784880] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.183+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94267685765824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2290 con 0x7f5230039060 2024-09-12T17:11:24.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94267685765824] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523c0f89c0 20 remove_watcher() i=0 2024-09-12T17:11:24.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523c0f89c0 2 removed watcher, disabling cache 2024-09-12T17:11:24.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94267685770016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2290 con 0x55bc67ebdca0 2024-09-12T17:11:24.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94267685770016] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523c0f89c0 20 remove_watcher() i=1 2024-09-12T17:11:24.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.187+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94267685773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ef2290 con 0x55bc67ec3ec0 2024-09-12T17:11:24.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f52393fd640 1 -- 172.21.15.193:0/1205800176 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94267685773808] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5230036030 con 0x55bc67ec3ec0 2024-09-12T17:11:24.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f523c0f89c0 20 remove_watcher() i=2 2024-09-12T17:11:24.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94267685771072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca1f0 con 0x7f5230039060 2024-09-12T17:11:24.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f523a3ff640 1 -- 172.21.15.193:0/1205800176 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94267685771072] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5234040040 con 0x7f5230039060 2024-09-12T17:11:24.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f523c0f89c0 20 remove_watcher() i=3 2024-09-12T17:11:24.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.191+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94267685778656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca1f0 con 0x55bc67ebdca0 2024-09-12T17:11:24.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94267685778656] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x55bc67ebdca0 2024-09-12T17:11:24.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f523c0f89c0 20 remove_watcher() i=4 2024-09-12T17:11:24.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94267685782224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca1f0 con 0x7f5234031040 2024-09-12T17:11:24.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94267685782224] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f523c0f89c0 20 remove_watcher() i=5 2024-09-12T17:11:24.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.195+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94267685783760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67ecc2d0 con 0x7f5234031040 2024-09-12T17:11:24.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94267685783760] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 20 remove_watcher() i=6 2024-09-12T17:11:24.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94267685787824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc67eca1f0 con 0x7f5234031040 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94267685787824] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522c0c53e0 con 0x7f5234031040 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 20 remove_watcher() i=7 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5234031040 msgr2=0x7f5234032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5234031040 0x7f5234032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67ebdca0 msgr2=0x55bc67ec0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67ebdca0 0x55bc67ec0130 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5230039060 msgr2=0x7f523002e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5230039060 0x7f523002e9e0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bc67ec3ec0 msgr2=0x55bc67ec62b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bc67ec3ec0 0x55bc67ec62b0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5104039a70 msgr2=0x7f510403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5104039a70 0x7f510403bf30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55bc67e82df0 tx=0x7f523401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 msgr2=0x55bc67eb2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f5239bfe640 1 -- 172.21.15.193:0/1205800176 reap_dead start 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f523000fcf0 tx=0x7f52300504a0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 shutdown_connections 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/1205800176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d96470 0x55bc67eb2950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 >> 172.21.15.193:0/1205800176 conn(0x55bc67ea1130 msgr2=0x55bc67e9f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 shutdown_connections 2024-09-12T17:11:24.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.199+0000 7f523c0f89c0 1 -- 172.21.15.193:0/1205800176 wait complete. 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 msgr2=0x7f511403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 0x7f511403bf30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55bc67e88de0 tx=0x7f5234005850 comp rx=0 tx=0).stop 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 msgr2=0x55bc67e987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5230010fd0 tx=0x7f523000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 shutdown_connections 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5114039a70 0x7f511403bf30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/726582107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67e983a0 0x55bc67e987c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 >> 172.21.15.193:0/726582107 conn(0x55bc67e8dd50 msgr2=0x55bc67e8e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 shutdown_connections 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/726582107 wait complete. 2024-09-12T17:11:24.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 msgr2=0x55bc67e87de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 0x55bc67e87de0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 msgr2=0x7f512003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 0x7f512003bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5230001ec0 tx=0x7f5230001440 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 msgr2=0x55bc67e80c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f522c000c10 tx=0x7f522c0180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 shutdown_connections 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bc67d8ff60 0x55bc67e87de0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5120039a70 0x7f512003bf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 --2- 172.21.15.193:0/2474318949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bc67d8cd80 0x55bc67e80c70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 >> 172.21.15.193:0/2474318949 conn(0x55bc67d888a0 msgr2=0x55bc67e73da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 shutdown_connections 2024-09-12T17:11:24.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.203+0000 7f523c0f89c0 1 -- 172.21.15.193:0/2474318949 wait complete. 2024-09-12T17:11:24.217 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:24.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T17:11:24.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-12T17:11:24.218 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-12T17:11:24.254 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:24.255 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:24.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49159e09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563dd042d180 0x563dd04bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49159e09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563dd036d9c0 con 0x563dd04bc0f0 2024-09-12T17:11:24.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49159e09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x563dd03bd6d0 con 0x563dd042d180 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49134e6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563dd042d180 0x563dd04bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49134e6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x563dd042d180 0x563dd04bbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50586/0 (socket says 172.21.15.193:50586) 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f4912ce5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x563dd04bc0f0 0x563dd04be4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35960/0 (socket says 172.21.15.193:35960) 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49134e6640 1 -- 172.21.15.193:0/4191205756 learned_addr learned my addr 172.21.15.193:0/4191205756 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49134e6640 1 -- 172.21.15.193:0/4191205756 >> v1:172.21.15.62:6789/0 conn(0x563dd04bc0f0 legacy=0x563dd04be4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.251+0000 7f49134e6640 1 -- 172.21.15.193:0/4191205756 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd0361ca0 con 0x563dd042d180 2024-09-12T17:11:24.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49134e6640 1 --2- 172.21.15.193:0/4191205756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd04bbbb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f490400a5c0 tx=0x7f490401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31665a7da7e516bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49124e4640 1 -- 172.21.15.193:0/4191205756 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040b1070 con 0x563dd042d180 2024-09-12T17:11:24.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49124e4640 1 -- 172.21.15.193:0/4191205756 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040a8070 con 0x563dd042d180 2024-09-12T17:11:24.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49124e4640 1 -- 172.21.15.193:0/4191205756 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040ac5b0 con 0x563dd042d180 2024-09-12T17:11:24.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 -- 172.21.15.193:0/4191205756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 msgr2=0x563dd04bbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 --2- 172.21.15.193:0/4191205756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd04bbbb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f490400a5c0 tx=0x7f490401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 -- 172.21.15.193:0/4191205756 shutdown_connections 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 --2- 172.21.15.193:0/4191205756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd04bbbb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 -- 172.21.15.193:0/4191205756 >> 172.21.15.193:0/4191205756 conn(0x563dd04b38a0 msgr2=0x563dd04b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 -- 172.21.15.193:0/4191205756 shutdown_connections 2024-09-12T17:11:24.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.255+0000 7f49159e09c0 1 -- 172.21.15.193:0/4191205756 wait complete. 2024-09-12T17:11:24.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49159e09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49159e09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563dd03c1680 con 0x563dd042d180 2024-09-12T17:11:24.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49134e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49134e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50600/0 (socket says 172.21.15.193:50600) 2024-09-12T17:11:24.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49134e6640 1 -- 172.21.15.193:0/3117717770 learned_addr learned my addr 172.21.15.193:0/3117717770 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49134e6640 1 -- 172.21.15.193:0/3117717770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd033cda0 con 0x563dd042d180 2024-09-12T17:11:24.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f49134e6640 1 --2- 172.21.15.193:0/3117717770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49040af040 tx=0x7f4904003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce74db617a1ac8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f480160a640 1 -- 172.21.15.193:0/3117717770 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040b1040 con 0x563dd042d180 2024-09-12T17:11:24.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f480160a640 1 -- 172.21.15.193:0/3117717770 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040ac820 con 0x563dd042d180 2024-09-12T17:11:24.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.271+0000 7f480160a640 1 -- 172.21.15.193:0/3117717770 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040acb00 con 0x563dd042d180 2024-09-12T17:11:24.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3117717770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 msgr2=0x563dd05a4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3117717770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f49040af040 tx=0x7f4904003030 comp rx=0 tx=0).stop 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3117717770 shutdown_connections 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3117717770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05a4780 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3117717770 >> 172.21.15.193:0/3117717770 conn(0x563dd04b38a0 msgr2=0x563dd05a03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3117717770 shutdown_connections 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3117717770 wait complete. 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563dd0363a50 con 0x563dd042d180 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49134e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49134e6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50614/0 (socket says 172.21.15.193:50614) 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49134e6640 1 -- 172.21.15.193:0/3966863007 learned_addr learned my addr 172.21.15.193:0/3966863007 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49134e6640 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd05ac280 con 0x563dd042d180 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49134e6640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4904018f70 tx=0x7f4904019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f47ffe07640 1 -- 172.21.15.193:0/3966863007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040cd070 con 0x563dd042d180 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dd05ac510 con 0x563dd042d180 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f47ffe07640 1 -- 172.21.15.193:0/3966863007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49040b7a20 con 0x563dd042d180 2024-09-12T17:11:24.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f47ffe07640 1 -- 172.21.15.193:0/3966863007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49040b1070 con 0x563dd042d180 2024-09-12T17:11:24.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.275+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd05acec0 con 0x563dd042d180 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f47ffe07640 1 -- 172.21.15.193:0/3966863007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f49040d0070 con 0x563dd042d180 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f47ffe07640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 0x7f47f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f47ffe07640 1 -- 172.21.15.193:0/3966863007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f49040eb2c0 con 0x563dd042d180 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 0x7f47f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 0x563dd05b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05b33d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 0x563dd05b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 0x7f47f803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4908001e90 tx=0x7f49080013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 0x563dd05b2e90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 -- 172.21.15.193:0/3966863007 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f490c00a4d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ad200 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 -- 172.21.15.193:0/3966863007 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f490c00a4d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05b5130 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 -- 172.21.15.193:0/3966863007 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f490c00a4d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05b4360 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 -- 172.21.15.193:0/3966863007 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f490c00a4d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05b47b0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f4913ce7640 1 -- 172.21.15.193:0/3966863007 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f490c00a4d0 con 0x563dd04bc0f0 2024-09-12T17:11:24.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.279+0000 7f49159e09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563dd03ce450 con 0x563dd04b9310 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50626/0 (socket says 172.21.15.193:50626) 2024-09-12T17:11:24.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4912ce5640 1 -- 172.21.15.193:0/994179219 learned_addr learned my addr 172.21.15.193:0/994179219 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4912ce5640 1 -- 172.21.15.193:0/994179219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd04b9830 con 0x563dd04b9310 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4912ce5640 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f490800e670 tx=0x7f490800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 -- 172.21.15.193:0/994179219 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908022070 con 0x563dd04b9310 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 -- 172.21.15.193:0/994179219 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490800d660 con 0x563dd04b9310 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dd04b80f0 con 0x563dd04b9310 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 -- 172.21.15.193:0/994179219 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908006070 con 0x563dd04b9310 2024-09-12T17:11:24.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd04b8660 con 0x563dd04b9310 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 -- 172.21.15.193:0/994179219 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4908025070 con 0x563dd04b9310 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 0x7f47ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f47fd602640 1 -- 172.21.15.193:0/994179219 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4908051bf0 con 0x563dd04b9310 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4913ce7640 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 0x7f47ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f4913ce7640 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 0x7f47ec03bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x563dd05b3e80 tx=0x7f490c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.283+0000 7f49159e09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563dd05a4f70 con 0x563dd05d2fb0 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50632/0 (socket says 172.21.15.193:50632) 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 -- 172.21.15.193:0/3298638560 learned_addr learned my addr 172.21.15.193:0/3298638560 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 -- 172.21.15.193:0/3298638560 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd05d39a0 con 0x563dd05d2fb0 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3298638560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4908050030 tx=0x7f490800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d228a1e78a9d771 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f47f6ffd640 1 -- 172.21.15.193:0/3298638560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490804e030 con 0x563dd05d2fb0 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f47f6ffd640 1 -- 172.21.15.193:0/3298638560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490801a320 con 0x563dd05d2fb0 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f47f6ffd640 1 -- 172.21.15.193:0/3298638560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49080268d0 con 0x563dd05d2fb0 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- 172.21.15.193:0/3298638560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 msgr2=0x563dd05d33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3298638560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4908050030 tx=0x7f490800df30 comp rx=0 tx=0).stop 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- 172.21.15.193:0/3298638560 shutdown_connections 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3298638560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d33b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- 172.21.15.193:0/3298638560 >> 172.21.15.193:0/3298638560 conn(0x563dd05ce3d0 msgr2=0x563dd05cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- 172.21.15.193:0/3298638560 shutdown_connections 2024-09-12T17:11:24.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- 172.21.15.193:0/3298638560 wait complete. 2024-09-12T17:11:24.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 Processor -- start 2024-09-12T17:11:24.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- start start 2024-09-12T17:11:24.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f49159e09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x563dd05d1f00 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50634/0 (socket says 172.21.15.193:50634) 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 learned_addr learned my addr 172.21.15.193:0/3579736019 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd05d9a50 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.287+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d94f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f490801bfd0 tx=0x7f490804ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 -- 172.21.15.193:0/3579736019 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4908036070 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563dd05d9a50 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 -- 172.21.15.193:0/3579736019 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f490801a540 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 -- 172.21.15.193:0/3579736019 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f490801a6f0 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd05d9a50 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 -- 172.21.15.193:0/3579736019 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f490801a890 con 0x563dd05d2fb0 2024-09-12T17:11:24.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47dc039a70 0x7f47dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f47f57fa640 1 -- 172.21.15.193:0/3579736019 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f490803bc30 con 0x563dd05d2fb0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47dc039a70 0x7f47dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd05e4530 0x563dd05e69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e7110 con 0x563dd05e4530 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd05e4530 0x563dd05e69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47dc039a70 0x7f47dc03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x563dd05ad140 tx=0x7f490c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd05e4530 0x563dd05e69c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 realm 2024-09-12T17:11:24.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e7520 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e7df0 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e8190 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.291+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e89e0 con 0x563dd05e4530 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49159e09c0 20 searching for the correct realm 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x563dd05ea750 0x563dd05ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x563dd05ea750 0x563dd05ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x563dd05ea750 0x563dd05ecb40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4908024030 con 0x563dd05ea750 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4912ce5640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4908027060 0x7f490801f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4908027060 0x7f490801f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4908027060 0x7f490801f080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4913ce7640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f490c031040 0x7f490c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f490c031040 0x7f490c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f490c031040 0x7f490c032430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040cf030 con 0x7f490c031040 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f49040cf030 con 0x563dd05e4530 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.295+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.299+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.303+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05ea750 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f490c031040 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x563dd05e4530 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ed080 con 0x7f4908027060 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f490c01f070 con 0x7f4908027060 2024-09-12T17:11:24.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e9330 con 0x563dd05e4530 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.307+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e9b80 con 0x563dd05e4530 2024-09-12T17:11:24.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e9b80 con 0x563dd05e4530 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 zone default found 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 4 Realm: () 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 zonegroup default 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05e9b80 con 0x7f490c031040 2024-09-12T17:11:24.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05eef20 con 0x563dd05ea750 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ef390 con 0x563dd05ea750 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 started sync module instance, tier type = 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:24.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ee3c0 con 0x7f4908027060 2024-09-12T17:11:24.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94823488874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ee020 con 0x7f4908027060 2024-09-12T17:11:24.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.311+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f02c0 con 0x563dd05e4530 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94823488874416] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94823488878576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f02c0 con 0x563dd05e4530 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f0cd0 con 0x563dd05ea750 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94823488882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f1520 con 0x563dd05ea750 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.315+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f1f20 con 0x7f4908027060 2024-09-12T17:11:24.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94823488878576] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94823488880144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f2310 con 0x7f4908027060 2024-09-12T17:11:24.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f2cd0 con 0x563dd05e4530 2024-09-12T17:11:24.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94823488882720] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94823488880144] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94823488887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f2820 con 0x563dd05e4530 2024-09-12T17:11:24.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.319+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f30b0 con 0x7f490c031040 2024-09-12T17:11:24.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94823488890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f2c40 con 0x7f490c031040 2024-09-12T17:11:24.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f3f70 con 0x7f490c031040 2024-09-12T17:11:24.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94823488887344] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94823488884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f3f70 con 0x7f490c031040 2024-09-12T17:11:24.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4930 con 0x7f490c031040 2024-09-12T17:11:24.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.323+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94823488890912] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94823488884848] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94823488895680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f3ee0 con 0x7f490c031040 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=0 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=1 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=2 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=3 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=4 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=5 2024-09-12T17:11:24.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.327+0000 7f49159e09c0 20 add_watcher() i=6 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94823488895680] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 add_watcher() i=7 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f7960 con 0x563dd05e4530 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94823488898176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4d50 con 0x563dd05e4530 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94823488898176] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f47c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 5 note: GC not initialized 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f47c8fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:24.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 Filter name: none 2024-09-12T17:11:24.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f47427fc640 20 reqs_thread_entry: start 2024-09-12T17:11:24.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:24.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd061aa10 con 0x7f490c031040 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd06190b0 con 0x563dd05e4530 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=7 2024-09-12T17:11:24.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.331+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563dd06194a0 con 0x563dd05e4530 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:24.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 20 get_user_info_from_index found 0 xattrs 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f47c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94823488898176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f5620 con 0x563dd05e4530 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94823488898176] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94823488874416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4480 con 0x7f4908027060 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94823488874416] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 20 remove_watcher() i=0 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 2 removed watcher, disabling cache 2024-09-12T17:11:24.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.335+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94823488878576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4480 con 0x563dd05e4530 2024-09-12T17:11:24.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94823488878576] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f49159e09c0 20 remove_watcher() i=1 2024-09-12T17:11:24.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94823488882720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05ef7f0 con 0x563dd05ea750 2024-09-12T17:11:24.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f4912ce5640 1 -- 172.21.15.193:0/3579736019 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94823488882720] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490805c040 con 0x563dd05ea750 2024-09-12T17:11:24.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f49159e09c0 20 remove_watcher() i=2 2024-09-12T17:11:24.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.339+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94823488880144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4480 con 0x7f4908027060 2024-09-12T17:11:24.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f4913ce7640 1 -- 172.21.15.193:0/3579736019 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94823488880144] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f490c040040 con 0x7f4908027060 2024-09-12T17:11:24.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f49159e09c0 20 remove_watcher() i=3 2024-09-12T17:11:24.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94823488887344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f0820 con 0x563dd05e4530 2024-09-12T17:11:24.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94823488887344] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x563dd05e4530 2024-09-12T17:11:24.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f49159e09c0 20 remove_watcher() i=4 2024-09-12T17:11:24.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.343+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94823488890912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05efe10 con 0x7f490c031040 2024-09-12T17:11:24.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94823488890912] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49159e09c0 20 remove_watcher() i=5 2024-09-12T17:11:24.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94823488884848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f4480 con 0x7f490c031040 2024-09-12T17:11:24.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94823488884848] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49159e09c0 20 remove_watcher() i=6 2024-09-12T17:11:24.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.347+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94823488895680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563dd05f1a30 con 0x7f490c031040 2024-09-12T17:11:24.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94823488895680] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49040e7040 con 0x7f490c031040 2024-09-12T17:11:24.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 20 remove_watcher() i=7 2024-09-12T17:11:24.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f490c031040 msgr2=0x7f490c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f490c031040 0x7f490c032430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd05e4530 msgr2=0x563dd05e69c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd05e4530 0x563dd05e69c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4908027060 msgr2=0x7f490801f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4908027060 0x7f490801f080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x563dd05ea750 msgr2=0x563dd05ecb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x563dd05ea750 0x563dd05ecb40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47dc039a70 msgr2=0x7f47dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47dc039a70 0x7f47dc03bf30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x563dd05ad140 tx=0x7f490c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 msgr2=0x563dd05d94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3579736019 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd05d2fb0 0x563dd05d94f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f490801bfd0 tx=0x7f490804ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 reap_dead start 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49134e6640 1 -- 172.21.15.193:0/3579736019 reap_dead start 2024-09-12T17:11:24.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 shutdown_connections 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 >> 172.21.15.193:0/3579736019 conn(0x563dd05ce3d0 msgr2=0x563dd05cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 shutdown_connections 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3579736019 wait complete. 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 msgr2=0x7f47ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 0x7f47ec03bf30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x563dd05b3e80 tx=0x7f490c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 msgr2=0x563dd04b7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f490800e670 tx=0x7f490800ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 shutdown_connections 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47ec039a70 0x7f47ec03bf30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/994179219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd04b9310 0x563dd04b7bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 >> 172.21.15.193:0/994179219 conn(0x563dd05b8df0 msgr2=0x563dd05b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 shutdown_connections 2024-09-12T17:11:24.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/994179219 wait complete. 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 msgr2=0x563dd05b2e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 0x563dd05b2e90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 msgr2=0x7f47f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 0x7f47f803bf30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4908001e90 tx=0x7f49080013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 msgr2=0x563dd05abd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4904018f70 tx=0x7f4904019b80 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 shutdown_connections 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x563dd04bc0f0 0x563dd05b2e90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f47f8039a70 0x7f47f803bf30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 --2- 172.21.15.193:0/3966863007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x563dd042d180 0x563dd05abd20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 >> 172.21.15.193:0/3966863007 conn(0x563dd04b38a0 msgr2=0x563dd059ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 shutdown_connections 2024-09-12T17:11:24.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.351+0000 7f49159e09c0 1 -- 172.21.15.193:0/3966863007 wait complete. 2024-09-12T17:11:24.367 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-12T17:11:24.368 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:24.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:24.368 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:24.446 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:24.446 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:24.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f780a07f9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556c15cd6350 0x556c15cd8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f780a07f9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c15b849c0 con 0x556c15cd2200 2024-09-12T17:11:24.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f780a07f9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556c15bd46d0 con 0x556c15cd6350 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807384640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556c15cd6350 0x556c15cd8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807384640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556c15cd6350 0x556c15cd8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50648/0 (socket says 172.21.15.193:50648) 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807b85640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556c15cd2200 0x556c15cd25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:35976/0 (socket says 172.21.15.193:35976) 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807384640 1 -- 172.21.15.193:0/2610087936 learned_addr learned my addr 172.21.15.193:0/2610087936 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807384640 1 -- 172.21.15.193:0/2610087936 >> v1:172.21.15.62:6789/0 conn(0x556c15cd2200 legacy=0x556c15cd25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.443+0000 7f7807384640 1 -- 172.21.15.193:0/2610087936 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15b78ca0 con 0x556c15cd6350 2024-09-12T17:11:24.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f7807384640 1 --2- 172.21.15.193:0/2610087936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd6350 0x556c15cd8740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a5c0 tx=0x7f77fc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34553019383dacda server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f7806b83640 1 -- 172.21.15.193:0/2610087936 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0a9590 con 0x556c15cd6350 2024-09-12T17:11:24.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f7806b83640 1 -- 172.21.15.193:0/2610087936 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc0ae070 con 0x556c15cd6350 2024-09-12T17:11:24.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f7806b83640 1 -- 172.21.15.193:0/2610087936 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0a9880 con 0x556c15cd6350 2024-09-12T17:11:24.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2610087936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd6350 msgr2=0x556c15cd8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2610087936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd6350 0x556c15cd8740 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00a5c0 tx=0x7f77fc01b3d0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2610087936 shutdown_connections 2024-09-12T17:11:24.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2610087936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd6350 0x556c15cd8740 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2610087936 >> 172.21.15.193:0/2610087936 conn(0x556c15c45b10 msgr2=0x556c15c45f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2610087936 shutdown_connections 2024-09-12T17:11:24.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.447+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2610087936 wait complete. 2024-09-12T17:11:24.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556c15bd8680 con 0x556c15cd2200 2024-09-12T17:11:24.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f7807b85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f7807b85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50650/0 (socket says 172.21.15.193:50650) 2024-09-12T17:11:24.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f7807b85640 1 -- 172.21.15.193:0/1131703966 learned_addr learned my addr 172.21.15.193:0/1131703966 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f7807b85640 1 -- 172.21.15.193:0/1131703966 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15b53da0 con 0x556c15cd2200 2024-09-12T17:11:24.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f7807b85640 1 --2- 172.21.15.193:0/1131703966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77f800b270 tx=0x7f77f800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6db6a94831f372 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f76f5e0b640 1 -- 172.21.15.193:0/1131703966 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f800e5d0 con 0x556c15cd2200 2024-09-12T17:11:24.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f76f5e0b640 1 -- 172.21.15.193:0/1131703966 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f800e770 con 0x556c15cd2200 2024-09-12T17:11:24.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f76f5e0b640 1 -- 172.21.15.193:0/1131703966 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f800ea70 con 0x556c15cd2200 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1131703966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 msgr2=0x556c15dbd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/1131703966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77f800b270 tx=0x7f77f800b670 comp rx=0 tx=0).stop 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1131703966 shutdown_connections 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/1131703966 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dbd8a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1131703966 >> 172.21.15.193:0/1131703966 conn(0x556c15c45b10 msgr2=0x556c15db94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1131703966 shutdown_connections 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.463+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1131703966 wait complete. 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556c15b7aa50 con 0x556c15cd2200 2024-09-12T17:11:24.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807b85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807b85640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50662/0 (socket says 172.21.15.193:50662) 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807b85640 1 -- 172.21.15.193:0/650201598 learned_addr learned my addr 172.21.15.193:0/650201598 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807b85640 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15dc54a0 con 0x556c15cd2200 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807b85640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x556c15dbe830 tx=0x7f77f8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 -- 172.21.15.193:0/650201598 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f800be70 con 0x556c15cd2200 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c15dc5730 con 0x556c15cd2200 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 -- 172.21.15.193:0/650201598 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f800f9f0 con 0x556c15cd2200 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 -- 172.21.15.193:0/650201598 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f800fcf0 con 0x556c15cd2200 2024-09-12T17:11:24.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c15dc60e0 con 0x556c15cd2200 2024-09-12T17:11:24.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 -- 172.21.15.193:0/650201598 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77f8017070 con 0x556c15cd2200 2024-09-12T17:11:24.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 0x7f76f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f76effff640 1 -- 172.21.15.193:0/650201598 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f77f8015020 con 0x556c15cd2200 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7807384640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 0x7f76f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 0x556c15dcc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dcc5f0 con 0x556c15cd6350 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.467+0000 7f7808386640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 0x556c15dcc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7807384640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 0x7f76f003bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ad000 tx=0x7f77fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 0x556c15dcc0b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 -- 172.21.15.193:0/650201598 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f780000a4d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dc64f0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 -- 172.21.15.193:0/650201598 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f780000a4d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dce3d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 -- 172.21.15.193:0/650201598 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f780000a4d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dcd600 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 -- 172.21.15.193:0/650201598 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f780000a4d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dcda50 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7808386640 1 -- 172.21.15.193:0/650201598 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f780000a4d0 con 0x556c15cd6350 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f780a07f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556c15be5450 con 0x556c15ddc6b0 2024-09-12T17:11:24.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50664/0 (socket says 172.21.15.193:50664) 2024-09-12T17:11:24.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7807384640 1 -- 172.21.15.193:0/2942140575 learned_addr learned my addr 172.21.15.193:0/2942140575 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.471+0000 7f7807384640 1 -- 172.21.15.193:0/2942140575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15ddd110 con 0x556c15ddc6b0 2024-09-12T17:11:24.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7807384640 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ab040 tx=0x7f77fc018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 -- 172.21.15.193:0/2942140575 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0b3ba0 con 0x556c15ddc6b0 2024-09-12T17:11:24.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 -- 172.21.15.193:0/2942140575 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc0b3d40 con 0x556c15ddc6b0 2024-09-12T17:11:24.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 -- 172.21.15.193:0/2942140575 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0c8580 con 0x556c15ddc6b0 2024-09-12T17:11:24.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c15ddd970 con 0x556c15ddc6b0 2024-09-12T17:11:24.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c15ddde80 con 0x556c15ddc6b0 2024-09-12T17:11:24.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 -- 172.21.15.193:0/2942140575 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77fc0d1440 con 0x556c15ddc6b0 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 0x7f76e003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f76ed7fa640 1 -- 172.21.15.193:0/2942140575 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f77fc0edcb0 con 0x556c15ddc6b0 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7808386640 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 0x7f76e003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7808386640 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 0x7f76e003bf80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x556c15dcd120 tx=0x7f7800005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f780a07f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556c15dbe0f0 con 0x556c15de8ef0 2024-09-12T17:11:24.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50680/0 (socket says 172.21.15.193:50680) 2024-09-12T17:11:24.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7807384640 1 -- 172.21.15.193:0/1679064835 learned_addr learned my addr 172.21.15.193:0/1679064835 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.475+0000 7f7807384640 1 -- 172.21.15.193:0/1679064835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15de98a0 con 0x556c15de8ef0 2024-09-12T17:11:24.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 --2- 172.21.15.193:0/1679064835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0c7400 tx=0x7f77fc0c7430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1544caac5b8927 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e6ffd640 1 -- 172.21.15.193:0/1679064835 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0bccd0 con 0x556c15de8ef0 2024-09-12T17:11:24.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e6ffd640 1 -- 172.21.15.193:0/1679064835 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc0be410 con 0x556c15de8ef0 2024-09-12T17:11:24.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e6ffd640 1 -- 172.21.15.193:0/1679064835 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0bc3b0 con 0x556c15de8ef0 2024-09-12T17:11:24.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1679064835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 msgr2=0x556c15de92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/1679064835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0c7400 tx=0x7f77fc0c7430 comp rx=0 tx=0).stop 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1679064835 shutdown_connections 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/1679064835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15de92d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1679064835 >> 172.21.15.193:0/1679064835 conn(0x556c15de5320 msgr2=0x556c15de3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1679064835 shutdown_connections 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/1679064835 wait complete. 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 Processor -- start 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- start start 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556c15de9f00 con 0x556c15de8ef0 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50690/0 (socket says 172.21.15.193:50690) 2024-09-12T17:11:24.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 learned_addr learned my addr 172.21.15.193:0/172812488 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c15df0920 con 0x556c15de8ef0 2024-09-12T17:11:24.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f7807384640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0c7af0 tx=0x7f77fc0ebf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e57fa640 1 -- 172.21.15.193:0/172812488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0f2070 con 0x556c15de8ef0 2024-09-12T17:11:24.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e57fa640 1 -- 172.21.15.193:0/172812488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77fc0bc870 con 0x556c15de8ef0 2024-09-12T17:11:24.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c15df0bb0 con 0x556c15de8ef0 2024-09-12T17:11:24.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f76e57fa640 1 -- 172.21.15.193:0/172812488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77fc0bf8f0 con 0x556c15de8ef0 2024-09-12T17:11:24.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.479+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c15df1560 con 0x556c15de8ef0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f76e57fa640 1 -- 172.21.15.193:0/172812488 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f77fc0f5070 con 0x556c15de8ef0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f76e57fa640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76d0039ac0 0x7f76d003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f76e57fa640 1 -- 172.21.15.193:0/172812488 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f77fc0f8c80 con 0x556c15de8ef0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7808386640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76d0039ac0 0x7f76d003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15dfb6f0 0x556c15dfdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dfe2b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15dfb6f0 0x556c15dfdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7808386640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76d0039ac0 0x7f76d003bf80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x556c15dc6450 tx=0x7f780001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15dfb6f0 0x556c15dfdb60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 realm 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dfe6c0 con 0x556c15dfb6f0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dfef90 con 0x556c15dfb6f0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dff330 con 0x556c15dfb6f0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dff7d0 con 0x556c15dfb6f0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 20 searching for the correct realm 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556c15e01740 0x556c15e03b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807384640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556c15e01740 0x556c15e03b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.483+0000 7f7807384640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556c15e01740 0x556c15e03b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc0f4030 con 0x556c15e01740 2024-09-12T17:11:24.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807384640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f77fc0f7060 0x7f77fc0e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7808386640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f77fc0f7060 0x7f77fc0e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7808386640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f77fc0f7060 0x7f77fc0e90d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7808386640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7800031040 0x7f7800032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7800031040 0x7f7800032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7800031040 0x7f7800032430 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f802e070 con 0x7f7800031040 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.487+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f802e070 con 0x7f7800031040 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f802e070 con 0x7f7800031040 2024-09-12T17:11:24.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f77f802e070 con 0x556c15dfb6f0 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.491+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.495+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15e01740 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c15e041b0 con 0x7f77fc0f7060 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f780001f070 con 0x7f77fc0f7060 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e001b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15dffdf0 con 0x556c15dfb6f0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e00b90 con 0x556c15dfb6f0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 zone default found 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 4 Realm: () 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:24.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 zonegroup default 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e04610 con 0x7f7800031040 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e06180 con 0x556c15e01740 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.499+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e06650 con 0x556c15e01740 2024-09-12T17:11:24.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 20 started sync module instance, tier type = 2024-09-12T17:11:24.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:24.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e054a0 con 0x7f77fc0f7060 2024-09-12T17:11:24.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93922711853200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e06f60 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e077b0 con 0x556c15dfb6f0 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93922711853200] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.503+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93922711857840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e074a0 con 0x556c15dfb6f0 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e07f90 con 0x556c15e01740 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93922711861856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e08830 con 0x556c15e01740 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e09230 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93922711857840] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93922711858960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e09620 con 0x7f77fc0f7060 2024-09-12T17:11:24.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.507+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e09fe0 con 0x556c15dfb6f0 2024-09-12T17:11:24.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93922711861856] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93922711858960] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93922711866688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e09b30 con 0x556c15dfb6f0 2024-09-12T17:11:24.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0a380 con 0x7f7800031040 2024-09-12T17:11:24.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.511+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93922711866688] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93922711870256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0a770 con 0x7f7800031040 2024-09-12T17:11:24.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0afc0 con 0x7f7800031040 2024-09-12T17:11:24.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93922711870256] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93922711871312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0ac20 con 0x7f7800031040 2024-09-12T17:11:24.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.515+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b660 con 0x7f7800031040 2024-09-12T17:11:24.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93922711871312] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93922711875888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b840 con 0x7f7800031040 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=0 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=1 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=2 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=3 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=4 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=5 2024-09-12T17:11:24.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=6 2024-09-12T17:11:24.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93922711875888] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 20 add_watcher() i=7 2024-09-12T17:11:24.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:24.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0ec10 con 0x556c15dfb6f0 2024-09-12T17:11:24.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.519+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93922711877424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0c000 con 0x556c15dfb6f0 2024-09-12T17:11:24.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93922711877424] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f76bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:24.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 5 note: GC not initialized 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f76bcfe1640 20 reqs_thread_entry: start 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 Filter name: none 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f76367fc640 20 reqs_thread_entry: start 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c15e31830 con 0x556c15dfb6f0 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:24.528 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:24.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f76bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.523+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93922711877424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e30680 con 0x556c15dfb6f0 2024-09-12T17:11:24.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93922711877424] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93922711853200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b730 con 0x7f77fc0f7060 2024-09-12T17:11:24.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93922711853200] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 20 remove_watcher() i=0 2024-09-12T17:11:24.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 2 removed watcher, disabling cache 2024-09-12T17:11:24.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93922711857840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b730 con 0x556c15dfb6f0 2024-09-12T17:11:24.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93922711857840] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 20 remove_watcher() i=1 2024-09-12T17:11:24.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.527+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93922711861856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e06ab0 con 0x556c15e01740 2024-09-12T17:11:24.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f7807384640 1 -- 172.21.15.193:0/172812488 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93922711861856] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77fc106040 con 0x556c15e01740 2024-09-12T17:11:24.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f780a07f9c0 20 remove_watcher() i=2 2024-09-12T17:11:24.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93922711858960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b730 con 0x7f77fc0f7060 2024-09-12T17:11:24.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f7808386640 1 -- 172.21.15.193:0/172812488 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93922711858960] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7800040040 con 0x7f77fc0f7060 2024-09-12T17:11:24.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f780a07f9c0 20 remove_watcher() i=3 2024-09-12T17:11:24.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.531+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93922711866688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e07a60 con 0x556c15dfb6f0 2024-09-12T17:11:24.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93922711866688] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x556c15dfb6f0 2024-09-12T17:11:24.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f780a07f9c0 20 remove_watcher() i=4 2024-09-12T17:11:24.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93922711870256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b730 con 0x7f7800031040 2024-09-12T17:11:24.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93922711870256] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f780a07f9c0 20 remove_watcher() i=5 2024-09-12T17:11:24.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.535+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93922711871312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e07a60 con 0x7f7800031040 2024-09-12T17:11:24.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93922711871312] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 20 remove_watcher() i=6 2024-09-12T17:11:24.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93922711875888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c15e0b730 con 0x7f7800031040 2024-09-12T17:11:24.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93922711875888] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77f8054040 con 0x7f7800031040 2024-09-12T17:11:24.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 20 remove_watcher() i=7 2024-09-12T17:11:24.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7800031040 msgr2=0x7f7800032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7800031040 0x7f7800032430 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.539+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15dfb6f0 msgr2=0x556c15dfdb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15dfb6f0 0x556c15dfdb60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f77fc0f7060 msgr2=0x7f77fc0e90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f77fc0f7060 0x7f77fc0e90d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556c15e01740 msgr2=0x556c15e03b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556c15e01740 0x556c15e03b30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76d0039ac0 msgr2=0x7f76d003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76d0039ac0 0x7f76d003bf80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x556c15dc6450 tx=0x7f780001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 msgr2=0x556c15df03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f7807b85640 1 -- 172.21.15.193:0/172812488 reap_dead start 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0c7af0 tx=0x7f77fc0ebf90 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 shutdown_connections 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/172812488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15de8ef0 0x556c15df03c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 >> 172.21.15.193:0/172812488 conn(0x556c15de5320 msgr2=0x556c15de3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 shutdown_connections 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/172812488 wait complete. 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 msgr2=0x7f76e003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 0x7f76e003bf80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x556c15dcd120 tx=0x7f7800005850 comp rx=0 tx=0).stop 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 msgr2=0x556c15ddcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ab040 tx=0x7f77fc018170 comp rx=0 tx=0).stop 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 shutdown_connections 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76e0039ac0 0x7f76e003bf80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/2942140575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15ddc6b0 0x556c15ddcad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 >> 172.21.15.193:0/2942140575 conn(0x556c15dd2060 msgr2=0x556c15dd2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 shutdown_connections 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/2942140575 wait complete. 2024-09-12T17:11:24.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 msgr2=0x556c15dcc0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 0x556c15dcc0b0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 msgr2=0x7f76f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 0x7f76f003bf30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0ad000 tx=0x7f77fc0a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 msgr2=0x556c15dc4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x556c15dbe830 tx=0x7f77f8000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 shutdown_connections 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556c15cd6350 0x556c15dcc0b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f76f0039a70 0x7f76f003bf30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 --2- 172.21.15.193:0/650201598 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556c15cd2200 0x556c15dc4f40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 >> 172.21.15.193:0/650201598 conn(0x556c15c45b10 msgr2=0x556c15db7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 shutdown_connections 2024-09-12T17:11:24.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.543+0000 7f780a07f9c0 1 -- 172.21.15.193:0/650201598 wait complete. 2024-09-12T17:11:24.558 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:24.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T17:11:24.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T17:11:24.558 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T17:11:24.639 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:24.640 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:24.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d54349c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c39e3f55e0 0x55c39e489760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d54349c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c39e3359c0 con 0x55c39e3f5200 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d54349c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c39e3856d0 con 0x55c39e3f55e0 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d2739640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c39e3f55e0 0x55c39e489760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d2739640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c39e3f55e0 0x55c39e489760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50700/0 (socket says 172.21.15.193:50700) 2024-09-12T17:11:24.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.635+0000 7f90d2739640 1 -- 172.21.15.193:0/1304826262 learned_addr learned my addr 172.21.15.193:0/1304826262 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d2739640 1 -- 172.21.15.193:0/1304826262 >> v1:172.21.15.62:6789/0 conn(0x55c39e3f5200 legacy=0x55c39e486030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d2739640 1 -- 172.21.15.193:0/1304826262 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e329ca0 con 0x55c39e3f55e0 2024-09-12T17:11:24.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d2739640 1 --2- 172.21.15.193:0/1304826262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f55e0 0x55c39e489760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00a5c0 tx=0x7f90bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c996fa0b879b8918 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d1f38640 1 -- 172.21.15.193:0/1304826262 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0a6070 con 0x55c39e3f55e0 2024-09-12T17:11:24.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d1f38640 1 -- 172.21.15.193:0/1304826262 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0af070 con 0x55c39e3f55e0 2024-09-12T17:11:24.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d1f38640 1 -- 172.21.15.193:0/1304826262 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0aa5c0 con 0x55c39e3f55e0 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 -- 172.21.15.193:0/1304826262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f55e0 msgr2=0x55c39e489760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1304826262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f55e0 0x55c39e489760 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00a5c0 tx=0x7f90bc01b340 comp rx=0 tx=0).stop 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 -- 172.21.15.193:0/1304826262 shutdown_connections 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1304826262 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f55e0 0x55c39e489760 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 -- 172.21.15.193:0/1304826262 >> 172.21.15.193:0/1304826262 conn(0x55c39e47b920 msgr2=0x55c39e47dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 -- 172.21.15.193:0/1304826262 shutdown_connections 2024-09-12T17:11:24.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.639+0000 7f90d54349c0 1 -- 172.21.15.193:0/1304826262 wait complete. 2024-09-12T17:11:24.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.655+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.655+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.655+0000 7f90d54349c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.655+0000 7f90d54349c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c39e389680 con 0x55c39e3f5200 2024-09-12T17:11:24.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50706/0 (socket says 172.21.15.193:50706) 2024-09-12T17:11:24.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 -- 172.21.15.193:0/1756241306 learned_addr learned my addr 172.21.15.193:0/1756241306 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 -- 172.21.15.193:0/1756241306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e304da0 con 0x55c39e3f5200 2024-09-12T17:11:24.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/1756241306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90c4001690 tx=0x7f90c4001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa69f3c3fa607ea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f8fc0e09640 1 -- 172.21.15.193:0/1756241306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c4016070 con 0x55c39e3f5200 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f8fc0e09640 1 -- 172.21.15.193:0/1756241306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c400f640 con 0x55c39e3f5200 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f8fc0e09640 1 -- 172.21.15.193:0/1756241306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c400f960 con 0x55c39e3f5200 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- 172.21.15.193:0/1756241306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 msgr2=0x55c39e56e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1756241306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f90c4001690 tx=0x7f90c4001b50 comp rx=0 tx=0).stop 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- 172.21.15.193:0/1756241306 shutdown_connections 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1756241306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e56e900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- 172.21.15.193:0/1756241306 >> 172.21.15.193:0/1756241306 conn(0x55c39e47b920 msgr2=0x55c39e56a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- 172.21.15.193:0/1756241306 shutdown_connections 2024-09-12T17:11:24.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- 172.21.15.193:0/1756241306 wait complete. 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d54349c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c39e32ba50 con 0x55c39e3f5200 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50708/0 (socket says 172.21.15.193:50708) 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 -- 172.21.15.193:0/349876513 learned_addr learned my addr 172.21.15.193:0/349876513 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.659+0000 7f90d2f3a640 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e576580 con 0x55c39e3f5200 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55c39e56f890 tx=0x7f90c4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 -- 172.21.15.193:0/349876513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c4021020 con 0x55c39e3f5200 2024-09-12T17:11:24.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39e576810 con 0x55c39e3f5200 2024-09-12T17:11:24.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 -- 172.21.15.193:0/349876513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c4011650 con 0x55c39e3f5200 2024-09-12T17:11:24.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 -- 172.21.15.193:0/349876513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c4016040 con 0x55c39e3f5200 2024-09-12T17:11:24.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39e5771c0 con 0x55c39e3f5200 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 -- 172.21.15.193:0/349876513 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90c4024020 con 0x55c39e3f5200 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 0x7f8fb803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f8fbf606640 1 -- 172.21.15.193:0/349876513 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f90c404fc20 con 0x55c39e3f5200 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d2739640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 0x7f8fb803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 0x55c39e57d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e57d6d0 con 0x55c39e3f55e0 2024-09-12T17:11:24.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d373b640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 0x55c39e57d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d2739640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 0x7f8fb803bf80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ae000 tx=0x7f90bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d373b640 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 0x55c39e57d190 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d373b640 1 -- 172.21.15.193:0/349876513 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90cc0083f0 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e57db00 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d373b640 1 -- 172.21.15.193:0/349876513 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90cc0083f0 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.663+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e57f400 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d373b640 1 -- 172.21.15.193:0/349876513 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f90cc0083f0 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e57e630 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d373b640 1 -- 172.21.15.193:0/349876513 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90cc0083f0 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e57ea80 con 0x55c39e3f55e0 2024-09-12T17:11:24.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d373b640 1 -- 172.21.15.193:0/349876513 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90cc0083f0 con 0x55c39e3f55e0 2024-09-12T17:11:24.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c39e396450 con 0x55c39e58d710 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50712/0 (socket says 172.21.15.193:50712) 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d2739640 1 -- 172.21.15.193:0/3341083249 learned_addr learned my addr 172.21.15.193:0/3341083249 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d2739640 1 -- 172.21.15.193:0/3341083249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e58e170 con 0x55c39e58d710 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d2739640 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f90bc01b8b0 tx=0x7f90bc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f8fbce01640 1 -- 172.21.15.193:0/3341083249 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0b3bc0 con 0x55c39e58d710 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f8fbce01640 1 -- 172.21.15.193:0/3341083249 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0b3d60 con 0x55c39e58d710 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39e58e9d0 con 0x55c39e58d710 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f8fbce01640 1 -- 172.21.15.193:0/3341083249 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0c8560 con 0x55c39e58d710 2024-09-12T17:11:24.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.667+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39e58eee0 con 0x55c39e58d710 2024-09-12T17:11:24.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fbce01640 1 -- 172.21.15.193:0/3341083249 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90bc0d1440 con 0x55c39e58d710 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fbce01640 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 0x7f8fac03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fbce01640 1 -- 172.21.15.193:0/3341083249 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f90bc0edbf0 con 0x55c39e58d710 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d373b640 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 0x7f8fac03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d373b640 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 0x7f8fac03bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55c39e57e150 tx=0x7f90cc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c39e56f150 con 0x55c39e59af40 2024-09-12T17:11:24.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50724/0 (socket says 172.21.15.193:50724) 2024-09-12T17:11:24.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d2739640 1 -- 172.21.15.193:0/1164572074 learned_addr learned my addr 172.21.15.193:0/1164572074 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d2739640 1 -- 172.21.15.193:0/1164572074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e59b930 con 0x55c39e59af40 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d2739640 1 --2- 172.21.15.193:0/1164572074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0bda10 tx=0x7f90bc0bd6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4958a7ca117e3039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fb67fc640 1 -- 172.21.15.193:0/1164572074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0be410 con 0x55c39e59af40 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fb67fc640 1 -- 172.21.15.193:0/1164572074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0c73d0 con 0x55c39e59af40 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f8fb67fc640 1 -- 172.21.15.193:0/1164572074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0be5b0 con 0x55c39e59af40 2024-09-12T17:11:24.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- 172.21.15.193:0/1164572074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 msgr2=0x55c39e59b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1164572074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0bda10 tx=0x7f90bc0bd6f0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- 172.21.15.193:0/1164572074 shutdown_connections 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 --2- 172.21.15.193:0/1164572074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e59b340 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- 172.21.15.193:0/1164572074 >> 172.21.15.193:0/1164572074 conn(0x55c39e596360 msgr2=0x55c39e5945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- 172.21.15.193:0/1164572074 shutdown_connections 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.671+0000 7f90d54349c0 1 -- 172.21.15.193:0/1164572074 wait complete. 2024-09-12T17:11:24.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 Processor -- start 2024-09-12T17:11:24.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 -- start start 2024-09-12T17:11:24.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c39e599e90 con 0x55c39e59af40 2024-09-12T17:11:24.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d2739640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50732/0 (socket says 172.21.15.193:50732) 2024-09-12T17:11:24.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 learned_addr learned my addr 172.21.15.193:0/3613994722 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39e5a1a30 con 0x55c39e59af40 2024-09-12T17:11:24.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d2739640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0bd550 tx=0x7f90bc0c6f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f8fb4ff9640 1 -- 172.21.15.193:0/3613994722 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0f2070 con 0x55c39e59af40 2024-09-12T17:11:24.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39e5a1cc0 con 0x55c39e59af40 2024-09-12T17:11:24.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f8fb4ff9640 1 -- 172.21.15.193:0/3613994722 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc0c6c30 con 0x55c39e59af40 2024-09-12T17:11:24.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f8fb4ff9640 1 -- 172.21.15.193:0/3613994722 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0c77b0 con 0x55c39e59af40 2024-09-12T17:11:24.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39e5a2670 con 0x55c39e59af40 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f8fb4ff9640 1 -- 172.21.15.193:0/3613994722 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f90bc0f5070 con 0x55c39e59af40 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f8fb4ff9640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8f9c039a70 0x7f8f9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.675+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f8fb4ff9640 1 -- 172.21.15.193:0/3613994722 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f90bc0f8c80 con 0x55c39e59af40 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d373b640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8f9c039a70 0x7f8f9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e5ac660 0x55c39e5aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5af240 con 0x55c39e5ac660 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e5ac660 0x55c39e5aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d373b640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8f9c039a70 0x7f8f9c03bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00f010 tx=0x7f90cc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e5ac660 0x55c39e5aeaf0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 realm 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5af650 con 0x55c39e5ac660 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5aff20 con 0x55c39e5ac660 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b02c0 con 0x55c39e5ac660 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b0b10 con 0x55c39e5ac660 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 20 searching for the correct realm 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c39e5b2880 0x55c39e5b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2739640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c39e5b2880 0x55c39e5b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2739640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c39e5b2880 0x55c39e5b4c70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2739640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f90bc0f7060 0x7f90bc0e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d373b640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f90bc0f7060 0x7f90bc0e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.679+0000 7f90d373b640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f90bc0f7060 0x7f90bc0e6a70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d373b640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f90cc019040 0x7f90cc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f90cc019040 0x7f90cc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f90cc019040 0x7f90cc019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.683+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.687+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.691+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5b2880 2024-09-12T17:11:24.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90cc019040 2024-09-12T17:11:24.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x55c39e5ac660 2024-09-12T17:11:24.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b51b0 con 0x7f90bc0f7060 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b14f0 con 0x55c39e5ac660 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b1d90 con 0x55c39e5ac660 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b5550 con 0x55c39e5ac660 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 zone default found 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 4 Realm: () 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:24.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 zonegroup default 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b19e0 con 0x7f90cc019040 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b7940 con 0x55c39e5b2880 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b7ce0 con 0x55c39e5b2880 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.695+0000 7f90d54349c0 20 started sync module instance, tier type = 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b6dd0 con 0x7f90bc0f7060 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298663776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b6a30 con 0x7f90bc0f7060 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b8c10 con 0x55c39e5ac660 2024-09-12T17:11:24.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298663776704] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298663780672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b8c10 con 0x55c39e5ac660 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.699+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b95d0 con 0x55c39e5b2880 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298663784736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5b9e70 con 0x55c39e5b2880 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5ba870 con 0x7f90bc0f7060 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298663780672] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298663782240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bac60 con 0x7f90bc0f7060 2024-09-12T17:11:24.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bb620 con 0x55c39e5ac660 2024-09-12T17:11:24.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.703+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298663784736] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298663782240] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298663789440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bb170 con 0x55c39e5ac660 2024-09-12T17:11:24.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bbec0 con 0x7f90cc019040 2024-09-12T17:11:24.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298663789440] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298663786944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bb170 con 0x7f90cc019040 2024-09-12T17:11:24.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.707+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bc310 con 0x7f90cc019040 2024-09-12T17:11:24.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.711+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.711+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298663796224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bc780 con 0x7f90cc019040 2024-09-12T17:11:24.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.711+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bd270 con 0x7f90cc019040 2024-09-12T17:11:24.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.711+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298663786944] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298663796224] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298663800128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bc2d0 con 0x7f90cc019040 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=0 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=1 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=2 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=3 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=4 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=5 2024-09-12T17:11:24.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=6 2024-09-12T17:11:24.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298663800128] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 20 add_watcher() i=7 2024-09-12T17:11:24.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:24.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5c0370 con 0x55c39e5ac660 2024-09-12T17:11:24.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.715+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298663794480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5bd7f0 con 0x55c39e5ac660 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298663794480] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f8f897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 5 note: GC not initialized 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f8f03fff640 20 reqs_thread_entry: start 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 Filter name: none 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f8f01ffb640 20 reqs_thread_entry: start 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:24.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e3270 con 0x55c39e5ac660 2024-09-12T17:11:24.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e5d00 con 0x7f90bc0f7060 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e9430 con 0x55c39e5ac660 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.719+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94298663980768 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e8000 con 0x55c39e5ac660 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94298663789440 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f90c4045040 con 0x55c39e5ac660 2024-09-12T17:11:24.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f8fb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94298663789440 notifier 4314 bl.length()=567 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(65 notify.4 [notify cookie 94298663980768 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f8fb67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f8fb67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f8fb67fc640 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8f98003eb0 con 0x55c39e5ac660 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94298663980768 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c39e5771c0 con 0x55c39e5ac660 2024-09-12T17:11:24.727 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:24.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f8f897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298663794480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e8000 con 0x55c39e5ac660 2024-09-12T17:11:24.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94298663794480] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.723+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298663776704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e8000 con 0x7f90bc0f7060 2024-09-12T17:11:24.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94298663776704] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d54349c0 20 remove_watcher() i=0 2024-09-12T17:11:24.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d54349c0 2 removed watcher, disabling cache 2024-09-12T17:11:24.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298663780672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e8000 con 0x55c39e5ac660 2024-09-12T17:11:24.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94298663780672] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d54349c0 20 remove_watcher() i=1 2024-09-12T17:11:24.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.727+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298663784736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e8000 con 0x55c39e5b2880 2024-09-12T17:11:24.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d2739640 1 -- 172.21.15.193:0/3613994722 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94298663784736] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90bc0f4030 con 0x55c39e5b2880 2024-09-12T17:11:24.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d54349c0 20 remove_watcher() i=2 2024-09-12T17:11:24.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298663782240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e1080 con 0x7f90bc0f7060 2024-09-12T17:11:24.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d373b640 1 -- 172.21.15.193:0/3613994722 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94298663782240] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90cc02f040 con 0x7f90bc0f7060 2024-09-12T17:11:24.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d54349c0 20 remove_watcher() i=3 2024-09-12T17:11:24.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.731+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298663789440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e1080 con 0x55c39e5ac660 2024-09-12T17:11:24.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94298663789440] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x55c39e5ac660 2024-09-12T17:11:24.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d54349c0 20 remove_watcher() i=4 2024-09-12T17:11:24.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298663786944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e1080 con 0x7f90cc019040 2024-09-12T17:11:24.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94298663786944] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d54349c0 20 remove_watcher() i=5 2024-09-12T17:11:24.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.735+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298663796224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e1080 con 0x7f90cc019040 2024-09-12T17:11:24.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94298663796224] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 20 remove_watcher() i=6 2024-09-12T17:11:24.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298663800128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c39e5e1080 con 0x7f90cc019040 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94298663800128] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f90c400f070 con 0x7f90cc019040 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 20 remove_watcher() i=7 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f90cc019040 msgr2=0x7f90cc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f90cc019040 0x7f90cc019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e5ac660 msgr2=0x55c39e5aeaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e5ac660 0x55c39e5aeaf0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f90bc0f7060 msgr2=0x7f90bc0e6a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f90bc0f7060 0x7f90bc0e6a70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c39e5b2880 msgr2=0x55c39e5b4c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c39e5b2880 0x55c39e5b4c70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8f9c039a70 msgr2=0x7f8f9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8f9c039a70 0x7f8f9c03bf30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00f010 tx=0x7f90cc01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d2f3a640 1 -- 172.21.15.193:0/3613994722 reap_dead start 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 msgr2=0x55c39e5a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0bd550 tx=0x7f90bc0c6f90 comp rx=0 tx=0).stop 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 shutdown_connections 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3613994722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e59af40 0x55c39e5a14d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 >> 172.21.15.193:0/3613994722 conn(0x55c39e596360 msgr2=0x55c39e594570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 shutdown_connections 2024-09-12T17:11:24.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3613994722 wait complete. 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 msgr2=0x7f8fac03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 0x7f8fac03bf80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55c39e57e150 tx=0x7f90cc003070 comp rx=0 tx=0).stop 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 msgr2=0x55c39e58db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f90bc01b8b0 tx=0x7f90bc0180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 shutdown_connections 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fac039ac0 0x7f8fac03bf80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 --2- 172.21.15.193:0/3341083249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e58d710 0x55c39e58db30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 >> 172.21.15.193:0/3341083249 conn(0x55c39e5830c0 msgr2=0x55c39e5834a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 shutdown_connections 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.739+0000 7f90d54349c0 1 -- 172.21.15.193:0/3341083249 wait complete. 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 msgr2=0x55c39e57d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 0x55c39e57d190 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 msgr2=0x7f8fb803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 0x7f8fb803bf80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ae000 tx=0x7f90bc0a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 msgr2=0x55c39e576020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55c39e56f890 tx=0x7f90c4001260 comp rx=0 tx=0).stop 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 shutdown_connections 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c39e3f55e0 0x55c39e57d190 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8fb8039ac0 0x7f8fb803bf80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 --2- 172.21.15.193:0/349876513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c39e3f5200 0x55c39e576020 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 >> 172.21.15.193:0/349876513 conn(0x55c39e47b920 msgr2=0x55c39e568fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 shutdown_connections 2024-09-12T17:11:24.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.743+0000 7f90d54349c0 1 -- 172.21.15.193:0/349876513 wait complete. 2024-09-12T17:11:24.757 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:24.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:24.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:24.757 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:24.833 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:24.833 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:24.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26ffbc29c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559c30acffa0 0x559c30ad0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26ffbc29c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c30a0d9c0 con 0x559c30ad30e0 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26ffbc29c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559c30a5d6d0 con 0x559c30acffa0 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26fd6c8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559c30acffa0 0x559c30ad0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26fd6c8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559c30acffa0 0x559c30ad0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50738/0 (socket says 172.21.15.193:50738) 2024-09-12T17:11:24.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26fd6c8640 1 -- 172.21.15.193:0/999158216 learned_addr learned my addr 172.21.15.193:0/999158216 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26fd6c8640 1 -- 172.21.15.193:0/999158216 >> v1:172.21.15.62:6789/0 conn(0x559c30ad30e0 legacy=0x559c30ad34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.831+0000 7f26fd6c8640 1 -- 172.21.15.193:0/999158216 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30a01ca0 con 0x559c30acffa0 2024-09-12T17:11:24.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/999158216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30ad0380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26f400a5c0 tx=0x7f26f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c20121beaa23ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26effff640 1 -- 172.21.15.193:0/999158216 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40af070 con 0x559c30acffa0 2024-09-12T17:11:24.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26effff640 1 -- 172.21.15.193:0/999158216 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f40aa530 con 0x559c30acffa0 2024-09-12T17:11:24.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26effff640 1 -- 172.21.15.193:0/999158216 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40aa830 con 0x559c30acffa0 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/999158216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 msgr2=0x559c30ad0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/999158216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30ad0380 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f26f400a5c0 tx=0x7f26f401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/999158216 shutdown_connections 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/999158216 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30ad0380 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/999158216 >> 172.21.15.193:0/999158216 conn(0x559c30aceb10 msgr2=0x559c30acef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/999158216 shutdown_connections 2024-09-12T17:11:24.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.835+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/999158216 wait complete. 2024-09-12T17:11:24.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559c30a61680 con 0x559c30acffa0 2024-09-12T17:11:24.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26fd6c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26fd6c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50742/0 (socket says 172.21.15.193:50742) 2024-09-12T17:11:24.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26fd6c8640 1 -- 172.21.15.193:0/838409340 learned_addr learned my addr 172.21.15.193:0/838409340 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26fd6c8640 1 -- 172.21.15.193:0/838409340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c309dcda0 con 0x559c30acffa0 2024-09-12T17:11:24.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/838409340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26f4017f50 tx=0x7f26f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18912ad8e2e3c894 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f25eb606640 1 -- 172.21.15.193:0/838409340 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40af040 con 0x559c30acffa0 2024-09-12T17:11:24.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f25eb606640 1 -- 172.21.15.193:0/838409340 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f40aa9d0 con 0x559c30acffa0 2024-09-12T17:11:24.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f25eb606640 1 -- 172.21.15.193:0/838409340 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40aacf0 con 0x559c30acffa0 2024-09-12T17:11:24.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/838409340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 msgr2=0x559c30c4b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/838409340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f26f4017f50 tx=0x7f26f4003030 comp rx=0 tx=0).stop 2024-09-12T17:11:24.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/838409340 shutdown_connections 2024-09-12T17:11:24.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/838409340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c4b340 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/838409340 >> 172.21.15.193:0/838409340 conn(0x559c30aceb10 msgr2=0x559c30c46f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/838409340 shutdown_connections 2024-09-12T17:11:24.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.851+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/838409340 wait complete. 2024-09-12T17:11:24.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559c30a03a50 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fd6c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fd6c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50754/0 (socket says 172.21.15.193:50754) 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1511825375 learned_addr learned my addr 172.21.15.193:0/1511825375 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30c52dd0 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26f40b7040 tx=0x7f26f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 -- 172.21.15.193:0/1511825375 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40c3020 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c30c53060 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 -- 172.21.15.193:0/1511825375 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f40b5b30 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c30c53a10 con 0x559c30acffa0 2024-09-12T17:11:24.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 -- 172.21.15.193:0/1511825375 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f40af070 con 0x559c30acffa0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 -- 172.21.15.193:0/1511825375 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26f40c6020 con 0x559c30acffa0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 0x7f25e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f25e9e03640 1 -- 172.21.15.193:0/1511825375 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f26f40ba070 con 0x559c30acffa0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 0x7f25e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 0x559c30c599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.855+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c59f20 con 0x559c30ad30e0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 0x559c30c599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 0x7f25e403bf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26f0001e60 tx=0x7f26f00013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 0x559c30c599e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 -- 172.21.15.193:0/1511825375 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26f800a4d0 con 0x559c30ad30e0 2024-09-12T17:11:24.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c5a350 con 0x559c30ad30e0 2024-09-12T17:11:24.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 -- 172.21.15.193:0/1511825375 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26f800a4d0 con 0x559c30ad30e0 2024-09-12T17:11:24.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c5bc50 con 0x559c30ad30e0 2024-09-12T17:11:24.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 -- 172.21.15.193:0/1511825375 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26f800a4d0 con 0x559c30ad30e0 2024-09-12T17:11:24.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c5ae80 con 0x559c30ad30e0 2024-09-12T17:11:24.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 -- 172.21.15.193:0/1511825375 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26f800a4d0 con 0x559c30ad30e0 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c5b2a0 con 0x559c30ad30e0 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fdec9640 1 -- 172.21.15.193:0/1511825375 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f26f800a4d0 con 0x559c30ad30e0 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26ffbc29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559c30a6e450 con 0x559c30c69fb0 2024-09-12T17:11:24.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50760/0 (socket says 172.21.15.193:50760) 2024-09-12T17:11:24.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fcec7640 1 -- 172.21.15.193:0/3868638808 learned_addr learned my addr 172.21.15.193:0/3868638808 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.859+0000 7f26fcec7640 1 -- 172.21.15.193:0/3868638808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30c6aa10 con 0x559c30c69fb0 2024-09-12T17:11:24.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26f0010f90 tx=0x7f26f000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 -- 172.21.15.193:0/3868638808 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f000a040 con 0x559c30c69fb0 2024-09-12T17:11:24.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c30c6b270 con 0x559c30c69fb0 2024-09-12T17:11:24.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 -- 172.21.15.193:0/3868638808 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0017050 con 0x559c30c69fb0 2024-09-12T17:11:24.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 -- 172.21.15.193:0/3868638808 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f000e7e0 con 0x559c30c69fb0 2024-09-12T17:11:24.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c30c6b7e0 con 0x559c30c69fb0 2024-09-12T17:11:24.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 -- 172.21.15.193:0/3868638808 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26f000e980 con 0x559c30c69fb0 2024-09-12T17:11:24.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 0x7f25d403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f25e2ffd640 1 -- 172.21.15.193:0/3868638808 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f26f0052130 con 0x559c30c69fb0 2024-09-12T17:11:24.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fdec9640 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 0x7f25d403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fdec9640 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 0x7f25d403bf20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x559c30c5b220 tx=0x7f26f8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26ffbc29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559c30c4bad0 con 0x559c30c77940 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50772/0 (socket says 172.21.15.193:50772) 2024-09-12T17:11:24.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 -- 172.21.15.193:0/2667417828 learned_addr learned my addr 172.21.15.193:0/2667417828 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 -- 172.21.15.193:0/2667417828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30c78330 con 0x559c30c77940 2024-09-12T17:11:24.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.863+0000 7f26fcec7640 1 --2- 172.21.15.193:0/2667417828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26f0050540 tx=0x7f26f0049f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc22a9d89ef2f87e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25e0ff9640 1 -- 172.21.15.193:0/2667417828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f0025e20 con 0x559c30c77940 2024-09-12T17:11:24.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25e0ff9640 1 -- 172.21.15.193:0/2667417828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0024c70 con 0x559c30c77940 2024-09-12T17:11:24.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25e0ff9640 1 -- 172.21.15.193:0/2667417828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f001ca60 con 0x559c30c77940 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/2667417828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 msgr2=0x559c30c77d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/2667417828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f26f0050540 tx=0x7f26f0049f40 comp rx=0 tx=0).stop 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/2667417828 shutdown_connections 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/2667417828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c77d40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/2667417828 >> 172.21.15.193:0/2667417828 conn(0x559c30c72d60 msgr2=0x559c30c70fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/2667417828 shutdown_connections 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/2667417828 wait complete. 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 Processor -- start 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- start start 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559c30c76890 con 0x559c30c77940 2024-09-12T17:11:24.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26fcec7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50784/0 (socket says 172.21.15.193:50784) 2024-09-12T17:11:24.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 learned_addr learned my addr 172.21.15.193:0/1811413370 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:24.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c30c7e370 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26f0025c20 tx=0x7f26f00504d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25d2ffd640 1 -- 172.21.15.193:0/1811413370 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f0024c70 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c30c7e600 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25d2ffd640 1 -- 172.21.15.193:0/1811413370 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0046040 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25d2ffd640 1 -- 172.21.15.193:0/1811413370 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26f0025e20 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c30c7efb0 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f25d2ffd640 1 -- 172.21.15.193:0/1811413370 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26f0035020 con 0x559c30c77940 2024-09-12T17:11:24.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.867+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f25d2ffd640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25c8039a70 0x7f25c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f25d2ffd640 1 -- 172.21.15.193:0/1811413370 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f26f0033020 con 0x559c30c77940 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25c8039a70 0x7f25c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30c89110 0x559c30c8b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8bcf0 con 0x559c30c89110 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30c89110 0x559c30c8b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25c8039a70 0x7f25c803bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x559c30c5a9a0 tx=0x7f26f801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30c89110 0x559c30c8b5a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 realm 2024-09-12T17:11:24.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8c100 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8c9d0 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8cd70 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8d210 con 0x559c30c89110 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 20 searching for the correct realm 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559c30c8f180 0x559c30c91570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559c30c8f180 0x559c30c91570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559c30c8f180 0x559c30c91570 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fcec7640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f26f001c030 0x7f26f0050680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f26f001c030 0x7f26f0050680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.871+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f26f001c030 0x7f26f0050680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fdec9640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f26f8031040 0x7f26f8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f26f8031040 0x7f26f8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f26f8031040 0x7f26f8032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.875+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.879+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c8f180 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.883+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f8031040 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x559c30c89110 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c30c91bf0 con 0x7f26f001c030 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26f801f070 con 0x7f26f001c030 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:24.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8dc20 con 0x559c30c89110 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8e4c0 con 0x559c30c89110 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8d860 con 0x559c30c89110 2024-09-12T17:11:24.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 zone default found 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 4 Realm: () 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 zonegroup default 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c8e4c0 con 0x7f26f8031040 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c93a60 con 0x559c30c8f180 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c93e30 con 0x559c30c8f180 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 started sync module instance, tier type = 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.887+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c92f00 con 0x7f26f001c030 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94129321751280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c92b60 con 0x7f26f001c030 2024-09-12T17:11:24.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c94d60 con 0x559c30c89110 2024-09-12T17:11:24.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94129321751280] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94129321755280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c94d60 con 0x559c30c89110 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.891+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c95720 con 0x559c30c8f180 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94129321755280] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94129321756848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c94cd0 con 0x559c30c8f180 2024-09-12T17:11:24.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c96420 con 0x7f26f001c030 2024-09-12T17:11:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94129321762976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c96cc0 con 0x7f26f001c030 2024-09-12T17:11:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c976e0 con 0x559c30c89110 2024-09-12T17:11:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94129321756848] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.895+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94129321762976] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94129321767376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c96810 con 0x559c30c89110 2024-09-12T17:11:24.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c97f80 con 0x7f26f8031040 2024-09-12T17:11:24.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94129321767376] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94129321761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c96810 con 0x7f26f8031040 2024-09-12T17:11:24.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.899+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c983f0 con 0x7f26f8031040 2024-09-12T17:11:24.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94129321770752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c98810 con 0x7f26f8031040 2024-09-12T17:11:24.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c99320 con 0x7f26f8031040 2024-09-12T17:11:24.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94129321761472] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94129321774544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c992e0 con 0x7f26f8031040 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=0 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=1 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=2 2024-09-12T17:11:24.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=3 2024-09-12T17:11:24.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=4 2024-09-12T17:11:24.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=5 2024-09-12T17:11:24.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94129321770752] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.903+0000 7f26ffbc29c0 20 add_watcher() i=6 2024-09-12T17:11:24.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94129321774544] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 20 add_watcher() i=7 2024-09-12T17:11:24.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:24.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30c98320 con 0x559c30c89110 2024-09-12T17:11:24.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94129321771808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c99720 con 0x559c30c89110 2024-09-12T17:11:24.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94129321771808] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f25b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:24.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 5 note: GC not initialized 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f25b2fe5640 20 reqs_thread_entry: start 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f26ffbc29c0 20 Filter name: none 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.907+0000 7f25b0fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c30cbefc0 con 0x559c30c89110 2024-09-12T17:11:24.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:24.915 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:24.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f25b3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:24.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94129321771808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30cbde10 con 0x559c30c89110 2024-09-12T17:11:24.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94129321771808] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94129321751280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c98320 con 0x7f26f001c030 2024-09-12T17:11:24.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94129321751280] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 20 remove_watcher() i=0 2024-09-12T17:11:24.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 2 removed watcher, disabling cache 2024-09-12T17:11:24.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.911+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94129321755280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c932f0 con 0x559c30c89110 2024-09-12T17:11:24.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.915+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94129321755280] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.915+0000 7f26ffbc29c0 20 remove_watcher() i=1 2024-09-12T17:11:24.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.915+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94129321756848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c932f0 con 0x559c30c8f180 2024-09-12T17:11:24.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26fcec7640 1 -- 172.21.15.193:0/1811413370 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94129321756848] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f000d040 con 0x559c30c8f180 2024-09-12T17:11:24.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 20 remove_watcher() i=2 2024-09-12T17:11:24.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94129321762976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c948b0 con 0x7f26f001c030 2024-09-12T17:11:24.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26fdec9640 1 -- 172.21.15.193:0/1811413370 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94129321762976] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f8040040 con 0x7f26f001c030 2024-09-12T17:11:24.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 20 remove_watcher() i=3 2024-09-12T17:11:24.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94129321767376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c948b0 con 0x559c30c89110 2024-09-12T17:11:24.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94129321767376] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x559c30c89110 2024-09-12T17:11:24.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 20 remove_watcher() i=4 2024-09-12T17:11:24.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.919+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94129321761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c948b0 con 0x7f26f8031040 2024-09-12T17:11:24.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.923+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94129321761472] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.923+0000 7f26ffbc29c0 20 remove_watcher() i=5 2024-09-12T17:11:24.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.923+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94129321770752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c95ac0 con 0x7f26f8031040 2024-09-12T17:11:24.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94129321770752] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 20 remove_watcher() i=6 2024-09-12T17:11:24.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94129321774544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c30c983b0 con 0x7f26f8031040 2024-09-12T17:11:24.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94129321774544] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26f40b2040 con 0x7f26f8031040 2024-09-12T17:11:24.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 20 remove_watcher() i=7 2024-09-12T17:11:24.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f26f8031040 msgr2=0x7f26f8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f26f8031040 0x7f26f8032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30c89110 msgr2=0x559c30c8b5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30c89110 0x559c30c8b5a0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f26f001c030 msgr2=0x7f26f0050680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f26f001c030 0x7f26f0050680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559c30c8f180 msgr2=0x559c30c91570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559c30c8f180 0x559c30c91570 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25c8039a70 msgr2=0x7f25c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25c8039a70 0x7f25c803bf30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x559c30c5a9a0 tx=0x7f26f801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 msgr2=0x559c30c7de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26fd6c8640 1 -- 172.21.15.193:0/1811413370 reap_dead start 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26f0025c20 tx=0x7f26f00504d0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 shutdown_connections 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1811413370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c77940 0x559c30c7de10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 >> 172.21.15.193:0/1811413370 conn(0x559c30c72d60 msgr2=0x559c30c70f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 shutdown_connections 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1811413370 wait complete. 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 msgr2=0x7f25d403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 0x7f25d403bf20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x559c30c5b220 tx=0x7f26f8005850 comp rx=0 tx=0).stop 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 msgr2=0x559c30c6a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f26f0010f90 tx=0x7f26f000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 shutdown_connections 2024-09-12T17:11:24.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25d4039a60 0x7f25d403bf20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/3868638808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30c69fb0 0x559c30c6a3d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 >> 172.21.15.193:0/3868638808 conn(0x559c30c5f960 msgr2=0x559c30c5fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.927+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 shutdown_connections 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/3868638808 wait complete. 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 msgr2=0x559c30c599e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 0x559c30c599e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 msgr2=0x7f25e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 0x7f25e403bf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f26f0001e60 tx=0x7f26f00013e0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 msgr2=0x559c30c52870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f26f40b7040 tx=0x7f26f40180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 shutdown_connections 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559c30ad30e0 0x559c30c599e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f25e4039a70 0x7f25e403bf30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 --2- 172.21.15.193:0/1511825375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559c30acffa0 0x559c30c52870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 >> 172.21.15.193:0/1511825375 conn(0x559c30aceb10 msgr2=0x559c30c45a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 shutdown_connections 2024-09-12T17:11:24.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:24.931+0000 7f26ffbc29c0 1 -- 172.21.15.193:0/1511825375 wait complete. 2024-09-12T17:11:24.945 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:24.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T17:11:24.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T17:11:24.945 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T17:11:25.026 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.026 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd365cb9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ce7fbc3ff0 0x55ce7fbc63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd365cb9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce7fa759c0 con 0x55ce7fbbfe00 2024-09-12T17:11:25.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd365cb9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ce7fac56d0 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd340d1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ce7fbbfe00 0x55ce7fbc01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36014/0 (socket says 172.21.15.193:36014) 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd340d1640 1 -- 172.21.15.193:0/4269251012 learned_addr learned my addr 172.21.15.193:0/4269251012 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd338d0640 1 --2- 172.21.15.193:0/4269251012 >> v2:172.21.15.62:3300/0 conn(0x55ce7fbc3ff0 0x55ce7fbc63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd330cf640 1 -- 172.21.15.193:0/4269251012 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228580182 0 0) 0x55ce7fa759c0 con 0x55ce7fbbfe00 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd330cf640 1 -- 172.21.15.193:0/4269251012 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd20001e20 con 0x55ce7fbbfe00 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd338d0640 1 -- 172.21.15.193:0/4269251012 >> v1:172.21.15.62:6789/0 conn(0x55ce7fbbfe00 legacy=0x55ce7fbc01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.023+0000 7fbd338d0640 1 -- 172.21.15.193:0/4269251012 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fa69ca0 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd338d0640 1 --2- 172.21.15.193:0/4269251012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fbc63e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00a420 tx=0x7fbd1c01b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b02d035df5d879f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd330cf640 1 -- 172.21.15.193:0/4269251012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0af070 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd330cf640 1 -- 172.21.15.193:0/4269251012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0aa530 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd330cf640 1 -- 172.21.15.193:0/4269251012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0aa810 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/4269251012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 msgr2=0x55ce7fbc63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/4269251012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fbc63e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00a420 tx=0x7fbd1c01b060 comp rx=0 tx=0).stop 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/4269251012 shutdown_connections 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/4269251012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fbc63e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/4269251012 >> 172.21.15.193:0/4269251012 conn(0x55ce7fbbb920 msgr2=0x55ce7fbbdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/4269251012 shutdown_connections 2024-09-12T17:11:25.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.027+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/4269251012 wait complete. 2024-09-12T17:11:25.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd365cb9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd365cb9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ce7fac9680 con 0x55ce7fbbfe00 2024-09-12T17:11:25.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd340d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd340d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50800/0 (socket says 172.21.15.193:50800) 2024-09-12T17:11:25.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.043+0000 7fbd340d1640 1 -- 172.21.15.193:0/2977416934 learned_addr learned my addr 172.21.15.193:0/2977416934 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 -- 172.21.15.193:0/2977416934 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fa44da0 con 0x55ce7fbbfe00 2024-09-12T17:11:25.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 --2- 172.21.15.193:0/2977416934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001e40 tx=0x7fbd2400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bd24e63c8faba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc2260c640 1 -- 172.21.15.193:0/2977416934 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd24012020 con 0x55ce7fbbfe00 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc2260c640 1 -- 172.21.15.193:0/2977416934 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2400e690 con 0x55ce7fbbfe00 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc2260c640 1 -- 172.21.15.193:0/2977416934 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2400e9b0 con 0x55ce7fbbfe00 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2977416934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 msgr2=0x55ce7fcac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2977416934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbd24001e40 tx=0x7fbd2400b790 comp rx=0 tx=0).stop 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2977416934 shutdown_connections 2024-09-12T17:11:25.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2977416934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbbfe00 0x55ce7fcac4e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2977416934 >> 172.21.15.193:0/2977416934 conn(0x55ce7fbbb920 msgr2=0x55ce7fca8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2977416934 shutdown_connections 2024-09-12T17:11:25.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2977416934 wait complete. 2024-09-12T17:11:25.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ce7fa6ba50 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50806/0 (socket says 172.21.15.193:50806) 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 -- 172.21.15.193:0/2556334579 learned_addr learned my addr 172.21.15.193:0/2556334579 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fcb43f0 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd340d1640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcad4b0 tx=0x7fbd240040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc20e09640 1 -- 172.21.15.193:0/2556334579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd24012030 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce7fcb4680 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc20e09640 1 -- 172.21.15.193:0/2556334579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2401a6d0 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.047+0000 7fbc20e09640 1 -- 172.21.15.193:0/2556334579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2401a9f0 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7fcb4f40 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbc20e09640 1 -- 172.21.15.193:0/2556334579 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd24015020 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbc20e09640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 0x7fbc1c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbc20e09640 1 -- 172.21.15.193:0/2556334579 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbd24020070 con 0x55ce7fbc3ff0 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd338d0640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 0x7fbc1c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 0x55ce7fcbb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcbb830 con 0x55ce7fcb8f00 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd348d2640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 0x55ce7fcbb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd338d0640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 0x7fbc1c03bf80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ac000 tx=0x7fbd1c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd348d2640 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 0x55ce7fcbb2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd348d2640 1 -- 172.21.15.193:0/2556334579 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd2c0083f0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcbbc50 con 0x55ce7fcb8f00 2024-09-12T17:11:25.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd348d2640 1 -- 172.21.15.193:0/2556334579 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd2c0083f0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcbd550 con 0x55ce7fcb8f00 2024-09-12T17:11:25.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd348d2640 1 -- 172.21.15.193:0/2556334579 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd2c0083f0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.051+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcbc780 con 0x55ce7fcb8f00 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd348d2640 1 -- 172.21.15.193:0/2556334579 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd2c0083f0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcbcba0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd348d2640 1 -- 172.21.15.193:0/2556334579 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd2c0083f0 con 0x55ce7fcb8f00 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ce7fad6450 con 0x55ce7fccb8b0 2024-09-12T17:11:25.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50820/0 (socket says 172.21.15.193:50820) 2024-09-12T17:11:25.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd338d0640 1 -- 172.21.15.193:0/1963578237 learned_addr learned my addr 172.21.15.193:0/1963578237 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd338d0640 1 -- 172.21.15.193:0/1963578237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fccc310 con 0x55ce7fccb8b0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c018c90 tx=0x7fbd1c017e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbc19ffb640 1 -- 172.21.15.193:0/1963578237 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0c7070 con 0x55ce7fccb8b0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce7fcccb70 con 0x55ce7fccb8b0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7fccd080 con 0x55ce7fccb8b0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbc19ffb640 1 -- 172.21.15.193:0/1963578237 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0b0040 con 0x55ce7fccb8b0 2024-09-12T17:11:25.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.055+0000 7fbc19ffb640 1 -- 172.21.15.193:0/1963578237 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0b7de0 con 0x55ce7fccb8b0 2024-09-12T17:11:25.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc19ffb640 1 -- 172.21.15.193:0/1963578237 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd1c0ca070 con 0x55ce7fccb8b0 2024-09-12T17:11:25.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc19ffb640 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 0x7fbc0c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc19ffb640 1 -- 172.21.15.193:0/1963578237 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbd1c0bd030 con 0x55ce7fccb8b0 2024-09-12T17:11:25.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 0x7fbc0c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 0x7fbc0c03bf80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcbcb20 tx=0x7fbd2c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ce7fcacd30 con 0x55ce7fcd9160 2024-09-12T17:11:25.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50824/0 (socket says 172.21.15.193:50824) 2024-09-12T17:11:25.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd338d0640 1 -- 172.21.15.193:0/1862914351 learned_addr learned my addr 172.21.15.193:0/1862914351 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd338d0640 1 -- 172.21.15.193:0/1862914351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fcd9b50 con 0x55ce7fcd9160 2024-09-12T17:11:25.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1862914351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0eac00 tx=0x7fbd1c0c2f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f499108d07c3b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc137fe640 1 -- 172.21.15.193:0/1862914351 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0c0e70 con 0x55ce7fcd9160 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc137fe640 1 -- 172.21.15.193:0/1862914351 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c005fe0 con 0x55ce7fcd9160 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbc137fe640 1 -- 172.21.15.193:0/1862914351 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c006300 con 0x55ce7fcd9160 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1862914351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 msgr2=0x55ce7fcd9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1862914351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0eac00 tx=0x7fbd1c0c2f40 comp rx=0 tx=0).stop 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1862914351 shutdown_connections 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1862914351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcd9560 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1862914351 >> 172.21.15.193:0/1862914351 conn(0x55ce7fcd4580 msgr2=0x55ce7fcd27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1862914351 shutdown_connections 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1862914351 wait complete. 2024-09-12T17:11:25.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 Processor -- start 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- start start 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.059+0000 7fbd365cb9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ce7fcd80b0 con 0x55ce7fcd9160 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd338d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50828/0 (socket says 172.21.15.193:50828) 2024-09-12T17:11:25.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 learned_addr learned my addr 172.21.15.193:0/1880066721 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7fcdfc10 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0b6040 tx=0x7fbd1c0eab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 -- 172.21.15.193:0/1880066721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0f1070 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce7fcdfea0 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 -- 172.21.15.193:0/1880066721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c0e9750 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 -- 172.21.15.193:0/1880066721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0ec200 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7fce0850 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 -- 172.21.15.193:0/1880066721 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbd1c0f4070 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc04039a70 0x7fbc0403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbc11ffb640 1 -- 172.21.15.193:0/1880066721 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fbd1c0e0030 con 0x55ce7fcd9160 2024-09-12T17:11:25.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc04039a70 0x7fbc0403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fceaa50 0x55ce7fcecee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fced630 con 0x55ce7fceaa50 2024-09-12T17:11:25.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd340d1640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fceaa50 0x55ce7fcecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc04039a70 0x7fbc0403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcbc2a0 tx=0x7fbd2c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.063+0000 7fbd340d1640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fceaa50 0x55ce7fcecee0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 realm 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fceda40 con 0x55ce7fceaa50 2024-09-12T17:11:25.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcee310 con 0x55ce7fceaa50 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcee6b0 con 0x55ce7fceaa50 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fceef00 con 0x55ce7fceaa50 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 20 searching for the correct realm 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ce7fcf0c70 0x55ce7fcf3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ce7fcf0c70 0x55ce7fcf3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ce7fcf0c70 0x55ce7fcf3060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd338d0640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbd1c0f6060 0x7fbd1c0a99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbd1c0f6060 0x7fbd1c0a99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbd1c0f6060 0x7fbd1c0a99d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd348d2640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbd2c019040 0x7fbd2c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.067+0000 7fbd340d1640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbd2c019040 0x7fbd2c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbd2c019040 0x7fbd2c019930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24008030 con 0x7fbd2c019040 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24008030 con 0x55ce7fceaa50 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.071+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.075+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fceaa50 2024-09-12T17:11:25.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf35a0 con 0x7fbd2c019040 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.079+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd24059040 con 0x55ce7fceaa50 2024-09-12T17:11:25.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbd24059040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcef750 con 0x55ce7fceaa50 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcefaf0 con 0x55ce7fceaa50 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcefaf0 con 0x55ce7fceaa50 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 zone default found 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 4 Realm: () 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:25.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 zonegroup default 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf0010 con 0x7fbd2c019040 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf53c0 con 0x55ce7fcf0c70 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf5760 con 0x55ce7fcf0c70 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 started sync module instance, tier type = 2024-09-12T17:11:25.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:25.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.083+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf4860 con 0x7fbd1c0f6060 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345395915904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf5fb0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf6800 con 0x55ce7fceaa50 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345395915904] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345395919616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf63d0 con 0x55ce7fceaa50 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.087+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf6e10 con 0x55ce7fcf0c70 2024-09-12T17:11:25.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.091+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345395919616] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.091+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.091+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345395920672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf6340 con 0x55ce7fcf0c70 2024-09-12T17:11:25.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.091+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf7b60 con 0x7fbd1c0f6060 2024-09-12T17:11:25.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.095+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.095+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345395926976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf82b0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.095+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf8db0 con 0x55ce7fceaa50 2024-09-12T17:11:25.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.095+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345395926976] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.095+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345395920672] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.099+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.099+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345395925504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf8d70 con 0x55ce7fceaa50 2024-09-12T17:11:25.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.099+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf9680 con 0x7fbd2c019040 2024-09-12T17:11:25.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.099+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345395925504] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.103+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.103+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345395931296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf8d70 con 0x7fbd2c019040 2024-09-12T17:11:25.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.103+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf9c20 con 0x7fbd2c019040 2024-09-12T17:11:25.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.107+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345395931296] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.107+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.107+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345395933520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf9c20 con 0x7fbd2c019040 2024-09-12T17:11:25.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.107+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfa5e0 con 0x7fbd2c019040 2024-09-12T17:11:25.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.107+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345395933520] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345395935360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfa5e0 con 0x7fbd2c019040 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=0 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=1 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=2 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=3 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=4 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=5 2024-09-12T17:11:25.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=6 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345395935360] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 20 add_watcher() i=7 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfd8c0 con 0x55ce7fceaa50 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.111+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345395937952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfab70 con 0x55ce7fceaa50 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345395937952] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbbea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 5 note: GC not initialized 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbbe97e2640 20 reqs_thread_entry: start 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 Filter name: none 2024-09-12T17:11:25.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbb5affd640 20 reqs_thread_entry: start 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fd20b90 con 0x55ce7fceaa50 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:25.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fd23620 con 0x7fbd1c0f6060 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fd26cf0 con 0x55ce7fceaa50 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94345396119424 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fd22610 con 0x55ce7fceaa50 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94345395925504 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ce7fcb4f40 con 0x55ce7fceaa50 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbc137fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94345395925504 notifier 4328 bl.length()=567 2024-09-12T17:11:25.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbc137fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbc137fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbc137fe640 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbf8003eb0 con 0x55ce7fceaa50 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(65 notify.4 [notify cookie 94345396119424 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.115+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94345396119424 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ce7fcb4680 con 0x55ce7fceaa50 2024-09-12T17:11:25.123 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:25.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbbea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345395937952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fd25ba0 con 0x55ce7fceaa50 2024-09-12T17:11:25.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94345395937952] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345395915904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfa2a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94345395915904] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd365cb9c0 20 remove_watcher() i=0 2024-09-12T17:11:25.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd365cb9c0 2 removed watcher, disabling cache 2024-09-12T17:11:25.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.119+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345395919616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf4c80 con 0x55ce7fceaa50 2024-09-12T17:11:25.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94345395919616] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd365cb9c0 20 remove_watcher() i=1 2024-09-12T17:11:25.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345395920672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf4c80 con 0x55ce7fcf0c70 2024-09-12T17:11:25.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd338d0640 1 -- 172.21.15.193:0/1880066721 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94345395920672] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd1c0f3030 con 0x55ce7fcf0c70 2024-09-12T17:11:25.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd365cb9c0 20 remove_watcher() i=2 2024-09-12T17:11:25.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.123+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345395926976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcfa2a0 con 0x7fbd1c0f6060 2024-09-12T17:11:25.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd348d2640 1 -- 172.21.15.193:0/1880066721 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94345395926976] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd2c02f040 con 0x7fbd1c0f6060 2024-09-12T17:11:25.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd365cb9c0 20 remove_watcher() i=3 2024-09-12T17:11:25.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345395925504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf77c0 con 0x55ce7fceaa50 2024-09-12T17:11:25.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94345395925504] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x55ce7fceaa50 2024-09-12T17:11:25.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd365cb9c0 20 remove_watcher() i=4 2024-09-12T17:11:25.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.127+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345395931296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf77c0 con 0x7fbd2c019040 2024-09-12T17:11:25.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94345395931296] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd365cb9c0 20 remove_watcher() i=5 2024-09-12T17:11:25.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345395933520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf88a0 con 0x7fbd2c019040 2024-09-12T17:11:25.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94345395933520] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd365cb9c0 20 remove_watcher() i=6 2024-09-12T17:11:25.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.131+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345395935360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce7fcf9150 con 0x7fbd2c019040 2024-09-12T17:11:25.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94345395935360] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd24033040 con 0x7fbd2c019040 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 20 remove_watcher() i=7 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbd2c019040 msgr2=0x7fbd2c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbd2c019040 0x7fbd2c019930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fceaa50 msgr2=0x55ce7fcecee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fceaa50 0x55ce7fcecee0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbd1c0f6060 msgr2=0x7fbd1c0a99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbd1c0f6060 0x7fbd1c0a99d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ce7fcf0c70 msgr2=0x55ce7fcf3060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ce7fcf0c70 0x55ce7fcf3060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc04039a70 msgr2=0x7fbc0403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc04039a70 0x7fbc0403bf30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcbc2a0 tx=0x7fbd2c01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 msgr2=0x55ce7fcdf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd340d1640 1 -- 172.21.15.193:0/1880066721 reap_dead start 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0b6040 tx=0x7fbd1c0eab60 comp rx=0 tx=0).stop 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 shutdown_connections 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1880066721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fcd9160 0x55ce7fcdf6b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 >> 172.21.15.193:0/1880066721 conn(0x55ce7fcd4580 msgr2=0x55ce7fcd2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 shutdown_connections 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1880066721 wait complete. 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 msgr2=0x7fbc0c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 0x7fbc0c03bf80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcbcb20 tx=0x7fbd2c003070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 msgr2=0x55ce7fccbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c018c90 tx=0x7fbd1c017e00 comp rx=0 tx=0).stop 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 shutdown_connections 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc0c039ac0 0x7fbc0c03bf80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/1963578237 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fccb8b0 0x55ce7fccbcd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 >> 172.21.15.193:0/1963578237 conn(0x55ce7fcc1260 msgr2=0x55ce7fcc1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 shutdown_connections 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/1963578237 wait complete. 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 msgr2=0x55ce7fcbb2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 0x55ce7fcbb2f0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 msgr2=0x7fbc1c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 0x7fbc1c03bf80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ac000 tx=0x7fbd1c0a5000 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 msgr2=0x55ce7fcb3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55ce7fcad4b0 tx=0x7fbd240040f0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 shutdown_connections 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ce7fcb8f00 0x55ce7fcbb2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fbc1c039ac0 0x7fbc1c03bf80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 --2- 172.21.15.193:0/2556334579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ce7fbc3ff0 0x55ce7fcb3e90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 >> 172.21.15.193:0/2556334579 conn(0x55ce7fbbb920 msgr2=0x55ce7fca6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 shutdown_connections 2024-09-12T17:11:25.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.135+0000 7fbd365cb9c0 1 -- 172.21.15.193:0/2556334579 wait complete. 2024-09-12T17:11:25.152 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:25.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:25.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:25.153 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:25.226 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.226 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23edd609c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fb9d4750d0 0x55fb9d4774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23edd609c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fb9d3259c0 con 0x55fb9d470f80 2024-09-12T17:11:25.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23edd609c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55fb9d3756d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23eb065640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fb9d4750d0 0x55fb9d4774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23eb866640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55fb9d470f80 0x55fb9d471360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36030/0 (socket says 172.21.15.193:36030) 2024-09-12T17:11:25.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23eb866640 1 -- 172.21.15.193:0/2115824763 learned_addr learned my addr 172.21.15.193:0/2115824763 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:25.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23eb065640 1 -- 172.21.15.193:0/2115824763 >> v1:172.21.15.62:6789/0 conn(0x55fb9d470f80 legacy=0x55fb9d471360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.223+0000 7f23eb065640 1 -- 172.21.15.193:0/2115824763 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d319ca0 con 0x55fb9d4750d0 2024-09-12T17:11:25.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23eb065640 1 --2- 172.21.15.193:0/2115824763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d4750d0 0x55fb9d4774c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23d400a480 tx=0x7f23d401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f71c38f4dfafc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23ea864640 1 -- 172.21.15.193:0/2115824763 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40aa570 con 0x55fb9d4750d0 2024-09-12T17:11:25.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23ea864640 1 -- 172.21.15.193:0/2115824763 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40af070 con 0x55fb9d4750d0 2024-09-12T17:11:25.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23ea864640 1 -- 172.21.15.193:0/2115824763 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40aa860 con 0x55fb9d4750d0 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 -- 172.21.15.193:0/2115824763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d4750d0 msgr2=0x55fb9d4774c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2115824763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d4750d0 0x55fb9d4774c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23d400a480 tx=0x7f23d401b310 comp rx=0 tx=0).stop 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 -- 172.21.15.193:0/2115824763 shutdown_connections 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2115824763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d4750d0 0x55fb9d4774c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 -- 172.21.15.193:0/2115824763 >> 172.21.15.193:0/2115824763 conn(0x55fb9d46caa0 msgr2=0x55fb9d46eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 -- 172.21.15.193:0/2115824763 shutdown_connections 2024-09-12T17:11:25.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.227+0000 7f23edd609c0 1 -- 172.21.15.193:0/2115824763 wait complete. 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23edd609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23edd609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fb9d379680 con 0x55fb9d470f80 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23eb866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23eb866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50856/0 (socket says 172.21.15.193:50856) 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23eb866640 1 -- 172.21.15.193:0/426901702 learned_addr learned my addr 172.21.15.193:0/426901702 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23eb866640 1 -- 172.21.15.193:0/426901702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d2f4da0 con 0x55fb9d470f80 2024-09-12T17:11:25.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f23eb866640 1 --2- 172.21.15.193:0/426901702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001e00 tx=0x7f23dc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfecf3d87b49bc43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f22d9e0b640 1 -- 172.21.15.193:0/426901702 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23dc012020 con 0x55fb9d470f80 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f22d9e0b640 1 -- 172.21.15.193:0/426901702 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc00e690 con 0x55fb9d470f80 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.243+0000 7f22d9e0b640 1 -- 172.21.15.193:0/426901702 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23dc00ea10 con 0x55fb9d470f80 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/426901702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 msgr2=0x55fb9d55c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 --2- 172.21.15.193:0/426901702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23dc001e00 tx=0x7f23dc00b6d0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/426901702 shutdown_connections 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 --2- 172.21.15.193:0/426901702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d55c6d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/426901702 >> 172.21.15.193:0/426901702 conn(0x55fb9d46caa0 msgr2=0x55fb9d558310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/426901702 shutdown_connections 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/426901702 wait complete. 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fb9d31ba50 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23eb866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23eb866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50868/0 (socket says 172.21.15.193:50868) 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23eb866640 1 -- 172.21.15.193:0/2855536376 learned_addr learned my addr 172.21.15.193:0/2855536376 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23eb866640 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d5642d0 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23eb866640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55fb9d55d660 tx=0x7f23dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f22d3fff640 1 -- 172.21.15.193:0/2855536376 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23dc012030 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb9d564560 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f22d3fff640 1 -- 172.21.15.193:0/2855536376 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23dc01a750 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f22d3fff640 1 -- 172.21.15.193:0/2855536376 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23dc01aa50 con 0x55fb9d470f80 2024-09-12T17:11:25.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.247+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9d564f10 con 0x55fb9d470f80 2024-09-12T17:11:25.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f22d3fff640 1 -- 172.21.15.193:0/2855536376 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f23dc015020 con 0x55fb9d470f80 2024-09-12T17:11:25.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f22d3fff640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 0x7f22d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f22d3fff640 1 -- 172.21.15.193:0/2855536376 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f23dc020030 con 0x55fb9d470f80 2024-09-12T17:11:25.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23eb065640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 0x7f22d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 0x55fb9d56aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d56b420 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 0x55fb9d56aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23eb065640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 0x7f22d403bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23d40ae000 tx=0x7f23d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 0x55fb9d56aee0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 -- 172.21.15.193:0/2855536376 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23e400a4d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d565250 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 -- 172.21.15.193:0/2855536376 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23e400a4d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d56d180 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 -- 172.21.15.193:0/2855536376 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23e400a4d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d56c3e0 con 0x55fb9d4750d0 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 -- 172.21.15.193:0/2855536376 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23e400a4d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d56c830 con 0x55fb9d4750d0 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23ec067640 1 -- 172.21.15.193:0/2855536376 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23e400a4d0 con 0x55fb9d4750d0 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23edd609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fb9d386450 con 0x55fb9d57b440 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.251+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50876/0 (socket says 172.21.15.193:50876) 2024-09-12T17:11:25.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 -- 172.21.15.193:0/199796975 learned_addr learned my addr 172.21.15.193:0/199796975 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 -- 172.21.15.193:0/199796975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d57bea0 con 0x55fb9d57b440 2024-09-12T17:11:25.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23d4000c10 tx=0x7f23d40180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 -- 172.21.15.193:0/199796975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40c5030 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 -- 172.21.15.193:0/199796975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40b5950 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb9d57c700 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 -- 172.21.15.193:0/199796975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40b5c50 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9d57cc70 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 -- 172.21.15.193:0/199796975 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f23d40c8030 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 0x7f22c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f22d17fa640 1 -- 172.21.15.193:0/199796975 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f23d40c6070 con 0x55fb9d57b440 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23ec067640 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 0x7f22c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23ec067640 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 0x7f22c403bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55fb9d56bf00 tx=0x7f23e4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23edd609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fb9d55cf20 con 0x55fb9d588c70 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50878/0 (socket says 172.21.15.193:50878) 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.255+0000 7f23eb065640 1 -- 172.21.15.193:0/2437041904 learned_addr learned my addr 172.21.15.193:0/2437041904 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 -- 172.21.15.193:0/2437041904 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d589660 con 0x55fb9d588c70 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 --2- 172.21.15.193:0/2437041904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23d40eb760 tx=0x7f23d40b5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5712cd364a73952b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22caffd640 1 -- 172.21.15.193:0/2437041904 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40d8070 con 0x55fb9d588c70 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22caffd640 1 -- 172.21.15.193:0/2437041904 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40ed1a0 con 0x55fb9d588c70 2024-09-12T17:11:25.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22caffd640 1 -- 172.21.15.193:0/2437041904 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40c1ad0 con 0x55fb9d588c70 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/2437041904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 msgr2=0x55fb9d589070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2437041904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f23d40eb760 tx=0x7f23d40b5f60 comp rx=0 tx=0).stop 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/2437041904 shutdown_connections 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2437041904 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d589070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/2437041904 >> 172.21.15.193:0/2437041904 conn(0x55fb9d584090 msgr2=0x55fb9d5822d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/2437041904 shutdown_connections 2024-09-12T17:11:25.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/2437041904 wait complete. 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 Processor -- start 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- start start 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fb9d587bc0 con 0x55fb9d588c70 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50880/0 (socket says 172.21.15.193:50880) 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 learned_addr learned my addr 172.21.15.193:0/3786139724 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9d58f740 con 0x55fb9d588c70 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23eb065640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23d40aaf30 tx=0x7f23d40eb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22c97fa640 1 -- 172.21.15.193:0/3786139724 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40f2070 con 0x55fb9d588c70 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22c97fa640 1 -- 172.21.15.193:0/3786139724 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d40c1440 con 0x55fb9d588c70 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fb9d58f9d0 con 0x55fb9d588c70 2024-09-12T17:11:25.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f22c97fa640 1 -- 172.21.15.193:0/3786139724 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d40d2770 con 0x55fb9d588c70 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.259+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9d590380 con 0x55fb9d588c70 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f22c97fa640 1 -- 172.21.15.193:0/3786139724 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f23d40f5070 con 0x55fb9d588c70 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f22c97fa640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22b4039ac0 0x7f22b403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f22c97fa640 1 -- 172.21.15.193:0/3786139724 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f23d40e7030 con 0x55fb9d588c70 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23ec067640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22b4039ac0 0x7f22b403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d59a4c0 0x55fb9d59c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59d0a0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d59a4c0 0x55fb9d59c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23ec067640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22b4039ac0 0x7f22b403bf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55fb9d565190 tx=0x7f23e401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d59a4c0 0x55fb9d59c950 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 realm 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59d4b0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59dd80 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59e120 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59e5c0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 20 searching for the correct realm 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fb9d5a0530 0x55fb9d5a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.263+0000 7f23eb065640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fb9d5a0530 0x55fb9d5a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb065640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fb9d5a0530 0x55fb9d5a2920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb065640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f23d40f7060 0x7f23d40baac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23ec067640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f23d40f7060 0x7f23d40baac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23ec067640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f23d40f7060 0x7f23d40baac0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23ec067640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f23e4031040 0x7f23e4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f23e4031040 0x7f23e4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f23e4031040 0x7f23e4032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.267+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.271+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.275+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d5a0530 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23e4031040 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a2fa0 con 0x7f23d40f7060 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23e401f070 con 0x7f23d40f7060 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59efa0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59f840 con 0x55fb9d59a4c0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59ebe0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:25.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 zone default found 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 4 Realm: () 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 zonegroup default 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.279+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d59f840 con 0x7f23e4031040 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a4df0 con 0x55fb9d5a0530 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a5190 con 0x55fb9d5a0530 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 started sync module instance, tier type = 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a4290 con 0x7f23d40f7060 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539165091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a3ef0 con 0x7f23d40f7060 2024-09-12T17:11:25.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6000 con 0x55fb9d59a4c0 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.283+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539165091504] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539165095216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6000 con 0x55fb9d59a4c0 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6a40 con 0x55fb9d5a0530 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539165099408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a7290 con 0x55fb9d5a0530 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a7c50 con 0x7f23d40f7060 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539165095216] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539165104032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a7bc0 con 0x7f23d40f7060 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.287+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a8a20 con 0x55fb9d59a4c0 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539165099408] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539165104032] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539165101536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a89e0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a8e50 con 0x7f23e4031040 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.291+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539165101536] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539165106240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a8dc0 con 0x7f23e4031040 2024-09-12T17:11:25.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a9780 con 0x7f23e4031040 2024-09-12T17:11:25.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539165106240] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539165107296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a9780 con 0x7f23e4031040 2024-09-12T17:11:25.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.295+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5aa140 con 0x7f23e4031040 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539165113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5aa560 con 0x7f23e4031040 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=0 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=1 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=2 2024-09-12T17:11:25.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=3 2024-09-12T17:11:25.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=4 2024-09-12T17:11:25.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=5 2024-09-12T17:11:25.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539165107296] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=6 2024-09-12T17:11:25.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539165113488] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 20 add_watcher() i=7 2024-09-12T17:11:25.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:25.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a92d0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.299+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539165110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5aaa70 con 0x55fb9d59a4c0 2024-09-12T17:11:25.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539165110992] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f22a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 5 note: GC not initialized 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f22a0fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 Filter name: none 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f221a7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5d0390 con 0x55fb9d59a4c0 2024-09-12T17:11:25.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:25.308 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:25.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f22a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539165110992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5cf220 con 0x55fb9d59a4c0 2024-09-12T17:11:25.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94539165110992] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.303+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539165091504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a92d0 con 0x7f23d40f7060 2024-09-12T17:11:25.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94539165091504] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23edd609c0 20 remove_watcher() i=0 2024-09-12T17:11:25.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23edd609c0 2 removed watcher, disabling cache 2024-09-12T17:11:25.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539165095216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a92d0 con 0x55fb9d59a4c0 2024-09-12T17:11:25.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94539165095216] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23edd609c0 20 remove_watcher() i=1 2024-09-12T17:11:25.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.307+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539165099408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a5530 con 0x55fb9d5a0530 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23eb065640 1 -- 172.21.15.193:0/3786139724 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94539165099408] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23d40f4030 con 0x55fb9d5a0530 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23edd609c0 20 remove_watcher() i=2 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539165104032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6590 con 0x7f23d40f7060 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23ec067640 1 -- 172.21.15.193:0/3786139724 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94539165104032] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23e4040040 con 0x7f23d40f7060 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23edd609c0 20 remove_watcher() i=3 2024-09-12T17:11:25.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.311+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539165101536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6590 con 0x55fb9d59a4c0 2024-09-12T17:11:25.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94539165101536] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x55fb9d59a4c0 2024-09-12T17:11:25.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23edd609c0 20 remove_watcher() i=4 2024-09-12T17:11:25.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539165106240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6de0 con 0x7f23e4031040 2024-09-12T17:11:25.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94539165106240] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23edd609c0 20 remove_watcher() i=5 2024-09-12T17:11:25.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.315+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539165107296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a6590 con 0x7f23e4031040 2024-09-12T17:11:25.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.319+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94539165107296] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.319+0000 7f23edd609c0 20 remove_watcher() i=6 2024-09-12T17:11:25.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.319+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539165113488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fb9d5a84f0 con 0x7f23e4031040 2024-09-12T17:11:25.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94539165113488] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23dc008030 con 0x7f23e4031040 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 20 remove_watcher() i=7 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f23e4031040 msgr2=0x7f23e4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f23e4031040 0x7f23e4032940 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d59a4c0 msgr2=0x55fb9d59c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d59a4c0 0x55fb9d59c950 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f23d40f7060 msgr2=0x7f23d40baac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f23d40f7060 0x7f23d40baac0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fb9d5a0530 msgr2=0x55fb9d5a2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fb9d5a0530 0x55fb9d5a2920 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22b4039ac0 msgr2=0x7f22b403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22b4039ac0 0x7f22b403bf80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55fb9d565190 tx=0x7f23e401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 msgr2=0x55fb9d58f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23eb866640 1 -- 172.21.15.193:0/3786139724 reap_dead start 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f23d40aaf30 tx=0x7f23d40eb6c0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 shutdown_connections 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/3786139724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d588c70 0x55fb9d58f1e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 >> 172.21.15.193:0/3786139724 conn(0x55fb9d584090 msgr2=0x55fb9d5822a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 shutdown_connections 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/3786139724 wait complete. 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 msgr2=0x7f22c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 0x7f22c403bf30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55fb9d56bf00 tx=0x7f23e4005850 comp rx=0 tx=0).stop 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 msgr2=0x55fb9d57b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f23d4000c10 tx=0x7f23d40180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 shutdown_connections 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22c4039a70 0x7f22c403bf30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/199796975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d57b440 0x55fb9d57b860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 >> 172.21.15.193:0/199796975 conn(0x55fb9d570df0 msgr2=0x55fb9d5711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 shutdown_connections 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/199796975 wait complete. 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 msgr2=0x55fb9d56aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 0x55fb9d56aee0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 msgr2=0x7f22d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 0x7f22d403bf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f23d40ae000 tx=0x7f23d40a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 msgr2=0x55fb9d563d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55fb9d55d660 tx=0x7f23dc000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 shutdown_connections 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fb9d4750d0 0x55fb9d56aee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f22d4039a70 0x7f22d403bf30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 --2- 172.21.15.193:0/2855536376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fb9d470f80 0x55fb9d563d70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 >> 172.21.15.193:0/2855536376 conn(0x55fb9d46caa0 msgr2=0x55fb9d556da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 shutdown_connections 2024-09-12T17:11:25.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.323+0000 7f23edd609c0 1 -- 172.21.15.193:0/2855536376 wait complete. 2024-09-12T17:11:25.338 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:25.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T17:11:25.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-12T17:11:25.338 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-12T17:11:25.420 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.421 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.415+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.415+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.415+0000 7f1b5c60c9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55936b0b9180 0x55936b147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.415+0000 7f1b5c60c9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55936aff99c0 con 0x55936b1480f0 2024-09-12T17:11:25.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.415+0000 7f1b5c60c9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55936b0496d0 con 0x55936b0b9180 2024-09-12T17:11:25.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b5a112640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55936b0b9180 0x55936b147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b5a112640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55936b0b9180 0x55936b147bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50890/0 (socket says 172.21.15.193:50890) 2024-09-12T17:11:25.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b59911640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55936b1480f0 0x55936b14a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36036/0 (socket says 172.21.15.193:36036) 2024-09-12T17:11:25.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b5a112640 1 -- 172.21.15.193:0/2144649508 learned_addr learned my addr 172.21.15.193:0/2144649508 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b5a112640 1 -- 172.21.15.193:0/2144649508 >> v1:172.21.15.62:6789/0 conn(0x55936b1480f0 legacy=0x55936b14a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.419+0000 7f1b5a112640 1 -- 172.21.15.193:0/2144649508 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936afedca0 con 0x55936b0b9180 2024-09-12T17:11:25.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5a112640 1 --2- 172.21.15.193:0/2144649508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b147bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a4e0 tx=0x7f1b5401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eaf793fe9c696b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b59110640 1 -- 172.21.15.193:0/2144649508 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540aa540 con 0x55936b0b9180 2024-09-12T17:11:25.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b59110640 1 -- 172.21.15.193:0/2144649508 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b540aa6e0 con 0x55936b0b9180 2024-09-12T17:11:25.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b59110640 1 -- 172.21.15.193:0/2144649508 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540aaa40 con 0x55936b0b9180 2024-09-12T17:11:25.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2144649508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 msgr2=0x55936b147bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2144649508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b147bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400a4e0 tx=0x7f1b5401b090 comp rx=0 tx=0).stop 2024-09-12T17:11:25.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2144649508 shutdown_connections 2024-09-12T17:11:25.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2144649508 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b147bb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2144649508 >> 172.21.15.193:0/2144649508 conn(0x55936b13f8a0 msgr2=0x55936b141cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2144649508 shutdown_connections 2024-09-12T17:11:25.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.423+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2144649508 wait complete. 2024-09-12T17:11:25.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.435+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.435+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.435+0000 7f1b5c60c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.435+0000 7f1b5c60c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55936b04d680 con 0x55936b0b9180 2024-09-12T17:11:25.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50896/0 (socket says 172.21.15.193:50896) 2024-09-12T17:11:25.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 -- 172.21.15.193:0/4100158286 learned_addr learned my addr 172.21.15.193:0/4100158286 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 -- 172.21.15.193:0/4100158286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936afc8da0 con 0x55936b0b9180 2024-09-12T17:11:25.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- 172.21.15.193:0/4100158286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b54019740 tx=0x7f1b540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa588365a90b926 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1a48608640 1 -- 172.21.15.193:0/4100158286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540b9070 con 0x55936b0b9180 2024-09-12T17:11:25.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1a48608640 1 -- 172.21.15.193:0/4100158286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b540aaa90 con 0x55936b0b9180 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1a48608640 1 -- 172.21.15.193:0/4100158286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540aad70 con 0x55936b0b9180 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/4100158286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 msgr2=0x55936b230880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/4100158286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1b54019740 tx=0x7f1b540033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/4100158286 shutdown_connections 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/4100158286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b230880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/4100158286 >> 172.21.15.193:0/4100158286 conn(0x55936b13f8a0 msgr2=0x55936b22c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/4100158286 shutdown_connections 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/4100158286 wait complete. 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5c60c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55936afefa50 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50904/0 (socket says 172.21.15.193:50904) 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 -- 172.21.15.193:0/354744298 learned_addr learned my addr 172.21.15.193:0/354744298 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936b2382d0 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.439+0000 7f1b5a112640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b54018cc0 tx=0x7f1b54017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 -- 172.21.15.193:0/354744298 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540b9070 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55936b238560 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 -- 172.21.15.193:0/354744298 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b540b5b10 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936b238f10 con 0x55936b0b9180 2024-09-12T17:11:25.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 -- 172.21.15.193:0/354744298 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b540b5df0 con 0x55936b0b9180 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 -- 172.21.15.193:0/354744298 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1b540b3040 con 0x55936b0b9180 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 0x7f1a4003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1a46e05640 1 -- 172.21.15.193:0/354744298 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1b540c4070 con 0x55936b0b9180 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b59911640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 0x7f1a4003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 0x55936b23eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b23f420 con 0x55936b1480f0 2024-09-12T17:11:25.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5a913640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 0x55936b23eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b59911640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 0x7f1a4003bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001e40 tx=0x7f1b4c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5a913640 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 0x55936b23eee0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5a913640 1 -- 172.21.15.193:0/354744298 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b440083f0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b23f840 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5a913640 1 -- 172.21.15.193:0/354744298 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b440083f0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b241140 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5a913640 1 -- 172.21.15.193:0/354744298 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b440083f0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.443+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b240370 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5a913640 1 -- 172.21.15.193:0/354744298 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b440083f0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2407c0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5a913640 1 -- 172.21.15.193:0/354744298 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b440083f0 con 0x55936b1480f0 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55936b05a450 con 0x55936b145310 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50906/0 (socket says 172.21.15.193:50906) 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b59911640 1 -- 172.21.15.193:0/2262393241 learned_addr learned my addr 172.21.15.193:0/2262393241 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b59911640 1 -- 172.21.15.193:0/2262393241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936b145830 con 0x55936b145310 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b59911640 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e670 tx=0x7f1b4c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1a3ffff640 1 -- 172.21.15.193:0/2262393241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c022070 con 0x55936b145310 2024-09-12T17:11:25.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1a3ffff640 1 -- 172.21.15.193:0/2262393241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c00d660 con 0x55936b145310 2024-09-12T17:11:25.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55936b1440f0 con 0x55936b145310 2024-09-12T17:11:25.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1a3ffff640 1 -- 172.21.15.193:0/2262393241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c006070 con 0x55936b145310 2024-09-12T17:11:25.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936b144660 con 0x55936b145310 2024-09-12T17:11:25.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1a3ffff640 1 -- 172.21.15.193:0/2262393241 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1b4c025070 con 0x55936b145310 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.447+0000 7f1a3ffff640 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 0x7f1a3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1a3ffff640 1 -- 172.21.15.193:0/2262393241 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1b4c051a30 con 0x55936b145310 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5a913640 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 0x7f1a3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5a913640 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 0x7f1a3403bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55936b23fe90 tx=0x7f1b44003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55936b231010 con 0x55936b25efa0 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50918/0 (socket says 172.21.15.193:50918) 2024-09-12T17:11:25.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 -- 172.21.15.193:0/1140001339 learned_addr learned my addr 172.21.15.193:0/1140001339 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 -- 172.21.15.193:0/1140001339 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936b25f990 con 0x55936b25efa0 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 --2- 172.21.15.193:0/1140001339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c04fe70 tx=0x7f1b4c024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2d74e2fbf66069 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1a3dffb640 1 -- 172.21.15.193:0/1140001339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c0263b0 con 0x55936b25efa0 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1a3dffb640 1 -- 172.21.15.193:0/1140001339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c04d020 con 0x55936b25efa0 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1a3dffb640 1 -- 172.21.15.193:0/1140001339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c00dcc0 con 0x55936b25efa0 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/1140001339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 msgr2=0x55936b25f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/1140001339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c04fe70 tx=0x7f1b4c024c90 comp rx=0 tx=0).stop 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/1140001339 shutdown_connections 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/1140001339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b25f3a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/1140001339 >> 172.21.15.193:0/1140001339 conn(0x55936b25a3c0 msgr2=0x55936b258600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/1140001339 shutdown_connections 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/1140001339 wait complete. 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 Processor -- start 2024-09-12T17:11:25.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- start start 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b265540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b5c60c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55936b25def0 con 0x55936b25efa0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b265540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b265540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50930/0 (socket says 172.21.15.193:50930) 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.451+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 learned_addr learned my addr 172.21.15.193:0/3321413445 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936b265aa0 con 0x55936b25efa0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b59911640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b265540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00ef00 tx=0x7f1b4c04fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 -- 172.21.15.193:0/3321413445 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c026550 con 0x55936b25efa0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55936b265d30 con 0x55936b25efa0 2024-09-12T17:11:25.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 -- 172.21.15.193:0/3321413445 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4c01a530 con 0x55936b25efa0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 -- 172.21.15.193:0/3321413445 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4c01a850 con 0x55936b25efa0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936b265d30 con 0x55936b25efa0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 -- 172.21.15.193:0/3321413445 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1b4c01b8c0 con 0x55936b25efa0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a24039a70 0x7f1a2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1a2bfff640 1 -- 172.21.15.193:0/3321413445 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1b4c047040 con 0x55936b25efa0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a913640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a24039a70 0x7f1a2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b2706d0 0x55936b272b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2732b0 con 0x55936b2706d0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b2706d0 0x55936b272b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a913640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a24039a70 0x7f1a2403bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400f010 tx=0x7f1b4401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b2706d0 0x55936b272b60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 realm 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2736c0 con 0x55936b2706d0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:25.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b273f90 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b274330 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.455+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b274b80 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5c60c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:25.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5c60c9c0 20 searching for the correct realm 2024-09-12T17:11:25.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55936b2768f0 0x55936b278ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b59911640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55936b2768f0 0x55936b278ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b59911640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55936b2768f0 0x55936b278ce0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b59911640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1b4c027060 0x7f1b4c027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b4c027060 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a913640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1b4c027060 0x7f1b4c027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a913640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1b4c027060 0x7f1b4c027440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a913640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1b44019040 0x7f1b44019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1b44019040 0x7f1b44019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1b44019040 0x7f1b44019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.459+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b4c027060 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b4c027060 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.463+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b4c027060 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2706d0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.467+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b4c027060 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x55936b2768f0 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55936b279220 con 0x7f1b44019040 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1b540fe040 con 0x55936b2706d0 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1b540fe040 con 0x7f1b4c027060 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:25.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2753d0 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b275770 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b275770 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:25.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 zone default found 2024-09-12T17:11:25.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 4 Realm: () 2024-09-12T17:11:25.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:25.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:25.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 zonegroup default 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b274f50 con 0x7f1b44019040 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b27b040 con 0x55936b2768f0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b27b3e0 con 0x55936b2768f0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.471+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 20 started sync module instance, tier type = 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27a4e0 con 0x7f1b4c027060 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94091646314752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27bc30 con 0x7f1b4c027060 2024-09-12T17:11:25.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27c480 con 0x55936b2706d0 2024-09-12T17:11:25.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94091646314752] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94091646318464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27c050 con 0x55936b2706d0 2024-09-12T17:11:25.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.475+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ca50 con 0x55936b2768f0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94091646322016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27d320 con 0x55936b2768f0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27dce0 con 0x7f1b4c027060 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94091646318464] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94091646326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27dc50 con 0x7f1b4c027060 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.479+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ea70 con 0x55936b2706d0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94091646326832] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94091646322016] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94091646324336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ea70 con 0x55936b2706d0 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ee60 con 0x7f1b44019040 2024-09-12T17:11:25.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94091646330240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27f250 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27fd00 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.483+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94091646324336] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94091646330240] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94091646329040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ebe0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2801b0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94091646336256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2805d0 con 0x7f1b44019040 2024-09-12T17:11:25.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=0 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=1 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=2 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=3 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=4 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.487+0000 7f1b5c60c9c0 20 add_watcher() i=5 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94091646329040] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 add_watcher() i=6 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94091646336256] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 add_watcher() i=7 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2805d0 con 0x55936b2706d0 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94091646337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b280540 con 0x55936b2706d0 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94091646337312] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1a10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 5 note: GC not initialized 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f198b7fe640 20 reqs_thread_entry: start 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 Filter name: none 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f19897fa640 20 reqs_thread_entry: start 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a6850 con 0x55936b2706d0 2024-09-12T17:11:25.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.491+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a72c0 con 0x7f1b44019040 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:11:25.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2acb80 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94091646518832 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a8310 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94091646324336 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f1b540d7040 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1a3dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94091646324336 notifier 4342 bl.length()=678 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1a3dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1a3dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(65 notify.4 [notify cookie 94091646518832 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1a3dffb640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1a20003eb0 con 0x55936b2706d0 2024-09-12T17:11:25.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94091646518832 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55936b238f10 con 0x55936b2706d0 2024-09-12T17:11:25.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.495+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2ac630 con 0x7f1b44019040 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94091646518832 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a7e60 con 0x55936b2768f0 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 94091646322016 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55936b265aa0 con 0x55936b2768f0 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1a3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94091646322016 notifier 4342 bl.length()=177 2024-09-12T17:11:25.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1a3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1a3d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 notify.2 [notify cookie 94091646518832 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1a3d7fa640 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1990003410 con 0x55936b2768f0 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== watch-notify(notify_complete (2) cookie 94091646518832 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55936b25f990 con 0x55936b2768f0 2024-09-12T17:11:25.507 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:11:25.499302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:25.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1a10fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94091646337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a8740 con 0x55936b2706d0 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94091646337312] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.499+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94091646314752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a45d0 con 0x7f1b4c027060 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94091646314752] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5c60c9c0 20 remove_watcher() i=0 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5c60c9c0 2 removed watcher, disabling cache 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94091646318464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a45d0 con 0x55936b2706d0 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94091646318464] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5c60c9c0 20 remove_watcher() i=1 2024-09-12T17:11:25.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.503+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94091646322016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b2a45d0 con 0x55936b2768f0 2024-09-12T17:11:25.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b59911640 1 -- 172.21.15.193:0/3321413445 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94091646322016] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4c024030 con 0x55936b2768f0 2024-09-12T17:11:25.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b5c60c9c0 20 remove_watcher() i=2 2024-09-12T17:11:25.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94091646326832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27a900 con 0x7f1b4c027060 2024-09-12T17:11:25.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b5a913640 1 -- 172.21.15.193:0/3321413445 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94091646326832] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b4402f040 con 0x7f1b4c027060 2024-09-12T17:11:25.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b5c60c9c0 20 remove_watcher() i=3 2024-09-12T17:11:25.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.507+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94091646324336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27b780 con 0x55936b2706d0 2024-09-12T17:11:25.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94091646324336] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x55936b2706d0 2024-09-12T17:11:25.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5c60c9c0 20 remove_watcher() i=4 2024-09-12T17:11:25.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94091646330240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27d830 con 0x7f1b44019040 2024-09-12T17:11:25.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94091646330240] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5c60c9c0 20 remove_watcher() i=5 2024-09-12T17:11:25.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.511+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94091646329040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27a900 con 0x7f1b44019040 2024-09-12T17:11:25.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94091646329040] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 20 remove_watcher() i=6 2024-09-12T17:11:25.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94091646336256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55936b27ce70 con 0x7f1b44019040 2024-09-12T17:11:25.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94091646336256] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b540c7de0 con 0x7f1b44019040 2024-09-12T17:11:25.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 20 remove_watcher() i=7 2024-09-12T17:11:25.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1b44019040 msgr2=0x7f1b44019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1b44019040 0x7f1b44019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b2706d0 msgr2=0x55936b272b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b2706d0 0x55936b272b60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1b4c027060 msgr2=0x7f1b4c027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1b4c027060 0x7f1b4c027440 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55936b2768f0 msgr2=0x55936b278ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55936b2768f0 0x55936b278ce0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a24039a70 msgr2=0x7f1a2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a24039a70 0x7f1a2403bf30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400f010 tx=0x7f1b4401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 msgr2=0x55936b265540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/3321413445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b25efa0 0x55936b265540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00ef00 tx=0x7f1b4c04fdd0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 reap_dead start 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5a112640 1 -- 172.21.15.193:0/3321413445 reap_dead start 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 shutdown_connections 2024-09-12T17:11:25.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 >> 172.21.15.193:0/3321413445 conn(0x55936b25a3c0 msgr2=0x55936b2585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 shutdown_connections 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/3321413445 wait complete. 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 msgr2=0x7f1a3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 0x7f1a3403bf30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55936b23fe90 tx=0x7f1b44003070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 msgr2=0x55936b143bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e670 tx=0x7f1b4c00ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 shutdown_connections 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a34039a70 0x7f1a3403bf30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/2262393241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b145310 0x55936b143bb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 >> 172.21.15.193:0/2262393241 conn(0x55936b244de0 msgr2=0x55936b2451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 shutdown_connections 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/2262393241 wait complete. 2024-09-12T17:11:25.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 msgr2=0x55936b23eee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 0x55936b23eee0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 msgr2=0x7f1a4003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 0x7f1a4003bf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001e40 tx=0x7f1b4c0013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 msgr2=0x55936b237d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1b54018cc0 tx=0x7f1b54017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 shutdown_connections 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55936b1480f0 0x55936b23eee0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1a40039a70 0x7f1a4003bf30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 --2- 172.21.15.193:0/354744298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55936b0b9180 0x55936b237d70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 >> 172.21.15.193:0/354744298 conn(0x55936b13f8a0 msgr2=0x55936b22af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 shutdown_connections 2024-09-12T17:11:25.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.515+0000 7f1b5c60c9c0 1 -- 172.21.15.193:0/354744298 wait complete. 2024-09-12T17:11:25.530 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:11:25.499302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:25.530 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:25.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:25.531 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:25.607 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.607 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecffe949c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c1a7fa0d0 0x561c1a7fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecffe949c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c1a6aa9c0 con 0x561c1a7f5f80 2024-09-12T17:11:25.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecffe949c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561c1a6fa6d0 con 0x561c1a7fa0d0 2024-09-12T17:11:25.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecfd199640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c1a7fa0d0 0x561c1a7fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecfd199640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561c1a7fa0d0 0x561c1a7fc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50942/0 (socket says 172.21.15.193:50942) 2024-09-12T17:11:25.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecfd199640 1 -- 172.21.15.193:0/3930883090 learned_addr learned my addr 172.21.15.193:0/3930883090 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecfd199640 1 -- 172.21.15.193:0/3930883090 >> v1:172.21.15.62:6789/0 conn(0x561c1a7f5f80 legacy=0x561c1a7f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.603+0000 7fecfd199640 1 -- 172.21.15.193:0/3930883090 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a69eca0 con 0x561c1a7fa0d0 2024-09-12T17:11:25.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecfd199640 1 --2- 172.21.15.193:0/3930883090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a7fc4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a5c0 tx=0x7fecf401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d2776a5ff5732e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecfc998640 1 -- 172.21.15.193:0/3930883090 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40a9590 con 0x561c1a7fa0d0 2024-09-12T17:11:25.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecfc998640 1 -- 172.21.15.193:0/3930883090 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40ae070 con 0x561c1a7fa0d0 2024-09-12T17:11:25.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecfc998640 1 -- 172.21.15.193:0/3930883090 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40a9880 con 0x561c1a7fa0d0 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 -- 172.21.15.193:0/3930883090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 msgr2=0x561c1a7fc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3930883090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a7fc4c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fecf400a5c0 tx=0x7fecf401b3d0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 -- 172.21.15.193:0/3930883090 shutdown_connections 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3930883090 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a7fc4c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 -- 172.21.15.193:0/3930883090 >> 172.21.15.193:0/3930883090 conn(0x561c1a7f1aa0 msgr2=0x561c1a7f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 -- 172.21.15.193:0/3930883090 shutdown_connections 2024-09-12T17:11:25.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.607+0000 7fecffe949c0 1 -- 172.21.15.193:0/3930883090 wait complete. 2024-09-12T17:11:25.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.619+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.619+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.619+0000 7fecffe949c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.619+0000 7fecffe949c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c1a6fe680 con 0x561c1a7f5f80 2024-09-12T17:11:25.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.619+0000 7fecfd99a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50948/0 (socket says 172.21.15.193:50948) 2024-09-12T17:11:25.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 -- 172.21.15.193:0/3667980472 learned_addr learned my addr 172.21.15.193:0/3667980472 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 -- 172.21.15.193:0/3667980472 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a679da0 con 0x561c1a7f5f80 2024-09-12T17:11:25.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 --2- 172.21.15.193:0/3667980472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b220 tx=0x7fecf000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4068a38a2a9b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febebe07640 1 -- 172.21.15.193:0/3667980472 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf000a040 con 0x561c1a7f5f80 2024-09-12T17:11:25.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febebe07640 1 -- 172.21.15.193:0/3667980472 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf000f750 con 0x561c1a7f5f80 2024-09-12T17:11:25.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febebe07640 1 -- 172.21.15.193:0/3667980472 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf000fa70 con 0x561c1a7f5f80 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/3667980472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 msgr2=0x561c1a8e16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3667980472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fecf000b220 tx=0x7fecf000b6e0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/3667980472 shutdown_connections 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3667980472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7f5f80 0x561c1a8e16d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/3667980472 >> 172.21.15.193:0/3667980472 conn(0x561c1a7f1aa0 msgr2=0x561c1a8dd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/3667980472 shutdown_connections 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/3667980472 wait complete. 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c1a6a0a50 con 0x561c1a7fa0d0 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50952/0 (socket says 172.21.15.193:50952) 2024-09-12T17:11:25.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 -- 172.21.15.193:0/131882980 learned_addr learned my addr 172.21.15.193:0/131882980 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a8e9650 con 0x561c1a7fa0d0 2024-09-12T17:11:25.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecfd99a640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fecf0002000 tx=0x7fecf0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febea604640 1 -- 172.21.15.193:0/131882980 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf001a7c0 con 0x561c1a7fa0d0 2024-09-12T17:11:25.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c1a8e98e0 con 0x561c1a7fa0d0 2024-09-12T17:11:25.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febea604640 1 -- 172.21.15.193:0/131882980 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf001a960 con 0x561c1a7fa0d0 2024-09-12T17:11:25.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c1a8ea220 con 0x561c1a7fa0d0 2024-09-12T17:11:25.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.623+0000 7febea604640 1 -- 172.21.15.193:0/131882980 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf002c060 con 0x561c1a7fa0d0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7febea604640 1 -- 172.21.15.193:0/131882980 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecf0017070 con 0x561c1a7fa0d0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7febea604640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 0x7febe403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7febea604640 1 -- 172.21.15.193:0/131882980 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fecf0015020 con 0x561c1a7fa0d0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfd199640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 0x7febe403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 0x561c1a8f0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a8f0a90 con 0x561c1a8ee160 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 0x561c1a8f0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfd199640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 0x7febe403bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ad000 tx=0x7fecf40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 0x561c1a8f0550 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 -- 172.21.15.193:0/131882980 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf800a4d0 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a8f0e30 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 -- 172.21.15.193:0/131882980 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecf800a4d0 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a8f2730 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 -- 172.21.15.193:0/131882980 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fecf800a4d0 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a8f1960 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 -- 172.21.15.193:0/131882980 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecf800a4d0 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a8f1d80 con 0x561c1a8ee160 2024-09-12T17:11:25.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecfe19b640 1 -- 172.21.15.193:0/131882980 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fecf800a4d0 con 0x561c1a8ee160 2024-09-12T17:11:25.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.627+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c1a70b450 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50960/0 (socket says 172.21.15.193:50960) 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfd199640 1 -- 172.21.15.193:0/2327293484 learned_addr learned my addr 172.21.15.193:0/2327293484 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfd199640 1 -- 172.21.15.193:0/2327293484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a9014f0 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfd199640 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fecf4017fe0 tx=0x7fecf4018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 -- 172.21.15.193:0/2327293484 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40b3ba0 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c1a901d50 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 -- 172.21.15.193:0/2327293484 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40b3d40 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 -- 172.21.15.193:0/2327293484 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40c8560 con 0x561c1a900a90 2024-09-12T17:11:25.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c1a902260 con 0x561c1a900a90 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 -- 172.21.15.193:0/2327293484 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecf40c8700 con 0x561c1a900a90 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 0x7febd803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7febe37fe640 1 -- 172.21.15.193:0/2327293484 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fecf40ede20 con 0x561c1a900a90 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfe19b640 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 0x7febd803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecfe19b640 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 0x7febd803bf20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x561c1a8f1d00 tx=0x7fecf8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.631+0000 7fecffe949c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c1a8e1f20 con 0x561c1a90e340 2024-09-12T17:11:25.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50974/0 (socket says 172.21.15.193:50974) 2024-09-12T17:11:25.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 -- 172.21.15.193:0/3335912792 learned_addr learned my addr 172.21.15.193:0/3335912792 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 -- 172.21.15.193:0/3335912792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a90ed30 con 0x561c1a90e340 2024-09-12T17:11:25.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- 172.21.15.193:0/3335912792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ec190 tx=0x7fecf40c8e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21cf6902e8da91a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febe17fa640 1 -- 172.21.15.193:0/3335912792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40bea10 con 0x561c1a90e340 2024-09-12T17:11:25.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febe17fa640 1 -- 172.21.15.193:0/3335912792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40be410 con 0x561c1a90e340 2024-09-12T17:11:25.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febe17fa640 1 -- 172.21.15.193:0/3335912792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40e5860 con 0x561c1a90e340 2024-09-12T17:11:25.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/3335912792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 msgr2=0x561c1a90e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3335912792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ec190 tx=0x7fecf40c8e60 comp rx=0 tx=0).stop 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/3335912792 shutdown_connections 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 --2- 172.21.15.193:0/3335912792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a90e740 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/3335912792 >> 172.21.15.193:0/3335912792 conn(0x561c1a909760 msgr2=0x561c1a9079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/3335912792 shutdown_connections 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/3335912792 wait complete. 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 Processor -- start 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- start start 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561c1a90d290 con 0x561c1a90e340 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50982/0 (socket says 172.21.15.193:50982) 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 learned_addr learned my addr 172.21.15.193:0/4179924441 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1a914e00 con 0x561c1a90e340 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecfd199640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ec190 tx=0x7fecf40ec1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febcf7fe640 1 -- 172.21.15.193:0/4179924441 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40df040 con 0x561c1a90e340 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febcf7fe640 1 -- 172.21.15.193:0/4179924441 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40c7600 con 0x561c1a90e340 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7febcf7fe640 1 -- 172.21.15.193:0/4179924441 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecf40c78e0 con 0x561c1a90e340 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c1a915090 con 0x561c1a90e340 2024-09-12T17:11:25.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.635+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c1a915a40 con 0x561c1a90e340 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7febcf7fe640 1 -- 172.21.15.193:0/4179924441 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fecf40f1070 con 0x561c1a90e340 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7febcf7fe640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febc8039a70 0x7febc803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7febcf7fe640 1 -- 172.21.15.193:0/4179924441 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fecf40dbc80 con 0x561c1a90e340 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfe19b640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febc8039a70 0x7febc803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a91fba0 0x561c1a921ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a922740 con 0x561c1a91fba0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a91fba0 0x561c1a921ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfe19b640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febc8039a70 0x7febc803bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x561c1a8f1480 tx=0x7fecf801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a91fba0 0x561c1a921ff0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 realm 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a922b50 con 0x561c1a91fba0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a923420 con 0x561c1a91fba0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9237c0 con 0x561c1a91fba0 2024-09-12T17:11:25.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a924010 con 0x561c1a91fba0 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 20 searching for the correct realm 2024-09-12T17:11:25.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561c1a925d80 0x561c1a928170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd199640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561c1a925d80 0x561c1a928170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd199640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561c1a925d80 0x561c1a928170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd199640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fecf40f3070 0x7fecf40f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.639+0000 7fecfe19b640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fecf40f3070 0x7fecf40f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fecf40f3070 0x7fecf40f5a60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fecf8031040 0x7fecf8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fecf8031040 0x7fecf8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fecf8031040 0x7fecf8032940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.643+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.647+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a925d80 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf8031040 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.651+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x561c1a91fba0 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9286b0 con 0x7fecf40f3070 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fecf801f070 con 0x7fecf40f3070 2024-09-12T17:11:25.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a924960 con 0x561c1a91fba0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9245a0 con 0x561c1a91fba0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a925280 con 0x561c1a91fba0 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 zone default found 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 4 Realm: () 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 zonegroup default 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a925280 con 0x7fecf8031040 2024-09-12T17:11:25.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92a4d0 con 0x561c1a925d80 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92a870 con 0x561c1a925d80 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 started sync module instance, tier type = 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a929970 con 0x7fecf40f3070 2024-09-12T17:11:25.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94678704889232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92b0c0 con 0x7fecf40f3070 2024-09-12T17:11:25.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.655+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92b910 con 0x561c1a91fba0 2024-09-12T17:11:25.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.659+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94678704889232] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.659+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.659+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94678704892944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92b4e0 con 0x561c1a91fba0 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.659+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92c000 con 0x561c1a925d80 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.659+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94678704892944] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94678704894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92b450 con 0x561c1a925d80 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92cd50 con 0x7fecf40f3070 2024-09-12T17:11:25.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94678704900560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92d5f0 con 0x7fecf40f3070 2024-09-12T17:11:25.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92dff0 con 0x561c1a91fba0 2024-09-12T17:11:25.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94678704894000] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94678704900560] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94678704899056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92d140 con 0x561c1a91fba0 2024-09-12T17:11:25.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.663+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92e890 con 0x7fecf8031040 2024-09-12T17:11:25.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.667+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94678704899056] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.667+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.667+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94678704904960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92d140 con 0x7fecf8031040 2024-09-12T17:11:25.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.667+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92ece0 con 0x7fecf8031040 2024-09-12T17:11:25.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94678704904960] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94678704906704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92eca0 con 0x7fecf8031040 2024-09-12T17:11:25.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92f6e0 con 0x7fecf8031040 2024-09-12T17:11:25.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94678704906704] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94678704910768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92f8c0 con 0x7fecf8031040 2024-09-12T17:11:25.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=0 2024-09-12T17:11:25.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=1 2024-09-12T17:11:25.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=2 2024-09-12T17:11:25.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=3 2024-09-12T17:11:25.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=4 2024-09-12T17:11:25.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=5 2024-09-12T17:11:25.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.671+0000 7fecffe949c0 20 add_watcher() i=6 2024-09-12T17:11:25.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94678704910768] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 add_watcher() i=7 2024-09-12T17:11:25.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:25.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a932c90 con 0x561c1a91fba0 2024-09-12T17:11:25.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94678704912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a930080 con 0x561c1a91fba0 2024-09-12T17:11:25.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94678704912304] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7febaffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:25.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:25.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 5 note: GC not initialized 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7febaeffd640 20 reqs_thread_entry: start 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 Filter name: none 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7febacff9640 20 reqs_thread_entry: start 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.675+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1a955910 con 0x561c1a91fba0 2024-09-12T17:11:25.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T17:11:25.683 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:11:25.499302Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:25.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7febaffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94678704912304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a9543c0 con 0x561c1a91fba0 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94678704912304] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94678704889232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a953750 con 0x7fecf40f3070 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94678704889232] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 20 remove_watcher() i=0 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 2 removed watcher, disabling cache 2024-09-12T17:11:25.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.679+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94678704892944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a953750 con 0x561c1a91fba0 2024-09-12T17:11:25.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94678704892944] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecffe949c0 20 remove_watcher() i=1 2024-09-12T17:11:25.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94678704894000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a953750 con 0x561c1a925d80 2024-09-12T17:11:25.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecfd199640 1 -- 172.21.15.193:0/4179924441 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94678704894000] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf40fa070 con 0x561c1a925d80 2024-09-12T17:11:25.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecffe949c0 20 remove_watcher() i=2 2024-09-12T17:11:25.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.683+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94678704900560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a929d90 con 0x7fecf40f3070 2024-09-12T17:11:25.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecfe19b640 1 -- 172.21.15.193:0/4179924441 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94678704900560] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf8040040 con 0x7fecf40f3070 2024-09-12T17:11:25.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecffe949c0 20 remove_watcher() i=3 2024-09-12T17:11:25.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94678704899056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92c9d0 con 0x561c1a91fba0 2024-09-12T17:11:25.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94678704899056] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x561c1a91fba0 2024-09-12T17:11:25.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecffe949c0 20 remove_watcher() i=4 2024-09-12T17:11:25.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94678704904960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92c3f0 con 0x7fecf8031040 2024-09-12T17:11:25.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.687+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94678704904960] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.691+0000 7fecffe949c0 20 remove_watcher() i=5 2024-09-12T17:11:25.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.691+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94678704906704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92c3f0 con 0x7fecf8031040 2024-09-12T17:11:25.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.691+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94678704906704] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.691+0000 7fecffe949c0 20 remove_watcher() i=6 2024-09-12T17:11:25.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.691+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94678704910768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1a92e1d0 con 0x7fecf8031040 2024-09-12T17:11:25.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94678704910768] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fecf002e070 con 0x7fecf8031040 2024-09-12T17:11:25.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 20 remove_watcher() i=7 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fecf8031040 msgr2=0x7fecf8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fecf8031040 0x7fecf8032940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a91fba0 msgr2=0x561c1a921ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a91fba0 0x561c1a921ff0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fecf40f3070 msgr2=0x7fecf40f5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fecf40f3070 0x7fecf40f5a60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561c1a925d80 msgr2=0x561c1a928170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561c1a925d80 0x561c1a928170 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febc8039a70 msgr2=0x7febc803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febc8039a70 0x7febc803bf30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x561c1a8f1480 tx=0x7fecf801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecfd99a640 1 -- 172.21.15.193:0/4179924441 reap_dead start 2024-09-12T17:11:25.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 msgr2=0x561c1a9148a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ec190 tx=0x7fecf40ec1c0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 shutdown_connections 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/4179924441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a90e340 0x561c1a9148a0 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ec190 tx=0x7fecf40ec1c0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 >> 172.21.15.193:0/4179924441 conn(0x561c1a909760 msgr2=0x561c1a907970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 shutdown_connections 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/4179924441 wait complete. 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 msgr2=0x7febd803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 0x7febd803bf20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x561c1a8f1d00 tx=0x7fecf8005850 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 msgr2=0x561c1a900eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fecf4017fe0 tx=0x7fecf4018170 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 shutdown_connections 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febd8039a60 0x7febd803bf20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/2327293484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a900a90 0x561c1a900eb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 >> 172.21.15.193:0/2327293484 conn(0x561c1a8f6440 msgr2=0x561c1a8f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 shutdown_connections 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/2327293484 wait complete. 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 msgr2=0x561c1a8f0550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 0x561c1a8f0550 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 msgr2=0x7febe403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 0x7febe403bf30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fecf40ad000 tx=0x7fecf40a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 msgr2=0x561c1a8e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fecf0002000 tx=0x7fecf0000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 shutdown_connections 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561c1a8ee160 0x561c1a8f0550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7febe4039a70 0x7febe403bf30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 --2- 172.21.15.193:0/131882980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561c1a7fa0d0 0x561c1a8e90f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 >> 172.21.15.193:0/131882980 conn(0x561c1a7f1aa0 msgr2=0x561c1a8e29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 shutdown_connections 2024-09-12T17:11:25.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.695+0000 7fecffe949c0 1 -- 172.21.15.193:0/131882980 wait complete. 2024-09-12T17:11:25.708 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:11:25.499302Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:25.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T17:11:25.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-12T17:11:25.709 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-12T17:11:25.779 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.779 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e7c2a9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55696cf6fe40 0x55696cf70220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e7c2a9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55696ce259c0 con 0x55696cf73020 2024-09-12T17:11:25.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e7c2a9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55696ce756d0 con 0x55696cf6fe40 2024-09-12T17:11:25.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e5730640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55696cf6fe40 0x55696cf70220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e5730640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55696cf6fe40 0x55696cf70220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50992/0 (socket says 172.21.15.193:50992) 2024-09-12T17:11:25.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e5730640 1 -- 172.21.15.193:0/1622764424 learned_addr learned my addr 172.21.15.193:0/1622764424 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.775+0000 7f50e4f2f640 1 --1- 172.21.15.193:0/1622764424 >> v1:172.21.15.62:6789/0 conn(0x55696cf73020 0x55696cf75410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36060/0 (socket says 172.21.15.193:36060) 2024-09-12T17:11:25.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e5730640 1 -- 172.21.15.193:0/1622764424 >> v1:172.21.15.62:6789/0 conn(0x55696cf73020 legacy=0x55696cf75410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e5730640 1 -- 172.21.15.193:0/1622764424 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696ce19ca0 con 0x55696cf6fe40 2024-09-12T17:11:25.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e5730640 1 --2- 172.21.15.193:0/1622764424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696cf70220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50e000a7a0 tx=0x7f50e001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaa0a2f0c60d3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50d7fff640 1 -- 172.21.15.193:0/1622764424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00b3070 con 0x55696cf6fe40 2024-09-12T17:11:25.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50d7fff640 1 -- 172.21.15.193:0/1622764424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e00a6720 con 0x55696cf6fe40 2024-09-12T17:11:25.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50d7fff640 1 -- 172.21.15.193:0/1622764424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00a6a20 con 0x55696cf6fe40 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1622764424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 msgr2=0x55696cf70220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1622764424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696cf70220 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f50e000a7a0 tx=0x7f50e001d800 comp rx=0 tx=0).stop 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1622764424 shutdown_connections 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1622764424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696cf70220 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1622764424 >> 172.21.15.193:0/1622764424 conn(0x55696cf6b960 msgr2=0x55696cf6dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1622764424 shutdown_connections 2024-09-12T17:11:25.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.779+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1622764424 wait complete. 2024-09-12T17:11:25.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55696ce79680 con 0x55696cf6fe40 2024-09-12T17:11:25.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e5730640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e5730640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51002/0 (socket says 172.21.15.193:51002) 2024-09-12T17:11:25.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e5730640 1 -- 172.21.15.193:0/4004376252 learned_addr learned my addr 172.21.15.193:0/4004376252 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e5730640 1 -- 172.21.15.193:0/4004376252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696cdf4da0 con 0x55696cf6fe40 2024-09-12T17:11:25.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e5730640 1 --2- 172.21.15.193:0/4004376252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f50e00b1040 tx=0x7f50e00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24166813e5bcb873 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f4fd3606640 1 -- 172.21.15.193:0/4004376252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00b3070 con 0x55696cf6fe40 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f4fd3606640 1 -- 172.21.15.193:0/4004376252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e00b4040 con 0x55696cf6fe40 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f4fd3606640 1 -- 172.21.15.193:0/4004376252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00a6c70 con 0x55696cf6fe40 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/4004376252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 msgr2=0x55696d05a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/4004376252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f50e00b1040 tx=0x7f50e00033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/4004376252 shutdown_connections 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/4004376252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d05a5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/4004376252 >> 172.21.15.193:0/4004376252 conn(0x55696cf6b960 msgr2=0x55696d056240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/4004376252 shutdown_connections 2024-09-12T17:11:25.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/4004376252 wait complete. 2024-09-12T17:11:25.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.795+0000 7f50e7c2a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55696ce1ba50 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5730640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5730640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51014/0 (socket says 172.21.15.193:51014) 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5730640 1 -- 172.21.15.193:0/1586205834 learned_addr learned my addr 172.21.15.193:0/1586205834 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5730640 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696d062020 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5730640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50e001b430 tx=0x7f50e001a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 -- 172.21.15.193:0/1586205834 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00c5070 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55696d0622b0 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696d062c60 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 -- 172.21.15.193:0/1586205834 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e00aedd0 con 0x55696cf6fe40 2024-09-12T17:11:25.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 -- 172.21.15.193:0/1586205834 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e00cf060 con 0x55696cf6fe40 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 -- 172.21.15.193:0/1586205834 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50e00c8070 con 0x55696cf6fe40 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 0x7f4fcc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f4fd1e03640 1 -- 172.21.15.193:0/1586205834 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f50e00bd070 con 0x55696cf6fe40 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 0x7f4fcc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 0x55696d068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d069170 con 0x55696cf73020 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5f31640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 0x55696d068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 0x7f4fcc03bf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50dc001e90 tx=0x7f50dc0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5f31640 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 0x55696d068c30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e5f31640 1 -- 172.21.15.193:0/1586205834 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50d80083f0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.799+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d062fe0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e5f31640 1 -- 172.21.15.193:0/1586205834 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50d80083f0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d06af20 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e5f31640 1 -- 172.21.15.193:0/1586205834 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50d80083f0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d06a150 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e5f31640 1 -- 172.21.15.193:0/1586205834 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50d80083f0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d06a570 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e5f31640 1 -- 172.21.15.193:0/1586205834 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50d80083f0 con 0x55696cf73020 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55696ce86450 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51020/0 (socket says 172.21.15.193:51020) 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e4f2f640 1 -- 172.21.15.193:0/3246149328 learned_addr learned my addr 172.21.15.193:0/3246149328 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e4f2f640 1 -- 172.21.15.193:0/3246149328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696d079ce0 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00e670 tx=0x7f50dc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f4fcaffd640 1 -- 172.21.15.193:0/3246149328 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc022070 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f4fcaffd640 1 -- 172.21.15.193:0/3246149328 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc00d660 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55696d07a540 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f4fcaffd640 1 -- 172.21.15.193:0/3246149328 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc006070 con 0x55696d079280 2024-09-12T17:11:25.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.803+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696d07aab0 con 0x55696d079280 2024-09-12T17:11:25.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fcaffd640 1 -- 172.21.15.193:0/3246149328 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50dc025070 con 0x55696d079280 2024-09-12T17:11:25.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fcaffd640 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 0x7f4fbc03bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fcaffd640 1 -- 172.21.15.193:0/3246149328 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f50dc051c70 con 0x55696d079280 2024-09-12T17:11:25.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e5f31640 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 0x7f4fbc03bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e5f31640 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 0x7f4fbc03bfc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55696d06a4f0 tx=0x7f50d8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55696d05ad30 con 0x55696d086bb0 2024-09-12T17:11:25.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51022/0 (socket says 172.21.15.193:51022) 2024-09-12T17:11:25.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e4f2f640 1 -- 172.21.15.193:0/3312602540 learned_addr learned my addr 172.21.15.193:0/3312602540 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e4f2f640 1 -- 172.21.15.193:0/3312602540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696d0875a0 con 0x55696d086bb0 2024-09-12T17:11:25.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/3312602540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04fff0 tx=0x7f50dc00df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f977d3ac6f2d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fc8ff9640 1 -- 172.21.15.193:0/3312602540 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc03f050 con 0x55696d086bb0 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fc8ff9640 1 -- 172.21.15.193:0/3312602540 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc01ae40 con 0x55696d086bb0 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f4fc8ff9640 1 -- 172.21.15.193:0/3312602540 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc01a320 con 0x55696d086bb0 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3312602540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 msgr2=0x55696d086fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3312602540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f50dc04fff0 tx=0x7f50dc00df30 comp rx=0 tx=0).stop 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3312602540 shutdown_connections 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3312602540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d086fb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3312602540 >> 172.21.15.193:0/3312602540 conn(0x55696d081fd0 msgr2=0x55696d080210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3312602540 shutdown_connections 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3312602540 wait complete. 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 Processor -- start 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.807+0000 7f50e7c2a9c0 1 -- start start 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55696d085b00 con 0x55696d086bb0 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e4f2f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51026/0 (socket says 172.21.15.193:51026) 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 learned_addr learned my addr 172.21.15.193:0/2735828625 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55696d08d670 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50dc029040 tx=0x7f50dc04ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 -- 172.21.15.193:0/2735828625 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc01a540 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55696d08d900 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 -- 172.21.15.193:0/2735828625 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc01a6e0 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 -- 172.21.15.193:0/2735828625 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50dc01aa00 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696d08d900 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 -- 172.21.15.193:0/2735828625 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50dc00c710 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fb0039ac0 0x7f4fb003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f4fbaffd640 1 -- 172.21.15.193:0/2735828625 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f50dc032c50 con 0x55696d086bb0 2024-09-12T17:11:25.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e5f31640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fb0039ac0 0x7f4fb003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696d098210 0x55696d09a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09adf0 con 0x55696d098210 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e5730640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696d098210 0x55696d09a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e5730640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696d098210 0x55696d09a6a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e5f31640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fb0039ac0 0x7f4fb003bf80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50d800f010 tx=0x7f50d801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 20 realm 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.811+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09b200 con 0x55696d098210 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09bad0 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09be70 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09c6c0 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:25.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 20 searching for the correct realm 2024-09-12T17:11:25.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55696d09e430 0x55696d0a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55696d09e430 0x55696d0a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55696d09e430 0x55696d0a0820 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e4f2f640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50dc031030 0x7f50dc01c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5f31640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50dc031030 0x7f50dc01c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5f31640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50dc031030 0x7f50dc01c640 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5f31640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50d8019040 0x7f50d8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50d8019040 0x7f50d8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50d8019040 0x7f50d8019930 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.815+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.819+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.823+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d09e430 2024-09-12T17:11:25.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50d8019040 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x55696d098210 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a0d60 con 0x7f50dc031030 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:25.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09d040 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09d8e0 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d09cc80 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 zone default found 2024-09-12T17:11:25.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 4 Realm: () 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 zonegroup default 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.827+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a1190 con 0x7f50d8019040 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a2fa0 con 0x55696d09e430 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a33e0 con 0x55696d09e430 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 started sync module instance, tier type = 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a2440 con 0x7f50dc031030 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93911289309232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a20a0 con 0x7f50dc031030 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a4310 con 0x55696d098210 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.831+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93911289309232] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93911289314912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a4280 con 0x55696d098210 2024-09-12T17:11:25.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a50e0 con 0x55696d09e430 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93911289314912] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93911289317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a54d0 con 0x55696d09e430 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.835+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a5e90 con 0x7f50dc031030 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93911289322224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a6580 con 0x7f50dc031030 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a70a0 con 0x55696d098210 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93911289317120] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93911289322224] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93911289326448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7060 con 0x55696d098210 2024-09-12T17:11:25.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.839+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7940 con 0x7f50d8019040 2024-09-12T17:11:25.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93911289326448] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93911289318176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7510 con 0x7f50d8019040 2024-09-12T17:11:25.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7dc0 con 0x7f50d8019040 2024-09-12T17:11:25.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93911289318176] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93911289327712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7fa0 con 0x7f50d8019040 2024-09-12T17:11:25.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.843+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a87f0 con 0x7f50d8019040 2024-09-12T17:11:25.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93911289332096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a8bd0 con 0x7f50d8019040 2024-09-12T17:11:25.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=0 2024-09-12T17:11:25.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=1 2024-09-12T17:11:25.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=2 2024-09-12T17:11:25.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=3 2024-09-12T17:11:25.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=4 2024-09-12T17:11:25.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=5 2024-09-12T17:11:25.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93911289327712] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=6 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93911289332096] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 20 add_watcher() i=7 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a7500 con 0x55696d098210 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.847+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93911289328832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a9120 con 0x55696d098210 2024-09-12T17:11:25.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93911289328832] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 5 note: GC not initialized 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4f9a7e4640 20 reqs_thread_entry: start 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 Filter name: none 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4f0bfff640 20 reqs_thread_entry: start 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0cee60 con 0x55696d098210 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 20 rados_obj.operate() r=0 bl.length=502 2024-09-12T17:11:25.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:25.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:25.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0d5410 con 0x55696d098210 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93911289515776 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0d0ba0 con 0x55696d098210 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 93911289326448 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55696d062c60 con 0x55696d098210 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4fc8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93911289326448 notifier 4356 bl.length()=567 2024-09-12T17:11:25.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4fc8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4fc8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f4fc8ff9640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4fa8003eb0 con 0x55696d098210 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 93911289515776 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.851+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 93911289515776 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55696d0622b0 con 0x55696d098210 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0d4f00 con 0x7f50d8019040 2024-09-12T17:11:25.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e7c2a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:25.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93911289515776 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55696d0d06f0 con 0x55696d09e430 2024-09-12T17:11:25.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 93911289317120 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55696d08d670 con 0x55696d09e430 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f4fbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 93911289317120 notifier 4356 bl.length()=170 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 notify.2 [notify cookie 93911289515776 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f4fbbfff640 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4f180032d0 con 0x55696d09e430 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== watch-notify(notify_complete (2) cookie 93911289515776 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55696d0875a0 con 0x55696d09e430 2024-09-12T17:11:25.861 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:25.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f4f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:25.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.855+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93911289328832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0ccc20 con 0x55696d098210 2024-09-12T17:11:25.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93911289328832] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93911289309232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0ccc20 con 0x7f50dc031030 2024-09-12T17:11:25.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93911289309232] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e7c2a9c0 20 remove_watcher() i=0 2024-09-12T17:11:25.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e7c2a9c0 2 removed watcher, disabling cache 2024-09-12T17:11:25.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.859+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93911289314912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0ccc20 con 0x55696d098210 2024-09-12T17:11:25.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93911289314912] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 20 remove_watcher() i=1 2024-09-12T17:11:25.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93911289317120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0ccc20 con 0x55696d09e430 2024-09-12T17:11:25.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e4f2f640 1 -- 172.21.15.193:0/2735828625 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93911289317120] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50dc037020 con 0x55696d09e430 2024-09-12T17:11:25.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 20 remove_watcher() i=2 2024-09-12T17:11:25.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93911289322224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a2830 con 0x7f50dc031030 2024-09-12T17:11:25.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e5f31640 1 -- 172.21.15.193:0/2735828625 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93911289322224] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50d802f040 con 0x7f50dc031030 2024-09-12T17:11:25.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 20 remove_watcher() i=3 2024-09-12T17:11:25.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.863+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93911289326448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a3e60 con 0x55696d098210 2024-09-12T17:11:25.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93911289326448] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x55696d098210 2024-09-12T17:11:25.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e7c2a9c0 20 remove_watcher() i=4 2024-09-12T17:11:25.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93911289318176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a5af0 con 0x7f50d8019040 2024-09-12T17:11:25.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93911289318176] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e7c2a9c0 20 remove_watcher() i=5 2024-09-12T17:11:25.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.867+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93911289327712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a4b60 con 0x7f50d8019040 2024-09-12T17:11:25.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93911289327712] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 20 remove_watcher() i=6 2024-09-12T17:11:25.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93911289332096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55696d0a2830 con 0x7f50d8019040 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93911289332096] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50e00c7030 con 0x7f50d8019040 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 20 remove_watcher() i=7 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50d8019040 msgr2=0x7f50d8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50d8019040 0x7f50d8019930 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696d098210 msgr2=0x55696d09a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696d098210 0x55696d09a6a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50dc031030 msgr2=0x7f50dc01c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50dc031030 0x7f50dc01c640 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55696d09e430 msgr2=0x55696d0a0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55696d09e430 0x55696d0a0820 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fb0039ac0 msgr2=0x7f4fb003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fb0039ac0 0x7f4fb003bf80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f50d800f010 tx=0x7f50d801b070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 msgr2=0x55696d08d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e5730640 1 -- 172.21.15.193:0/2735828625 reap_dead start 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.871+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50dc029040 tx=0x7f50dc04ff50 comp rx=0 tx=0).stop 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 shutdown_connections 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/2735828625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d086bb0 0x55696d08d110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 >> 172.21.15.193:0/2735828625 conn(0x55696d081fd0 msgr2=0x55696d0801e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 shutdown_connections 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/2735828625 wait complete. 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 msgr2=0x7f4fbc03bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 0x7f4fbc03bfc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55696d06a4f0 tx=0x7f50d8003070 comp rx=0 tx=0).stop 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 msgr2=0x55696d0796a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00e670 tx=0x7f50dc00ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 shutdown_connections 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fbc039b00 0x7f4fbc03bfc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/3246149328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696d079280 0x55696d0796a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 >> 172.21.15.193:0/3246149328 conn(0x55696d06ec30 msgr2=0x55696d06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 shutdown_connections 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/3246149328 wait complete. 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 msgr2=0x55696d068c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 0x55696d068c30 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 msgr2=0x7f4fcc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 0x7f4fcc03bf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50dc001e90 tx=0x7f50dc0013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 msgr2=0x55696d061ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f50e001b430 tx=0x7f50e001a5a0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 shutdown_connections 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55696cf73020 0x55696d068c30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fcc039ac0 0x7f4fcc03bf80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 --2- 172.21.15.193:0/1586205834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55696cf6fe40 0x55696d061ac0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 >> 172.21.15.193:0/1586205834 conn(0x55696cf6b960 msgr2=0x55696d054cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 shutdown_connections 2024-09-12T17:11:25.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.875+0000 7f50e7c2a9c0 1 -- 172.21.15.193:0/1586205834 wait complete. 2024-09-12T17:11:25.888 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:25.888 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T17:11:25.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-12T17:11:25.888 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-12T17:11:25.966 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:25.966 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093ce569c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578e32881f0 0x5578e32885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093ce569c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578e313a9c0 con 0x5578e328b330 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093ce569c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5578e318a6d0 con 0x5578e32881f0 2024-09-12T17:11:25.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a95c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578e32881f0 0x5578e32885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a95c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578e32881f0 0x5578e32885d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51042/0 (socket says 172.21.15.193:51042) 2024-09-12T17:11:25.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a95c640 1 -- 172.21.15.193:0/2978516399 learned_addr learned my addr 172.21.15.193:0/2978516399 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a15b640 1 --1- 172.21.15.193:0/2978516399 >> v1:172.21.15.62:6789/0 conn(0x5578e328b330 0x5578e328d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36070/0 (socket says 172.21.15.193:36070) 2024-09-12T17:11:25.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a95c640 1 -- 172.21.15.193:0/2978516399 >> v1:172.21.15.62:6789/0 conn(0x5578e328b330 legacy=0x5578e328d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.963+0000 7f093a95c640 1 -- 172.21.15.193:0/2978516399 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e312eca0 con 0x5578e32881f0 2024-09-12T17:11:25.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093a95c640 1 --2- 172.21.15.193:0/2978516399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e32885d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f093000a5c0 tx=0x7f093001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d9aabafb4bc678 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093995a640 1 -- 172.21.15.193:0/2978516399 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300a6070 con 0x5578e32881f0 2024-09-12T17:11:25.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093995a640 1 -- 172.21.15.193:0/2978516399 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300af070 con 0x5578e32881f0 2024-09-12T17:11:25.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093995a640 1 -- 172.21.15.193:0/2978516399 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300aa5c0 con 0x5578e32881f0 2024-09-12T17:11:25.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 -- 172.21.15.193:0/2978516399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 msgr2=0x5578e32885d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 --2- 172.21.15.193:0/2978516399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e32885d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f093000a5c0 tx=0x7f093001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:25.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 -- 172.21.15.193:0/2978516399 shutdown_connections 2024-09-12T17:11:25.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 --2- 172.21.15.193:0/2978516399 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e32885d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 -- 172.21.15.193:0/2978516399 >> 172.21.15.193:0/2978516399 conn(0x5578e31fbb00 msgr2=0x5578e31fbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 -- 172.21.15.193:0/2978516399 shutdown_connections 2024-09-12T17:11:25.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.967+0000 7f093ce569c0 1 -- 172.21.15.193:0/2978516399 wait complete. 2024-09-12T17:11:25.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:25.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:25.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093ce569c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093ce569c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578e318e680 con 0x5578e32881f0 2024-09-12T17:11:25.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093a95c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093a95c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51058/0 (socket says 172.21.15.193:51058) 2024-09-12T17:11:25.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.979+0000 7f093a95c640 1 -- 172.21.15.193:0/1334946146 learned_addr learned my addr 172.21.15.193:0/1334946146 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 -- 172.21.15.193:0/1334946146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e3109da0 con 0x5578e32881f0 2024-09-12T17:11:25.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 --2- 172.21.15.193:0/1334946146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0930018f70 tx=0x7f0930003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87214be4997833b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0828e09640 1 -- 172.21.15.193:0/1334946146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300aa8b0 con 0x5578e32881f0 2024-09-12T17:11:25.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0828e09640 1 -- 172.21.15.193:0/1334946146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300aaa50 con 0x5578e32881f0 2024-09-12T17:11:25.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0828e09640 1 -- 172.21.15.193:0/1334946146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300aad30 con 0x5578e32881f0 2024-09-12T17:11:25.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/1334946146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 msgr2=0x5578e3373880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:25.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 --2- 172.21.15.193:0/1334946146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0930018f70 tx=0x7f0930003030 comp rx=0 tx=0).stop 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/1334946146 shutdown_connections 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 --2- 172.21.15.193:0/1334946146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e32881f0 0x5578e3373880 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/1334946146 >> 172.21.15.193:0/1334946146 conn(0x5578e31fbb00 msgr2=0x5578e336f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/1334946146 shutdown_connections 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/1334946146 wait complete. 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:25.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578e3130a50 con 0x5578e328b330 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51068/0 (socket says 172.21.15.193:51068) 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 -- 172.21.15.193:0/917551121 learned_addr learned my addr 172.21.15.193:0/917551121 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e337b5f0 con 0x5578e328b330 2024-09-12T17:11:25.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093a95c640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0930018f70 tx=0x7f09300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0827606640 1 -- 172.21.15.193:0/917551121 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300c6690 con 0x5578e328b330 2024-09-12T17:11:25.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e337b880 con 0x5578e328b330 2024-09-12T17:11:25.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0827606640 1 -- 172.21.15.193:0/917551121 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300c6830 con 0x5578e328b330 2024-09-12T17:11:25.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e337c190 con 0x5578e328b330 2024-09-12T17:11:25.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.983+0000 7f0827606640 1 -- 172.21.15.193:0/917551121 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09300c69e0 con 0x5578e328b330 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f0827606640 1 -- 172.21.15.193:0/917551121 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f09300ce030 con 0x5578e328b330 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f0827606640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 0x7f082003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f0827606640 1 -- 172.21.15.193:0/917551121 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f09300cc020 con 0x5578e328b330 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093a15b640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 0x7f082003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 0x5578e3382540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e3382a80 con 0x5578e3380150 2024-09-12T17:11:25.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 0x5578e3382540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093a15b640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 0x7f082003bf80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f092c001e40 tx=0x7f092c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 0x5578e3382540 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 -- 172.21.15.193:0/917551121 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f093400a4d0 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e337c510 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 -- 172.21.15.193:0/917551121 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f093400a4d0 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e3384830 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 -- 172.21.15.193:0/917551121 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f093400a4d0 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e3383a60 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 -- 172.21.15.193:0/917551121 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f093400a4d0 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e3383eb0 con 0x5578e3380150 2024-09-12T17:11:25.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093b15d640 1 -- 172.21.15.193:0/917551121 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f093400a4d0 con 0x5578e3380150 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.987+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578e319b450 con 0x5578e3392b40 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51084/0 (socket says 172.21.15.193:51084) 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093a15b640 1 -- 172.21.15.193:0/3512407744 learned_addr learned my addr 172.21.15.193:0/3512407744 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093a15b640 1 -- 172.21.15.193:0/3512407744 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e33935a0 con 0x5578e3392b40 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093a15b640 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e670 tx=0x7f092c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 -- 172.21.15.193:0/3512407744 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c022070 con 0x5578e3392b40 2024-09-12T17:11:25.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e3393e00 con 0x5578e3392b40 2024-09-12T17:11:25.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 -- 172.21.15.193:0/3512407744 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c00d660 con 0x5578e3392b40 2024-09-12T17:11:25.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 -- 172.21.15.193:0/3512407744 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c006070 con 0x5578e3392b40 2024-09-12T17:11:25.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e3394370 con 0x5578e3392b40 2024-09-12T17:11:26.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 -- 172.21.15.193:0/3512407744 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f092c025070 con 0x5578e3392b40 2024-09-12T17:11:26.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 0x7f081403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f0824e01640 1 -- 172.21.15.193:0/3512407744 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f092c051a30 con 0x5578e3392b40 2024-09-12T17:11:26.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093b15d640 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 0x7f081403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.991+0000 7f093b15d640 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 0x7f081403bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5578e3383580 tx=0x7f0934005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578e3374010 con 0x5578e33a04b0 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51100/0 (socket says 172.21.15.193:51100) 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 -- 172.21.15.193:0/3809187687 learned_addr learned my addr 172.21.15.193:0/3809187687 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 -- 172.21.15.193:0/3809187687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e33a0ea0 con 0x5578e33a04b0 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- 172.21.15.193:0/3809187687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f092c04fe70 tx=0x7f092c024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e8432acd863ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081e7fc640 1 -- 172.21.15.193:0/3809187687 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c0263b0 con 0x5578e33a04b0 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081e7fc640 1 -- 172.21.15.193:0/3809187687 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c04d020 con 0x5578e33a04b0 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081e7fc640 1 -- 172.21.15.193:0/3809187687 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c00dcc0 con 0x5578e33a04b0 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/3809187687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 msgr2=0x5578e33a08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3809187687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f092c04fe70 tx=0x7f092c024c90 comp rx=0 tx=0).stop 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/3809187687 shutdown_connections 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3809187687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a08b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/3809187687 >> 172.21.15.193:0/3809187687 conn(0x5578e339b8d0 msgr2=0x5578e3399b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/3809187687 shutdown_connections 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/3809187687 wait complete. 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 Processor -- start 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- start start 2024-09-12T17:11:26.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578e339f400 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51108/0 (socket says 172.21.15.193:51108) 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 learned_addr learned my addr 172.21.15.193:0/580190848 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e33a6f70 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093a15b640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f092c00ef00 tx=0x7f092c04fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081cff9640 1 -- 172.21.15.193:0/580190848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c026550 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578e33a7200 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081cff9640 1 -- 172.21.15.193:0/580190848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f092c01a530 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e33a7200 con 0x5578e33a04b0 2024-09-12T17:11:26.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.995+0000 7f081cff9640 1 -- 172.21.15.193:0/580190848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f092c01a6e0 con 0x5578e33a04b0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f081cff9640 1 -- 172.21.15.193:0/580190848 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f092c01b8c0 con 0x5578e33a04b0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f081cff9640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0804039a70 0x7f080403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f081cff9640 1 -- 172.21.15.193:0/580190848 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f092c047040 con 0x5578e33a04b0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093b15d640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0804039a70 0x7f080403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e33b1be0 0x5578e33b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b47c0 con 0x5578e33b1be0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e33b1be0 0x5578e33b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093b15d640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0804039a70 0x7f080403bf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5578e337c410 tx=0x7f093401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e33b1be0 0x5578e33b4070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 realm 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b4bd0 con 0x5578e33b1be0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b54a0 con 0x5578e33b1be0 2024-09-12T17:11:26.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b5840 con 0x5578e33b1be0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b6090 con 0x5578e33b1be0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 20 searching for the correct realm 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578e33b7e00 0x5578e33ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a15b640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578e33b7e00 0x5578e33ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a15b640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578e33b7e00 0x5578e33ba1f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a15b640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f092c027060 0x7f092c033820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:25.999+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093b15d640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f092c027060 0x7f092c033820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093b15d640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f092c027060 0x7f092c033820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093b15d640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0934031040 0x7f0934032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0934031040 0x7f0934032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0934031040 0x7f0934032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.003+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.007+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b7e00 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f0934031040 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x5578e33b1be0 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.011+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ba730 con 0x7f092c027060 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093401f070 con 0x7f092c027060 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b6a10 con 0x5578e33b1be0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33b72b0 con 0x5578e33b1be0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33baad0 con 0x5578e33b1be0 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 zone default found 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 4 Realm: () 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 zonegroup default 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bab80 con 0x7f0934031040 2024-09-12T17:11:26.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bc9b0 con 0x5578e33b7e00 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bce20 con 0x5578e33b7e00 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bbe50 con 0x7f092c027060 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977696780912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bbab0 con 0x7f092c027060 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.015+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bdd50 con 0x5578e33b1be0 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977696780912] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977696786592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bdcc0 con 0x5578e33b1be0 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33beae0 con 0x5578e33b7e00 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977696790000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bf3b0 con 0x5578e33b7e00 2024-09-12T17:11:26.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.019+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bfdb0 con 0x7f092c027060 2024-09-12T17:11:26.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977696786592] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977696788800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c01a0 con 0x7f092c027060 2024-09-12T17:11:26.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c0b60 con 0x5578e33b1be0 2024-09-12T17:11:26.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977696790000] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977696788800] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977696794816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c06b0 con 0x5578e33b1be0 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.023+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c0f40 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977696794816] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977696792320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c0b60 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c1950 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977696801952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c1d70 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.027+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c2790 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977696792320] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977696805504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c2750 con 0x7f0934031040 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=0 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=1 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=2 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=3 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=4 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=5 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977696801952] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=6 2024-09-12T17:11:26.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977696805504] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 20 add_watcher() i=7 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c18c0 con 0x5578e33b1be0 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.031+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977696803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c2bb0 con 0x5578e33b1be0 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977696803008] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f07f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 5 note: GC not initialized 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f076bfff640 20 reqs_thread_entry: start 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 Filter name: none 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f0769ffb640 20 reqs_thread_entry: start 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e88c0 con 0x5578e33b1be0 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:26.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e9330 con 0x5578e33b1be0 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-12T17:11:26.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33eec20 con 0x5578e33b1be0 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93977696986896 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ea340 con 0x5578e33b1be0 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify (1) cookie 93977696794816 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f09300e5040 con 0x5578e33b1be0 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f081e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93977696794816 notifier 4363 bl.length()=732 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f081e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f081e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify cookie 93977696986896 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f081e7fc640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0800003eb0 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.035+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify_complete (2) cookie 93977696986896 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5578e337c190 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33ee710 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T17:11:26.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93977696986896 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e9e90 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== watch-notify(notify (1) cookie 93977696780912 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f09340247b0 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f081dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 93977696780912 notifier 4363 bl.length()=166 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f081dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f081dffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.0 [notify cookie 93977696986896 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f081dffb640 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0770003410 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== watch-notify(notify_complete (2) cookie 93977696986896 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0934024980 con 0x7f092c027060 2024-09-12T17:11:26.051 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"urecxOfC7g5BEte1sXXH6ve3loCDGqUuCV5B02MJ","active":true,"create_date":"2024-09-12T17:11:26.040949Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f07f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977696803008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x5578e33b1be0 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93977696803008] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.039+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977696780912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x7f092c027060 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93977696780912] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093ce569c0 20 remove_watcher() i=0 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093ce569c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977696786592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x5578e33b1be0 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93977696786592] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093ce569c0 20 remove_watcher() i=1 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.043+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977696790000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bd8a0 con 0x5578e33b7e00 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093a15b640 1 -- 172.21.15.193:0/580190848 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93977696790000] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f092c024030 con 0x5578e33b7e00 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093ce569c0 20 remove_watcher() i=2 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977696788800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x7f092c027060 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093b15d640 1 -- 172.21.15.193:0/580190848 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93977696788800] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934040040 con 0x7f092c027060 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093ce569c0 20 remove_watcher() i=3 2024-09-12T17:11:26.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.047+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977696794816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x5578e33b1be0 2024-09-12T17:11:26.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93977696794816] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x5578e33b1be0 2024-09-12T17:11:26.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093ce569c0 20 remove_watcher() i=4 2024-09-12T17:11:26.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977696792320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33bf8c0 con 0x7f0934031040 2024-09-12T17:11:26.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93977696792320] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093ce569c0 20 remove_watcher() i=5 2024-09-12T17:11:26.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.051+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977696801952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33e66a0 con 0x7f0934031040 2024-09-12T17:11:26.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93977696801952] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 20 remove_watcher() i=6 2024-09-12T17:11:26.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977696805504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578e33c1950 con 0x7f0934031040 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93977696805504] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09300d0930 con 0x7f0934031040 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 20 remove_watcher() i=7 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0934031040 msgr2=0x7f0934032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0934031040 0x7f0934032940 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e33b1be0 msgr2=0x5578e33b4070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e33b1be0 0x5578e33b4070 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f092c027060 msgr2=0x7f092c033820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f092c027060 0x7f092c033820 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578e33b7e00 msgr2=0x5578e33ba1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578e33b7e00 0x5578e33ba1f0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0804039a70 msgr2=0x7f080403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0804039a70 0x7f080403bf30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x5578e337c410 tx=0x7f093401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 msgr2=0x5578e33a6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093a95c640 1 -- 172.21.15.193:0/580190848 reap_dead start 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f092c00ef00 tx=0x7f092c04fdd0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 shutdown_connections 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 --2- 172.21.15.193:0/580190848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e33a04b0 0x5578e33a6a10 secure :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f092c00ef00 tx=0x7f092c04fdd0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 >> 172.21.15.193:0/580190848 conn(0x5578e339b8d0 msgr2=0x5578e3399ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 shutdown_connections 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.055+0000 7f093ce569c0 1 -- 172.21.15.193:0/580190848 wait complete. 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 msgr2=0x7f081403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 0x7f081403bf30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x5578e3383580 tx=0x7f0934005850 comp rx=0 tx=0).stop 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 msgr2=0x5578e3392f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f092c00e670 tx=0x7f092c00ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 shutdown_connections 2024-09-12T17:11:26.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0814039a70 0x7f081403bf30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/3512407744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e3392b40 0x5578e3392f60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 >> 172.21.15.193:0/3512407744 conn(0x5578e33884f0 msgr2=0x5578e33888d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 shutdown_connections 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/3512407744 wait complete. 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 msgr2=0x5578e3382540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 0x5578e3382540 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 msgr2=0x7f082003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 0x7f082003bf80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f092c001e40 tx=0x7f092c0013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 msgr2=0x5578e337b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0930018f70 tx=0x7f09300180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 shutdown_connections 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578e3380150 0x5578e3382540 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0820039ac0 0x7f082003bf80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 --2- 172.21.15.193:0/917551121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578e328b330 0x5578e337b090 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 >> 172.21.15.193:0/917551121 conn(0x5578e31fbb00 msgr2=0x5578e336df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 shutdown_connections 2024-09-12T17:11:26.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.059+0000 7f093ce569c0 1 -- 172.21.15.193:0/917551121 wait complete. 2024-09-12T17:11:26.071 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'urecxOfC7g5BEte1sXXH6ve3loCDGqUuCV5B02MJ', 'active': True, 'create_date': '2024-09-12T17:11:26.040949Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T17:11:26.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-12T17:11:26.072 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-12T17:11:26.155 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:26.155 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:26.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb8744d69c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5601f62bddd0 0x5601f62be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb8744d69c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601f61739c0 con 0x5601f62c0fb0 2024-09-12T17:11:26.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb8744d69c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5601f61c36d0 con 0x5601f62bddd0 2024-09-12T17:11:26.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb871fdc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5601f62bddd0 0x5601f62be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb871fdc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5601f62bddd0 0x5601f62be1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51110/0 (socket says 172.21.15.193:51110) 2024-09-12T17:11:26.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb871fdc640 1 -- 172.21.15.193:0/945168465 learned_addr learned my addr 172.21.15.193:0/945168465 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb871fdc640 1 -- 172.21.15.193:0/945168465 >> v1:172.21.15.62:6789/0 conn(0x5601f62c0fb0 legacy=0x5601f62c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.151+0000 7fb871fdc640 1 -- 172.21.15.193:0/945168465 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f6167ca0 con 0x5601f62bddd0 2024-09-12T17:11:26.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb871fdc640 1 --2- 172.21.15.193:0/945168465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f62be1b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00a4e0 tx=0x7fb86c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94c68bb09b1b87f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb870fda640 1 -- 172.21.15.193:0/945168465 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0aa540 con 0x5601f62bddd0 2024-09-12T17:11:26.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb870fda640 1 -- 172.21.15.193:0/945168465 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb86c0aa6e0 con 0x5601f62bddd0 2024-09-12T17:11:26.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb870fda640 1 -- 172.21.15.193:0/945168465 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0aaa40 con 0x5601f62bddd0 2024-09-12T17:11:26.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 -- 172.21.15.193:0/945168465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 msgr2=0x5601f62be1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/945168465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f62be1b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00a4e0 tx=0x7fb86c01b090 comp rx=0 tx=0).stop 2024-09-12T17:11:26.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 -- 172.21.15.193:0/945168465 shutdown_connections 2024-09-12T17:11:26.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/945168465 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f62be1b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 -- 172.21.15.193:0/945168465 >> 172.21.15.193:0/945168465 conn(0x5601f62b98f0 msgr2=0x5601f62bbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 -- 172.21.15.193:0/945168465 shutdown_connections 2024-09-12T17:11:26.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.155+0000 7fb8744d69c0 1 -- 172.21.15.193:0/945168465 wait complete. 2024-09-12T17:11:26.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601f61c7680 con 0x5601f62bddd0 2024-09-12T17:11:26.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51124/0 (socket says 172.21.15.193:51124) 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 -- 172.21.15.193:0/1652069195 learned_addr learned my addr 172.21.15.193:0/1652069195 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 -- 172.21.15.193:0/1652069195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f6142da0 con 0x5601f62bddd0 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 --2- 172.21.15.193:0/1652069195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb86c019740 tx=0x7fb86c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df8a57ea6dcc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb75fe07640 1 -- 172.21.15.193:0/1652069195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0b9070 con 0x5601f62bddd0 2024-09-12T17:11:26.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb75fe07640 1 -- 172.21.15.193:0/1652069195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb86c0aaa90 con 0x5601f62bddd0 2024-09-12T17:11:26.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb75fe07640 1 -- 172.21.15.193:0/1652069195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0aad70 con 0x5601f62bddd0 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1652069195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 msgr2=0x5601f63a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1652069195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb86c019740 tx=0x7fb86c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1652069195 shutdown_connections 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1652069195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63a9620 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1652069195 >> 172.21.15.193:0/1652069195 conn(0x5601f62b98f0 msgr2=0x5601f63a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1652069195 shutdown_connections 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1652069195 wait complete. 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb8744d69c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601f6169a50 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51126/0 (socket says 172.21.15.193:51126) 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.171+0000 7fb871fdc640 1 -- 172.21.15.193:0/1761819119 learned_addr learned my addr 172.21.15.193:0/1761819119 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb871fdc640 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f63b1050 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb871fdc640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb86c018cc0 tx=0x7fb86c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 -- 172.21.15.193:0/1761819119 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0b9070 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601f63b12e0 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 -- 172.21.15.193:0/1761819119 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb86c0b5b10 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 -- 172.21.15.193:0/1761819119 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb86c0b5df0 con 0x5601f62bddd0 2024-09-12T17:11:26.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f63b1c90 con 0x5601f62bddd0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 -- 172.21.15.193:0/1761819119 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb86c0b3040 con 0x5601f62bddd0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 0x7fb75803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb75e604640 1 -- 172.21.15.193:0/1761819119 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb86c0c4070 con 0x5601f62bddd0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8717db640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 0x7fb75803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 0x5601f63b7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63b81a0 con 0x5601f62c0fb0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8727dd640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 0x5601f63b7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8717db640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 0x7fb75803bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001e60 tx=0x7fb85c0013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8727dd640 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 0x5601f63b7c60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8727dd640 1 -- 172.21.15.193:0/1761819119 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8640083f0 con 0x5601f62c0fb0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63b2010 con 0x5601f62c0fb0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8727dd640 1 -- 172.21.15.193:0/1761819119 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8640083f0 con 0x5601f62c0fb0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.175+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63b9fa0 con 0x5601f62c0fb0 2024-09-12T17:11:26.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8727dd640 1 -- 172.21.15.193:0/1761819119 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8640083f0 con 0x5601f62c0fb0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63b9200 con 0x5601f62c0fb0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8727dd640 1 -- 172.21.15.193:0/1761819119 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8640083f0 con 0x5601f62c0fb0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63b9650 con 0x5601f62c0fb0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8727dd640 1 -- 172.21.15.193:0/1761819119 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8640083f0 con 0x5601f62c0fb0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601f61d4450 con 0x5601f6233b30 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51134/0 (socket says 172.21.15.193:51134) 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8717db640 1 -- 172.21.15.193:0/3232631551 learned_addr learned my addr 172.21.15.193:0/3232631551 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8717db640 1 -- 172.21.15.193:0/3232631551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f6234050 con 0x5601f6233b30 2024-09-12T17:11:26.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8717db640 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb85c010f90 tx=0x7fb85c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb7577fe640 1 -- 172.21.15.193:0/3232631551 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c00a040 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601f63cc600 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb7577fe640 1 -- 172.21.15.193:0/3232631551 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c017050 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb7577fe640 1 -- 172.21.15.193:0/3232631551 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c00e7e0 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.179+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f63ccb70 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7577fe640 1 -- 172.21.15.193:0/3232631551 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb85c00e9d0 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7577fe640 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 0x7fb74c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7577fe640 1 -- 172.21.15.193:0/3232631551 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb85c052190 con 0x5601f6233b30 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 0x7fb74c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 0x7fb74c03bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb86400e3f0 tx=0x7fb864003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601f63a9d90 con 0x5601f63c7fc0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51140/0 (socket says 172.21.15.193:51140) 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8717db640 1 -- 172.21.15.193:0/3445592351 learned_addr learned my addr 172.21.15.193:0/3445592351 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8717db640 1 -- 172.21.15.193:0/3445592351 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f63c8900 con 0x5601f63c7fc0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8717db640 1 --2- 172.21.15.193:0/3445592351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01ae30 tx=0x7fb85c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7daaae96ae649b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7557fa640 1 -- 172.21.15.193:0/3445592351 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c025ee0 con 0x5601f63c7fc0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7557fa640 1 -- 172.21.15.193:0/3445592351 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c026080 con 0x5601f63c7fc0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb7557fa640 1 -- 172.21.15.193:0/3445592351 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c026360 con 0x5601f63c7fc0 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3445592351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 msgr2=0x5601f63c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3445592351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01ae30 tx=0x7fb85c01aa60 comp rx=0 tx=0).stop 2024-09-12T17:11:26.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3445592351 shutdown_connections 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3445592351 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63c83c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3445592351 >> 172.21.15.193:0/3445592351 conn(0x5601f63d20d0 msgr2=0x5601f63d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3445592351 shutdown_connections 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3445592351 wait complete. 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 Processor -- start 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- start start 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.183+0000 7fb8744d69c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5601f63c8e80 con 0x5601f63c7fc0 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8717db640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51154/0 (socket says 172.21.15.193:51154) 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 learned_addr learned my addr 172.21.15.193:0/3141410286 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f63dfaa0 con 0x5601f63c7fc0 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8717db640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01ae30 tx=0x7fb85c0504b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 -- 172.21.15.193:0/3141410286 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c024360 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601f63dfd30 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 -- 172.21.15.193:0/3141410286 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85c01a310 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f63e06e0 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 -- 172.21.15.193:0/3141410286 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb85c01c410 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 -- 172.21.15.193:0/3141410286 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb85c023760 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb7437fe640 1 -- 172.21.15.193:0/3141410286 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb85c02ebc0 con 0x5601f63c7fc0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f63ea820 0x5601f63ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63ed430 con 0x5601f63ea820 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb871fdc640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f63ea820 0x5601f63ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb86400f010 tx=0x7fb86401c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb871fdc640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f63ea820 0x5601f63ecce0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 20 realm 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.187+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63ed840 con 0x5601f63ea820 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63ee110 con 0x5601f63ea820 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63ee4b0 con 0x5601f63ea820 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63eed00 con 0x5601f63ea820 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 20 searching for the correct realm 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5601f63f0a70 0x5601f63f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8717db640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5601f63f0a70 0x5601f63f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8717db640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5601f63f0a70 0x5601f63f2e60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8717db640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb85c01c030 0x7fb85c040420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb85c01c030 0x7fb85c040420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb85c01c030 0x7fb85c040420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8727dd640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb86401a940 0x7fb864011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb86401a940 0x7fb864011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.191+0000 7fb871fdc640 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb86401a940 0x7fb864011430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.195+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.199+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63f0a70 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb86401a940 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x5601f63ea820 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f33a0 con 0x7fb85c01c030 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63ef610 con 0x5601f63ea820 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63efeb0 con 0x5601f63ea820 2024-09-12T17:11:26.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63efeb0 con 0x5601f63ea820 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 zone default found 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 4 Realm: () 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 zonegroup default 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.203+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f37d0 con 0x7fb86401a940 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f52c0 con 0x5601f63f0a70 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f5760 con 0x5601f63f0a70 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63efac0 con 0x7fb85c01c030 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94566426298128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f5bc0 con 0x7fb85c01c030 2024-09-12T17:11:26.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f6640 con 0x5601f63ea820 2024-09-12T17:11:26.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.207+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94566426298128] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94566426304816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f6a60 con 0x5601f63ea820 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f7420 con 0x5601f63f0a70 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94566426304816] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94566426308464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f7810 con 0x5601f63f0a70 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.211+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f81d0 con 0x7fb85c01c030 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94566426312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f8920 con 0x7fb85c01c030 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f9440 con 0x5601f63ea820 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94566426312240] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94566426308464] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94566426299280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f9400 con 0x5601f63ea820 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f9ce0 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.215+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94566426299280] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94566426316560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f98b0 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63fa180 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94566426316560] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94566426319024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63fa830 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.219+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f9420 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94566426322992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63fb100 con 0x7fb86401a940 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=0 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=1 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=2 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=3 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=4 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=5 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94566426319024] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.223+0000 7fb8744d69c0 20 add_watcher() i=6 2024-09-12T17:11:26.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94566426322992] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 add_watcher() i=7 2024-09-12T17:11:26.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f63fe130 con 0x5601f63ea820 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94566426324048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63fb520 con 0x5601f63ea820 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94566426324048] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb7237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 5 note: GC not initialized 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb7227fc640 20 reqs_thread_entry: start 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 Filter name: none 2024-09-12T17:11:26.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb693fff640 20 reqs_thread_entry: start 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f6421220 con 0x5601f63ea820 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f64278d0 con 0x5601f63ea820 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.227+0000 7fb8744d69c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94566426506112 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5601f6423040 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94566426299280 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fb86c0e3040 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb7557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94566426299280 notifier 4370 bl.length()=732 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb7557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb7557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94566426506112 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb7557fa640 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb734003eb0 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94566426506112 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb86c0d7040 con 0x5601f63ea820 2024-09-12T17:11:26.237 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb7237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94566426324048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f6422b90 con 0x5601f63ea820 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94566426324048] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94566426298128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f6423040 con 0x7fb85c01c030 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94566426298128] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 20 remove_watcher() i=0 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.231+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94566426304816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f6423040 con 0x5601f63ea820 2024-09-12T17:11:26.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94566426304816] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb8744d69c0 20 remove_watcher() i=1 2024-09-12T17:11:26.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94566426308464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f6423040 con 0x5601f63f0a70 2024-09-12T17:11:26.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb8717db640 1 -- 172.21.15.193:0/3141410286 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94566426308464] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb85c036020 con 0x5601f63f0a70 2024-09-12T17:11:26.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb8744d69c0 20 remove_watcher() i=2 2024-09-12T17:11:26.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.235+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94566426312240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f4710 con 0x7fb85c01c030 2024-09-12T17:11:26.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb8727dd640 1 -- 172.21.15.193:0/3141410286 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94566426312240] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb864030040 con 0x7fb85c01c030 2024-09-12T17:11:26.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb8744d69c0 20 remove_watcher() i=3 2024-09-12T17:11:26.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94566426299280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f6130 con 0x5601f63ea820 2024-09-12T17:11:26.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94566426299280] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x5601f63ea820 2024-09-12T17:11:26.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb8744d69c0 20 remove_watcher() i=4 2024-09-12T17:11:26.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.239+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94566426316560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f7e30 con 0x7fb86401a940 2024-09-12T17:11:26.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94566426316560] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb8744d69c0 20 remove_watcher() i=5 2024-09-12T17:11:26.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94566426319024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f4710 con 0x7fb86401a940 2024-09-12T17:11:26.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94566426319024] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb8744d69c0 20 remove_watcher() i=6 2024-09-12T17:11:26.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.243+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94566426322992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5601f63f6130 con 0x7fb86401a940 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94566426322992] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb86c0c6d80 con 0x7fb86401a940 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 20 remove_watcher() i=7 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb86401a940 msgr2=0x7fb864011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb86401a940 0x7fb864011430 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f63ea820 msgr2=0x5601f63ecce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f63ea820 0x5601f63ecce0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb85c01c030 msgr2=0x7fb85c040420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb85c01c030 0x7fb85c040420 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5601f63f0a70 msgr2=0x5601f63f2e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5601f63f0a70 0x5601f63f2e60 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 msgr2=0x7fb73c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb86400f010 tx=0x7fb86401c070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 msgr2=0x5601f63df540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb871fdc640 1 -- 172.21.15.193:0/3141410286 reap_dead start 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb85c01ae30 tx=0x7fb85c0504b0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 shutdown_connections 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3141410286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f63c7fc0 0x5601f63df540 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 >> 172.21.15.193:0/3141410286 conn(0x5601f63d20d0 msgr2=0x5601f63d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 shutdown_connections 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3141410286 wait complete. 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 msgr2=0x7fb74c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 0x7fb74c03bf30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb86400e3f0 tx=0x7fb864003070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 msgr2=0x5601f63cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb85c010f90 tx=0x7fb85c00f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 shutdown_connections 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb74c039a70 0x7fb74c03bf30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/3232631551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f6233b30 0x5601f63cc000 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 >> 172.21.15.193:0/3232631551 conn(0x5601f63bdc10 msgr2=0x5601f63bdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 shutdown_connections 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/3232631551 wait complete. 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 msgr2=0x5601f63b7c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 0x5601f63b7c60 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 msgr2=0x7fb75803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 0x7fb75803bf30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001e60 tx=0x7fb85c0013e0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 msgr2=0x5601f63b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb86c018cc0 tx=0x7fb86c017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 shutdown_connections 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5601f62c0fb0 0x5601f63b7c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb758039a70 0x7fb75803bf30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 --2- 172.21.15.193:0/1761819119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5601f62bddd0 0x5601f63b0af0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 >> 172.21.15.193:0/1761819119 conn(0x5601f62b98f0 msgr2=0x5601f63a3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 shutdown_connections 2024-09-12T17:11:26.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.247+0000 7fb8744d69c0 1 -- 172.21.15.193:0/1761819119 wait complete. 2024-09-12T17:11:26.261 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.261 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:26.329 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:26.329 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:26.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10ac179c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627b4ed6fb0 0x5627b4ed7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10ac179c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627b4d8b9c0 con 0x5627b4eda140 2024-09-12T17:11:26.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10ac179c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5627b4ddb6d0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627b4ed6fb0 0x5627b4ed7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627b4ed6fb0 0x5627b4ed7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51162/0 (socket says 172.21.15.193:51162) 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 -- 172.21.15.193:0/1016262012 learned_addr learned my addr 172.21.15.193:0/1016262012 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe0fffff640 1 --1- 172.21.15.193:0/1016262012 >> v1:172.21.15.62:6789/0 conn(0x5627b4eda140 0x5627b4edc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36094/0 (socket says 172.21.15.193:36094) 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 -- 172.21.15.193:0/1016262012 >> v1:172.21.15.62:6789/0 conn(0x5627b4eda140 legacy=0x5627b4edc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 -- 172.21.15.193:0/1016262012 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4d7fca0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe10871d640 1 --2- 172.21.15.193:0/1016262012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4ed7390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a5c0 tx=0x7fe0f801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc42d53d3e7c780 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe107f1c640 1 -- 172.21.15.193:0/1016262012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80a6070 con 0x5627b4ed6fb0 2024-09-12T17:11:26.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe107f1c640 1 -- 172.21.15.193:0/1016262012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80af070 con 0x5627b4ed6fb0 2024-09-12T17:11:26.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.327+0000 7fe107f1c640 1 -- 172.21.15.193:0/1016262012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80aa5c0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1016262012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 msgr2=0x5627b4ed7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1016262012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4ed7390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe0f800a5c0 tx=0x7fe0f801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1016262012 shutdown_connections 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1016262012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4ed7390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1016262012 >> 172.21.15.193:0/1016262012 conn(0x5627b4ed2ad0 msgr2=0x5627b4ed4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1016262012 shutdown_connections 2024-09-12T17:11:26.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.331+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1016262012 wait complete. 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627b4ddf680 con 0x5627b4ed6fb0 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10871d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10871d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51178/0 (socket says 172.21.15.193:51178) 2024-09-12T17:11:26.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10871d640 1 -- 172.21.15.193:0/3651096255 learned_addr learned my addr 172.21.15.193:0/3651096255 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10871d640 1 -- 172.21.15.193:0/3651096255 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4d5ada0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10871d640 1 --2- 172.21.15.193:0/3651096255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ac040 tx=0x7fe0f8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da91c05bc3aa2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fdff660c640 1 -- 172.21.15.193:0/3651096255 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80aa970 con 0x5627b4ed6fb0 2024-09-12T17:11:26.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fdff660c640 1 -- 172.21.15.193:0/3651096255 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80aab10 con 0x5627b4ed6fb0 2024-09-12T17:11:26.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fdff660c640 1 -- 172.21.15.193:0/3651096255 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80aae30 con 0x5627b4ed6fb0 2024-09-12T17:11:26.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3651096255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 msgr2=0x5627b4fc2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/3651096255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80ac040 tx=0x7fe0f8003030 comp rx=0 tx=0).stop 2024-09-12T17:11:26.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3651096255 shutdown_connections 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/3651096255 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc2690 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3651096255 >> 172.21.15.193:0/3651096255 conn(0x5627b4ed2ad0 msgr2=0x5627b4fbe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3651096255 shutdown_connections 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3651096255 wait complete. 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.343+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627b4d81a50 con 0x5627b4ed6fb0 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10871d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10871d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51190/0 (socket says 172.21.15.193:51190) 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10871d640 1 -- 172.21.15.193:0/1793399983 learned_addr learned my addr 172.21.15.193:0/1793399983 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10871d640 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4fca110 con 0x5627b4ed6fb0 2024-09-12T17:11:26.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10871d640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe0f801b170 tx=0x7fe0f80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 -- 172.21.15.193:0/1793399983 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80cb020 con 0x5627b4ed6fb0 2024-09-12T17:11:26.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b4fca3a0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 -- 172.21.15.193:0/1793399983 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f80c6650 con 0x5627b4ed6fb0 2024-09-12T17:11:26.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 -- 172.21.15.193:0/1793399983 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f80c6930 con 0x5627b4ed6fb0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b4fcad50 con 0x5627b4ed6fb0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 -- 172.21.15.193:0/1793399983 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe0f80ce020 con 0x5627b4ed6fb0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 0x7fdff003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fdff4e09640 1 -- 172.21.15.193:0/1793399983 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe0f80ebbf0 con 0x5627b4ed6fb0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe0fffff640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 0x7fdff003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 0x5627b4fd0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b4fd1260 con 0x5627b4eda140 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe108f1e640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 0x5627b4fd0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe0fffff640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 0x7fdff003bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0001e40 tx=0x7fe0f00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.347+0000 7fe108f1e640 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 0x5627b4fd0d20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe108f1e640 1 -- 172.21.15.193:0/1793399983 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe10000a4d0 con 0x5627b4eda140 2024-09-12T17:11:26.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b4fcb0e0 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe108f1e640 1 -- 172.21.15.193:0/1793399983 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe10000a4d0 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b4fd3060 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe108f1e640 1 -- 172.21.15.193:0/1793399983 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe10000a4d0 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b4fd2290 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe108f1e640 1 -- 172.21.15.193:0/1793399983 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe10000a4d0 con 0x5627b4eda140 2024-09-12T17:11:26.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b4fd26b0 con 0x5627b4eda140 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe108f1e640 1 -- 172.21.15.193:0/1793399983 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe10000a4d0 con 0x5627b4eda140 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627b4dec450 con 0x5627b4fe13c0 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51202/0 (socket says 172.21.15.193:51202) 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe0fffff640 1 -- 172.21.15.193:0/1433710705 learned_addr learned my addr 172.21.15.193:0/1433710705 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe0fffff640 1 -- 172.21.15.193:0/1433710705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4fe1e20 con 0x5627b4fe13c0 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe0fffff640 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e670 tx=0x7fe0f000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fdfedffb640 1 -- 172.21.15.193:0/1433710705 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0022070 con 0x5627b4fe13c0 2024-09-12T17:11:26.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fdfedffb640 1 -- 172.21.15.193:0/1433710705 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f000d660 con 0x5627b4fe13c0 2024-09-12T17:11:26.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fdfedffb640 1 -- 172.21.15.193:0/1433710705 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0006070 con 0x5627b4fe13c0 2024-09-12T17:11:26.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b4fe2680 con 0x5627b4fe13c0 2024-09-12T17:11:26.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.351+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b4fe2bf0 con 0x5627b4fe13c0 2024-09-12T17:11:26.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfedffb640 1 -- 172.21.15.193:0/1433710705 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe0f0025070 con 0x5627b4fe13c0 2024-09-12T17:11:26.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfedffb640 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 0x7fdfe003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfedffb640 1 -- 172.21.15.193:0/1433710705 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe0f00519c0 con 0x5627b4fe13c0 2024-09-12T17:11:26.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe108f1e640 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 0x7fdfe003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe108f1e640 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 0x7fdfe003bf70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5627b4fd2630 tx=0x7fe100005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627b4fc2e00 con 0x5627b4fedce0 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51210/0 (socket says 172.21.15.193:51210) 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe0fffff640 1 -- 172.21.15.193:0/3500269536 learned_addr learned my addr 172.21.15.193:0/3500269536 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe0fffff640 1 -- 172.21.15.193:0/3500269536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4fee690 con 0x5627b4fedce0 2024-09-12T17:11:26.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe0fffff640 1 --2- 172.21.15.193:0/3500269536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000ef50 tx=0x7fe0f0024bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1d09205c12a029 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfdf7fe640 1 -- 172.21.15.193:0/3500269536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0026530 con 0x5627b4fedce0 2024-09-12T17:11:26.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfdf7fe640 1 -- 172.21.15.193:0/3500269536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f000dc70 con 0x5627b4fedce0 2024-09-12T17:11:26.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fdfdf7fe640 1 -- 172.21.15.193:0/3500269536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0025c80 con 0x5627b4fedce0 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3500269536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 msgr2=0x5627b4fee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/3500269536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000ef50 tx=0x7fe0f0024bf0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3500269536 shutdown_connections 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/3500269536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4fee0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3500269536 >> 172.21.15.193:0/3500269536 conn(0x5627b4fea110 msgr2=0x5627b4fe8350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3500269536 shutdown_connections 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.355+0000 7fe10ac179c0 1 -- 172.21.15.193:0/3500269536 wait complete. 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 Processor -- start 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- start start 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4ff5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627b4feecf0 con 0x5627b4fedce0 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4ff5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe0fffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4ff5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51226/0 (socket says 172.21.15.193:51226) 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 learned_addr learned my addr 172.21.15.193:0/444702877 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b4ff5790 con 0x5627b4fedce0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe0fffff640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4ff5230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0024d20 tx=0x7fe0f004fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 -- 172.21.15.193:0/444702877 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f00242c0 con 0x5627b4fedce0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 -- 172.21.15.193:0/444702877 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f004d070 con 0x5627b4fedce0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b4ff5a20 con 0x5627b4fedce0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 -- 172.21.15.193:0/444702877 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0f0024590 con 0x5627b4fedce0 2024-09-12T17:11:26.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b4ff5a20 con 0x5627b4fedce0 2024-09-12T17:11:26.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 -- 172.21.15.193:0/444702877 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe0f001a320 con 0x5627b4fedce0 2024-09-12T17:11:26.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd0039a20 0x7fdfd003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fdfddffb640 1 -- 172.21.15.193:0/444702877 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe0f0036c70 con 0x5627b4fedce0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe108f1e640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd0039a20 0x7fdfd003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b50002e0 0x5627b5002770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5002ec0 con 0x5627b50002e0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10871d640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b50002e0 0x5627b5002770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe108f1e640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd0039a20 0x7fdfd003bee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5627b4fd1db0 tx=0x7fe10001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10871d640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b50002e0 0x5627b5002770 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 20 realm 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.359+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5003320 con 0x5627b50002e0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5003bf0 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5003f90 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5004430 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 20 searching for the correct realm 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627b50063a0 0x5627b5008790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe0fffff640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627b50063a0 0x5627b5008790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe0fffff640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627b50063a0 0x5627b5008790 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f003c070 con 0x5627b50063a0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe0fffff640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f0027060 0x7fe0f003d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe108f1e640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f0027060 0x7fe0f003d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe108f1e640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f0027060 0x7fe0f003d980 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe108f1e640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe100031040 0x7fe100032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe100031040 0x7fe100032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe100031040 0x7fe100032430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.363+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f003c070 con 0x5627b50063a0 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.367+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.371+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50063a0 2024-09-12T17:11:26.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe100031040 2024-09-12T17:11:26.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x5627b50002e0 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627b5008da0 con 0x7fe0f0027060 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe10001f070 con 0x7fe0f0027060 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5004e40 con 0x5627b50002e0 2024-09-12T17:11:26.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b50056e0 con 0x5627b50002e0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5004a80 con 0x5627b50002e0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 zone default found 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 4 Realm: () 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 zonegroup default 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5009220 con 0x7fe100031040 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b500b0c0 con 0x5627b50063a0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b500b460 con 0x5627b50063a0 2024-09-12T17:11:26.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.375+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500a500 con 0x7fe0f0027060 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728540432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500ad10 con 0x7fe0f0027060 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500c1e0 con 0x5627b50002e0 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728540432624] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728540436480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500c5d0 con 0x5627b50002e0 2024-09-12T17:11:26.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.379+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500cf90 con 0x5627b50063a0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728540441312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500d830 con 0x5627b50063a0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728540436480] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500bc20 con 0x7fe0f0027060 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728540446016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500e610 con 0x7fe0f0027060 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.383+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500efd0 con 0x5627b50002e0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728540446016] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728540441312] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728540447072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500e580 con 0x5627b50002e0 2024-09-12T17:11:26.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500f480 con 0x7fe100031040 2024-09-12T17:11:26.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728540447072] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728540449568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500f3f0 con 0x7fe100031040 2024-09-12T17:11:26.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.387+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500fc40 con 0x7fe100031040 2024-09-12T17:11:26.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.391+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728540449568] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.391+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.391+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728540451104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500faf0 con 0x7fe100031040 2024-09-12T17:11:26.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.391+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b5010610 con 0x7fe100031040 2024-09-12T17:11:26.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.395+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728540451104] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728540455136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b50105d0 con 0x7fe100031040 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=0 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=1 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=2 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=3 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=4 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=5 2024-09-12T17:11:26.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=6 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728540455136] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 add_watcher() i=7 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b5013a90 con 0x5627b50002e0 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728540452160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b5010f50 con 0x5627b50002e0 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728540452160] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fdfbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.399+0000 7fe10ac179c0 5 note: GC not initialized 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fdfbd7e2640 20 reqs_thread_entry: start 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 20 Filter name: none 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fdf2effd640 20 reqs_thread_entry: start 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627b50367d0 con 0x5627b50002e0 2024-09-12T17:11:26.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:11:26.407 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fdfbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728540452160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b50352a0 con 0x5627b50002e0 2024-09-12T17:11:26.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94728540452160] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728540432624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500f540 con 0x7fe0f0027060 2024-09-12T17:11:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94728540432624] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 20 remove_watcher() i=0 2024-09-12T17:11:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.403+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728540436480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500a8f0 con 0x5627b50002e0 2024-09-12T17:11:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94728540436480] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe10ac179c0 20 remove_watcher() i=1 2024-09-12T17:11:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728540441312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500a8f0 con 0x5627b50063a0 2024-09-12T17:11:26.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe0fffff640 1 -- 172.21.15.193:0/444702877 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94728540441312] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f005c040 con 0x5627b50063a0 2024-09-12T17:11:26.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe10ac179c0 20 remove_watcher() i=2 2024-09-12T17:11:26.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.407+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728540446016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500cae0 con 0x7fe0f0027060 2024-09-12T17:11:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe108f1e640 1 -- 172.21.15.193:0/444702877 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94728540446016] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe100040040 con 0x7fe0f0027060 2024-09-12T17:11:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe10ac179c0 20 remove_watcher() i=3 2024-09-12T17:11:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728540447072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500dd40 con 0x5627b50002e0 2024-09-12T17:11:26.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94728540447072] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x5627b50002e0 2024-09-12T17:11:26.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe10ac179c0 20 remove_watcher() i=4 2024-09-12T17:11:26.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.411+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728540449568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500cae0 con 0x7fe100031040 2024-09-12T17:11:26.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.415+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94728540449568] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.415+0000 7fe10ac179c0 20 remove_watcher() i=5 2024-09-12T17:11:26.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.415+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728540451104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500eb20 con 0x7fe100031040 2024-09-12T17:11:26.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94728540451104] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 20 remove_watcher() i=6 2024-09-12T17:11:26.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728540455136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627b500cae0 con 0x7fe100031040 2024-09-12T17:11:26.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94728540455136] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0f80bd910 con 0x7fe100031040 2024-09-12T17:11:26.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 20 remove_watcher() i=7 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe100031040 msgr2=0x7fe100032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe100031040 0x7fe100032430 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b50002e0 msgr2=0x5627b5002770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b50002e0 0x5627b5002770 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f0027060 msgr2=0x7fe0f003d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe0f0027060 0x7fe0f003d980 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627b50063a0 msgr2=0x5627b5008790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627b50063a0 0x5627b5008790 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd0039a20 msgr2=0x7fdfd003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfd0039a20 0x7fdfd003bee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5627b4fd1db0 tx=0x7fe10001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 msgr2=0x5627b4ff5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/444702877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fedce0 0x5627b4ff5230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0024d20 tx=0x7fe0f004fd60 comp rx=0 tx=0).stop 2024-09-12T17:11:26.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10871d640 1 -- 172.21.15.193:0/444702877 reap_dead start 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 shutdown_connections 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 >> 172.21.15.193:0/444702877 conn(0x5627b4fea110 msgr2=0x5627b4fe8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 shutdown_connections 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/444702877 wait complete. 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 msgr2=0x7fdfe003bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 0x7fdfe003bf70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x5627b4fd2630 tx=0x7fe100005850 comp rx=0 tx=0).stop 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 msgr2=0x5627b4fe17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e670 tx=0x7fe0f000ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 shutdown_connections 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdfe0039ab0 0x7fdfe003bf70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1433710705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4fe13c0 0x5627b4fe17e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 >> 172.21.15.193:0/1433710705 conn(0x5627b4fd6d70 msgr2=0x5627b4fd7150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 shutdown_connections 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.419+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1433710705 wait complete. 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 msgr2=0x5627b4fd0d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 0x5627b4fd0d20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 msgr2=0x7fdff003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 0x7fdff003bf30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0001e40 tx=0x7fe0f00013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 msgr2=0x5627b4fc9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe0f801b170 tx=0x7fe0f80180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 shutdown_connections 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627b4eda140 0x5627b4fd0d20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdff0039a70 0x7fdff003bf30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 --2- 172.21.15.193:0/1793399983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627b4ed6fb0 0x5627b4fc9bb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 >> 172.21.15.193:0/1793399983 conn(0x5627b4ed2ad0 msgr2=0x5627b4fbcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 shutdown_connections 2024-09-12T17:11:26.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.423+0000 7fe10ac179c0 1 -- 172.21.15.193:0/1793399983 wait complete. 2024-09-12T17:11:26.434 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.435 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.435 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40c02a9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fcd94177b0 0x55fcd9416380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40c02a9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fcd93559c0 con 0x55fcd9417280 2024-09-12T17:11:26.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40c02a9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55fcd93a56d0 con 0x55fcd94177b0 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40932f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fcd94177b0 0x55fcd9416380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40932f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fcd94177b0 0x55fcd9416380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51234/0 (socket says 172.21.15.193:51234) 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40932f640 1 -- 172.21.15.193:0/1181730156 learned_addr learned my addr 172.21.15.193:0/1181730156 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd409b30640 1 --1- 172.21.15.193:0/1181730156 >> v1:172.21.15.62:6789/0 conn(0x55fcd9417280 0x55fcd9415c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36104/0 (socket says 172.21.15.193:36104) 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40932f640 1 -- 172.21.15.193:0/1181730156 >> v1:172.21.15.62:6789/0 conn(0x55fcd9417280 legacy=0x55fcd9415c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.503+0000 7fd40932f640 1 -- 172.21.15.193:0/1181730156 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd9349ca0 con 0x55fcd94177b0 2024-09-12T17:11:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40932f640 1 --2- 172.21.15.193:0/1181730156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd94177b0 0x55fcd9416380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd40000a5c0 tx=0x7fd40001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604f1a745169719 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd408b2e640 1 -- 172.21.15.193:0/1181730156 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b0070 con 0x55fcd94177b0 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd408b2e640 1 -- 172.21.15.193:0/1181730156 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000ab540 con 0x55fcd94177b0 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd408b2e640 1 -- 172.21.15.193:0/1181730156 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000ab840 con 0x55fcd94177b0 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1181730156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd94177b0 msgr2=0x55fcd9416380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1181730156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd94177b0 0x55fcd9416380 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd40000a5c0 tx=0x7fd40001b280 comp rx=0 tx=0).stop 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1181730156 shutdown_connections 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1181730156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd94177b0 0x55fcd9416380 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1181730156 >> 172.21.15.193:0/1181730156 conn(0x55fcd949caa0 msgr2=0x55fcd949eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1181730156 shutdown_connections 2024-09-12T17:11:26.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.507+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1181730156 wait complete. 2024-09-12T17:11:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd40c02a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd40c02a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fcd93a9680 con 0x55fcd9417280 2024-09-12T17:11:26.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd409b30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd409b30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51244/0 (socket says 172.21.15.193:51244) 2024-09-12T17:11:26.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd409b30640 1 -- 172.21.15.193:0/2110395801 learned_addr learned my addr 172.21.15.193:0/2110395801 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd409b30640 1 -- 172.21.15.193:0/2110395801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd9324da0 con 0x55fcd9417280 2024-09-12T17:11:26.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.519+0000 7fd409b30640 1 --2- 172.21.15.193:0/2110395801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd404001680 tx=0x7fd404001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a283df50758a114 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f7e07640 1 -- 172.21.15.193:0/2110395801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd404013420 con 0x55fcd9417280 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f7e07640 1 -- 172.21.15.193:0/2110395801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4040135c0 con 0x55fcd9417280 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f7e07640 1 -- 172.21.15.193:0/2110395801 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4040138e0 con 0x55fcd9417280 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/2110395801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 msgr2=0x55fcd9593370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/2110395801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd404001680 tx=0x7fd404001b40 comp rx=0 tx=0).stop 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/2110395801 shutdown_connections 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/2110395801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd9593370 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/2110395801 >> 172.21.15.193:0/2110395801 conn(0x55fcd949caa0 msgr2=0x55fcd958efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/2110395801 shutdown_connections 2024-09-12T17:11:26.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/2110395801 wait complete. 2024-09-12T17:11:26.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fcd934ba50 con 0x55fcd9417280 2024-09-12T17:11:26.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd409b30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd409b30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51250/0 (socket says 172.21.15.193:51250) 2024-09-12T17:11:26.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd409b30640 1 -- 172.21.15.193:0/1899262398 learned_addr learned my addr 172.21.15.193:0/1899262398 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd409b30640 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd959afc0 con 0x55fcd9417280 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd409b30640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd404001b80 tx=0x7fd404000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f6604640 1 -- 172.21.15.193:0/1899262398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd404013630 con 0x55fcd9417280 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcd959b250 con 0x55fcd9417280 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f6604640 1 -- 172.21.15.193:0/1899262398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd404023070 con 0x55fcd9417280 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd2f6604640 1 -- 172.21.15.193:0/1899262398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd404013920 con 0x55fcd9417280 2024-09-12T17:11:26.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.523+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd959bc00 con 0x55fcd9417280 2024-09-12T17:11:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd2f6604640 1 -- 172.21.15.193:0/1899262398 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd404010070 con 0x55fcd9417280 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd2f6604640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 0x7fd2f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd2f6604640 1 -- 172.21.15.193:0/1899262398 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4040500d0 con 0x55fcd9417280 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40932f640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 0x7fd2f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 0x55fcd95a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95a2110 con 0x55fcd94177b0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 0x55fcd95a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40932f640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 0x7fd2f003bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4000ad000 tx=0x7fd4000a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 0x55fcd95a1bd0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 -- 172.21.15.193:0/1899262398 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3fc0083f0 con 0x55fcd94177b0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95a2510 con 0x55fcd94177b0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 -- 172.21.15.193:0/1899262398 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3fc0083f0 con 0x55fcd94177b0 2024-09-12T17:11:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95a3e10 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 -- 172.21.15.193:0/1899262398 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3fc0083f0 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95a3040 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 -- 172.21.15.193:0/1899262398 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3fc0083f0 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95a3460 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40a331640 1 -- 172.21.15.193:0/1899262398 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3fc0083f0 con 0x55fcd94177b0 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40c02a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fcd93b6450 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51260/0 (socket says 172.21.15.193:51260) 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.527+0000 7fd40932f640 1 -- 172.21.15.193:0/1899372367 learned_addr learned my addr 172.21.15.193:0/1899372367 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40932f640 1 -- 172.21.15.193:0/1899372367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd95b2bd0 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40932f640 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd400018eb0 tx=0x7fd400018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 -- 172.21.15.193:0/1899372367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b0040 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcd95b3430 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 -- 172.21.15.193:0/1899372367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000c6070 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 -- 172.21.15.193:0/1899372367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b6470 con 0x55fcd95b2170 2024-09-12T17:11:26.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd95b3940 con 0x55fcd95b2170 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 -- 172.21.15.193:0/1899372367 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4000b66e0 con 0x55fcd95b2170 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 0x7fd2e403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd2ef7fe640 1 -- 172.21.15.193:0/1899372367 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4000a8070 con 0x55fcd95b2170 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40a331640 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 0x7fd2e403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40a331640 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 0x7fd2e403bf20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55fcd95a33e0 tx=0x7fd3fc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40c02a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fcd9593bc0 con 0x55fcd95bfa20 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51268/0 (socket says 172.21.15.193:51268) 2024-09-12T17:11:26.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.531+0000 7fd40932f640 1 -- 172.21.15.193:0/3772921300 learned_addr learned my addr 172.21.15.193:0/3772921300 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 -- 172.21.15.193:0/3772921300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd95c0410 con 0x55fcd95bfa20 2024-09-12T17:11:26.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 --2- 172.21.15.193:0/3772921300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd4000eb7e0 tx=0x7fd4000b5500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66be414b8e6a33f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2ed7fa640 1 -- 172.21.15.193:0/3772921300 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000cbd10 con 0x55fcd95bfa20 2024-09-12T17:11:26.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2ed7fa640 1 -- 172.21.15.193:0/3772921300 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000cb980 con 0x55fcd95bfa20 2024-09-12T17:11:26.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2ed7fa640 1 -- 172.21.15.193:0/3772921300 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b4370 con 0x55fcd95bfa20 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/3772921300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 msgr2=0x55fcd95bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/3772921300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd4000eb7e0 tx=0x7fd4000b5500 comp rx=0 tx=0).stop 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/3772921300 shutdown_connections 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/3772921300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95bfe20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/3772921300 >> 172.21.15.193:0/3772921300 conn(0x55fcd95bae40 msgr2=0x55fcd95b9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/3772921300 shutdown_connections 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/3772921300 wait complete. 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 Processor -- start 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- start start 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fcd95be970 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51276/0 (socket says 172.21.15.193:51276) 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 learned_addr learned my addr 172.21.15.193:0/1389116463 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd95c64b0 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40932f640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd4000b5540 tx=0x7fd4000eb770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2db7fe640 1 -- 172.21.15.193:0/1389116463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b5800 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fcd95c6740 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2db7fe640 1 -- 172.21.15.193:0/1389116463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4000e4070 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd2db7fe640 1 -- 172.21.15.193:0/1389116463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4000b5b10 con 0x55fcd95bfa20 2024-09-12T17:11:26.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.535+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd95c70f0 con 0x55fcd95bfa20 2024-09-12T17:11:26.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd2db7fe640 1 -- 172.21.15.193:0/1389116463 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd4000cbd10 con 0x55fcd95bfa20 2024-09-12T17:11:26.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd2db7fe640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2d4039a70 0x7fd2d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd2db7fe640 1 -- 172.21.15.193:0/1389116463 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd4000da070 con 0x55fcd95bfa20 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2d4039a70 0x7fd2d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd95d1240 0x55fcd95d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d3e20 con 0x55fcd95d1240 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd95d1240 0x55fcd95d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd95d1240 0x55fcd95d36d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2d4039a70 0x7fd2d403bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00f010 tx=0x7fd3fc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 realm 2024-09-12T17:11:26.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d4230 con 0x55fcd95d1240 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d4b00 con 0x55fcd95d1240 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d4ea0 con 0x55fcd95d1240 2024-09-12T17:11:26.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d5340 con 0x55fcd95d1240 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 20 searching for the correct realm 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fcd95d72b0 0x55fcd95d96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40932f640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fcd95d72b0 0x55fcd95d96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40932f640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fcd95d72b0 0x55fcd95d96a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40932f640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd4000ed050 0x7fd4000f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd4000ed050 0x7fd4000f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd4000ed050 0x7fd4000f63f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd3fc019040 0x7fd3fc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.539+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd3fc019040 0x7fd3fc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd3fc019040 0x7fd3fc019930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.543+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.547+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d72b0 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x55fcd95d1240 2024-09-12T17:11:26.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d9d20 con 0x7fd4000ed050 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.551+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d5d50 con 0x55fcd95d1240 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d65f0 con 0x55fcd95d1240 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d5990 con 0x55fcd95d1240 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 zone default found 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 4 Realm: () 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 zonegroup default 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95d65f0 con 0x7fd3fc019040 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dbb70 con 0x55fcd95d72b0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dbf10 con 0x55fcd95d72b0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95db010 con 0x7fd4000ed050 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94544466916400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dc760 con 0x7fd4000ed050 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.555+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dcfb0 con 0x55fcd95d1240 2024-09-12T17:11:26.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.559+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94544466916400] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.559+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.559+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94544466920112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dcbc0 con 0x55fcd95d1240 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.559+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dd6c0 con 0x55fcd95d72b0 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.559+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94544466920112] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94544466923952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95ddab0 con 0x55fcd95d72b0 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95de470 con 0x7fd4000ed050 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94544466927824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95deb40 con 0x7fd4000ed050 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95df640 con 0x55fcd95d1240 2024-09-12T17:11:26.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94544466923952] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94544466932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95df600 con 0x55fcd95d1240 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.563+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0080 con 0x7fd3fc019040 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.567+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94544466927824] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.567+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94544466932016] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.567+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.567+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94544466921168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dfbd0 con 0x7fd3fc019040 2024-09-12T17:11:26.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.567+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0420 con 0x7fd3fc019040 2024-09-12T17:11:26.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94544466921168] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94544466934816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e04f0 con 0x7fd3fc019040 2024-09-12T17:11:26.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0eb0 con 0x7fd3fc019040 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94544466934816] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94544466936144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0eb0 con 0x7fd3fc019040 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=0 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=1 2024-09-12T17:11:26.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=2 2024-09-12T17:11:26.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=3 2024-09-12T17:11:26.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=4 2024-09-12T17:11:26.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=5 2024-09-12T17:11:26.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.571+0000 7fd40c02a9c0 20 add_watcher() i=6 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94544466936144] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 add_watcher() i=7 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e4190 con 0x55fcd95d1240 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94544466938736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e1440 con 0x55fcd95d1240 2024-09-12T17:11:26.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94544466938736] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd2bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 5 note: GC not initialized 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd2ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 Filter name: none 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd22bfff640 20 reqs_thread_entry: start 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fcd9606fd0 con 0x55fcd95d1240 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.575+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:11:26.582 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd2bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94544466938736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd9605a80 con 0x55fcd95d1240 2024-09-12T17:11:26.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94544466938736] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94544466916400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x7fd4000ed050 2024-09-12T17:11:26.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94544466916400] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 20 remove_watcher() i=0 2024-09-12T17:11:26.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.579+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94544466920112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x55fcd95d1240 2024-09-12T17:11:26.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94544466920112] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd40c02a9c0 20 remove_watcher() i=1 2024-09-12T17:11:26.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94544466923952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dc2b0 con 0x55fcd95d72b0 2024-09-12T17:11:26.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd40932f640 1 -- 172.21.15.193:0/1389116463 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94544466923952] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd4000b3040 con 0x55fcd95d72b0 2024-09-12T17:11:26.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd40c02a9c0 20 remove_watcher() i=2 2024-09-12T17:11:26.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.583+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94544466927824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x7fd4000ed050 2024-09-12T17:11:26.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd40a331640 1 -- 172.21.15.193:0/1389116463 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94544466927824] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3fc02f040 con 0x7fd4000ed050 2024-09-12T17:11:26.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd40c02a9c0 20 remove_watcher() i=3 2024-09-12T17:11:26.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94544466932016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x55fcd95d1240 2024-09-12T17:11:26.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94544466932016] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x55fcd95d1240 2024-09-12T17:11:26.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd40c02a9c0 20 remove_watcher() i=4 2024-09-12T17:11:26.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.587+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94544466921168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x7fd3fc019040 2024-09-12T17:11:26.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.591+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94544466921168] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.591+0000 7fd40c02a9c0 20 remove_watcher() i=5 2024-09-12T17:11:26.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.591+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94544466934816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95e0b70 con 0x7fd3fc019040 2024-09-12T17:11:26.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94544466934816] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 20 remove_watcher() i=6 2024-09-12T17:11:26.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94544466936144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fcd95dfc20 con 0x7fd3fc019040 2024-09-12T17:11:26.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94544466936144] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd40400f030 con 0x7fd3fc019040 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 20 remove_watcher() i=7 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd3fc019040 msgr2=0x7fd3fc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd3fc019040 0x7fd3fc019930 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd95d1240 msgr2=0x55fcd95d36d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd95d1240 0x55fcd95d36d0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd4000ed050 msgr2=0x7fd4000f63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd4000ed050 0x7fd4000f63f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fcd95d72b0 msgr2=0x55fcd95d96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fcd95d72b0 0x55fcd95d96a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2d4039a70 msgr2=0x7fd2d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2d4039a70 0x7fd2d403bf30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00f010 tx=0x7fd3fc01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 msgr2=0x55fcd95c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd409b30640 1 -- 172.21.15.193:0/1389116463 reap_dead start 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd4000b5540 tx=0x7fd4000eb770 comp rx=0 tx=0).stop 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 shutdown_connections 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1389116463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95bfa20 0x55fcd95c5f50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 >> 172.21.15.193:0/1389116463 conn(0x55fcd95bae40 msgr2=0x55fcd95b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 shutdown_connections 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1389116463 wait complete. 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 msgr2=0x7fd2e403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 0x7fd2e403bf20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55fcd95a33e0 tx=0x7fd3fc003070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 msgr2=0x55fcd95b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd400018eb0 tx=0x7fd400018020 comp rx=0 tx=0).stop 2024-09-12T17:11:26.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 shutdown_connections 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2e4039a60 0x7fd2e403bf20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899372367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd95b2170 0x55fcd95b2590 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 >> 172.21.15.193:0/1899372367 conn(0x55fcd95a7b20 msgr2=0x55fcd95a7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 shutdown_connections 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.595+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899372367 wait complete. 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 msgr2=0x55fcd95a1bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 0x55fcd95a1bd0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 msgr2=0x7fd2f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 0x7fd2f003bf30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd4000ad000 tx=0x7fd4000a5040 comp rx=0 tx=0).stop 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 msgr2=0x55fcd959aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd404001b80 tx=0x7fd404000f50 comp rx=0 tx=0).stop 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 shutdown_connections 2024-09-12T17:11:26.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fcd94177b0 0x55fcd95a1bd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd2f0039a70 0x7fd2f003bf30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 --2- 172.21.15.193:0/1899262398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fcd9417280 0x55fcd959aa60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 >> 172.21.15.193:0/1899262398 conn(0x55fcd949caa0 msgr2=0x55fcd958da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 shutdown_connections 2024-09-12T17:11:26.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.599+0000 7fd40c02a9c0 1 -- 172.21.15.193:0/1899262398 wait complete. 2024-09-12T17:11:26.611 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.611 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T17:11:26.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-12T17:11:26.612 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-12T17:11:26.686 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:26.686 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690eeca9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9981e80d0 0x55c9981ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690eeca9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c9980989c0 con 0x55c9981e3f30 2024-09-12T17:11:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690eeca9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c9980e86d0 con 0x55c9981e80d0 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c1cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9981e80d0 0x55c9981ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c9d0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c9981e3f30 0x55c9981e4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36108/0 (socket says 172.21.15.193:36108) 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c9d0640 1 -- 172.21.15.193:0/2310921215 learned_addr learned my addr 172.21.15.193:0/2310921215 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c1cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c9981e80d0 0x55c9981ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51286/0 (socket says 172.21.15.193:51286) 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c1cf640 1 -- 172.21.15.193:0/2310921215 >> v1:172.21.15.62:6789/0 conn(0x55c9981e3f30 legacy=0x55c9981e4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.683+0000 7f690c1cf640 1 -- 172.21.15.193:0/2310921215 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c99808cca0 con 0x55c9981e80d0 2024-09-12T17:11:26.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690c1cf640 1 --2- 172.21.15.193:0/2310921215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9981ea4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a480 tx=0x7f68f401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c853c31ae48f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690b9ce640 1 -- 172.21.15.193:0/2310921215 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40aa570 con 0x55c9981e80d0 2024-09-12T17:11:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690b9ce640 1 -- 172.21.15.193:0/2310921215 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40af070 con 0x55c9981e80d0 2024-09-12T17:11:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690b9ce640 1 -- 172.21.15.193:0/2310921215 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40aa860 con 0x55c9981e80d0 2024-09-12T17:11:26.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2310921215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 msgr2=0x55c9981ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2310921215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9981ea4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f68f400a480 tx=0x7f68f401b310 comp rx=0 tx=0).stop 2024-09-12T17:11:26.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2310921215 shutdown_connections 2024-09-12T17:11:26.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2310921215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9981ea4c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2310921215 >> 172.21.15.193:0/2310921215 conn(0x55c9981dfa50 msgr2=0x55c9981e1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2310921215 shutdown_connections 2024-09-12T17:11:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.687+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2310921215 wait complete. 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690eeca9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690eeca9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9980ec680 con 0x55c9981e3f30 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690c9d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690c9d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51298/0 (socket says 172.21.15.193:51298) 2024-09-12T17:11:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.699+0000 7f690c9d0640 1 -- 172.21.15.193:0/2491400550 learned_addr learned my addr 172.21.15.193:0/2491400550 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 -- 172.21.15.193:0/2491400550 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c998067da0 con 0x55c9981e3f30 2024-09-12T17:11:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 --2- 172.21.15.193:0/2491400550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001810 tx=0x7f68fc001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7193100d171705 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67fae0d640 1 -- 172.21.15.193:0/2491400550 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc004530 con 0x55c9981e3f30 2024-09-12T17:11:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67fae0d640 1 -- 172.21.15.193:0/2491400550 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc0046d0 con 0x55c9981e3f30 2024-09-12T17:11:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67fae0d640 1 -- 172.21.15.193:0/2491400550 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc0049f0 con 0x55c9981e3f30 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2491400550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 msgr2=0x55c9982cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2491400550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f68fc001810 tx=0x7f68fc001cd0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2491400550 shutdown_connections 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2491400550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e3f30 0x55c9982cf780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2491400550 >> 172.21.15.193:0/2491400550 conn(0x55c9981dfa50 msgr2=0x55c9982cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2491400550 shutdown_connections 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2491400550 wait complete. 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c99808ea50 con 0x55c9981e80d0 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51314/0 (socket says 172.21.15.193:51314) 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 -- 172.21.15.193:0/595307608 learned_addr learned my addr 172.21.15.193:0/595307608 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9982d7650 con 0x55c9981e80d0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690c9d0640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f68fc000f90 tx=0x7f68fc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67f960a640 1 -- 172.21.15.193:0/595307608 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc013630 con 0x55c9981e80d0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9982d78e0 con 0x55c9981e80d0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67f960a640 1 -- 172.21.15.193:0/595307608 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68fc0137d0 con 0x55c9981e80d0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f67f960a640 1 -- 172.21.15.193:0/595307608 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68fc013ad0 con 0x55c9981e80d0 2024-09-12T17:11:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.703+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9982d81f0 con 0x55c9981e80d0 2024-09-12T17:11:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f67f960a640 1 -- 172.21.15.193:0/595307608 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f68fc010070 con 0x55c9981e80d0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f67f960a640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 0x7f67f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f67f960a640 1 -- 172.21.15.193:0/595307608 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f68fc018070 con 0x55c9981e80d0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690c1cf640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 0x7f67f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 0x55c9982de5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9982deae0 con 0x55c9982dc1b0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 0x55c9982de5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690c1cf640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 0x7f67f403bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ae000 tx=0x7f68f40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 0x55c9982de5a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 -- 172.21.15.193:0/595307608 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f69040083f0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9982deea0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 -- 172.21.15.193:0/595307608 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69040083f0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9982e07a0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 -- 172.21.15.193:0/595307608 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69040083f0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9982df9d0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 -- 172.21.15.193:0/595307608 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69040083f0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9982dfdf0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690d1d1640 1 -- 172.21.15.193:0/595307608 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f69040083f0 con 0x55c9982dc1b0 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.707+0000 7f690eeca9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9980f9450 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51322/0 (socket says 172.21.15.193:51322) 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690c1cf640 1 -- 172.21.15.193:0/793538229 learned_addr learned my addr 172.21.15.193:0/793538229 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690c1cf640 1 -- 172.21.15.193:0/793538229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9982ef4e0 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690c1cf640 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68f4018f40 tx=0x7f68f40180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 -- 172.21.15.193:0/793538229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40c5030 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c9982efd40 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 -- 172.21.15.193:0/793538229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40b5950 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 -- 172.21.15.193:0/793538229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40b5c30 con 0x55c9982eea80 2024-09-12T17:11:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9982f02b0 con 0x55c9982eea80 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 -- 172.21.15.193:0/793538229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f68f40c8030 con 0x55c9982eea80 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 0x7f67e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f67f27fc640 1 -- 172.21.15.193:0/793538229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f68f40c6070 con 0x55c9982eea80 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690d1d1640 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 0x7f67e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690d1d1640 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 0x7f67e403bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c9982dfd70 tx=0x7f6904003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.711+0000 7f690eeca9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9982cffb0 con 0x55c9982fb290 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.715+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.715+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51326/0 (socket says 172.21.15.193:51326) 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.715+0000 7f690c1cf640 1 -- 172.21.15.193:0/3000406528 learned_addr learned my addr 172.21.15.193:0/3000406528 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.715+0000 7f690c1cf640 1 -- 172.21.15.193:0/3000406528 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9982fbc40 con 0x55c9982fb290 2024-09-12T17:11:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.715+0000 7f690c1cf640 1 --2- 172.21.15.193:0/3000406528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68f40d2510 tx=0x7f68f4006f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e3c91737c2f7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e3fff640 1 -- 172.21.15.193:0/3000406528 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40d9070 con 0x55c9982fb290 2024-09-12T17:11:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e3fff640 1 -- 172.21.15.193:0/3000406528 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40ea250 con 0x55c9982fb290 2024-09-12T17:11:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e3fff640 1 -- 172.21.15.193:0/3000406528 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40c19b0 con 0x55c9982fb290 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/3000406528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 msgr2=0x55c9982fb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/3000406528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68f40d2510 tx=0x7f68f4006f30 comp rx=0 tx=0).stop 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/3000406528 shutdown_connections 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/3000406528 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9982fb670 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/3000406528 >> 172.21.15.193:0/3000406528 conn(0x55c9982f76c0 msgr2=0x55c9982f5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/3000406528 shutdown_connections 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/3000406528 wait complete. 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 Processor -- start 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- start start 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c9982fc2a0 con 0x55c9982fb290 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690c1cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51334/0 (socket says 172.21.15.193:51334) 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 learned_addr learned my addr 172.21.15.193:0/2086153996 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c998302d20 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690c1cf640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68f40d7040 tx=0x7f68f40eb6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e27fc640 1 -- 172.21.15.193:0/2086153996 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40e2070 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e27fc640 1 -- 172.21.15.193:0/2086153996 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f40064c0 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c998302fb0 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f67e27fc640 1 -- 172.21.15.193:0/2086153996 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f40d9040 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.719+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c998303960 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f67e27fc640 1 -- 172.21.15.193:0/2086153996 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f68f40dc070 con 0x55c9982fb290 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f67e27fc640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67d8039a20 0x7f67d803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f67e27fc640 1 -- 172.21.15.193:0/2086153996 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f68f40ea050 con 0x55c9982fb290 2024-09-12T17:11:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67d8039a20 0x7f67d803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c99830db20 0x55c99830ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998310700 con 0x55c99830db20 2024-09-12T17:11:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c99830db20 0x55c99830ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67d8039a20 0x7f67d803bee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f690400f010 tx=0x7f690401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c99830db20 0x55c99830ffb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 realm 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998310b60 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998311430 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9983117d0 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 20 searching for the correct realm 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c998313d90 0x55c998316180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9983166c0 con 0x55c998313d90 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c1cf640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c998313d90 0x55c998316180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c1cf640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c998313d90 0x55c998316180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c1cf640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68f40c1440 0x7f68f40dd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9983166c0 con 0x7f68f40c1440 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68f40c1440 0x7f68f40dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68f40c1440 0x7f68f40dd800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6904019040 0x7f6904019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.723+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c9983166c0 con 0x7f6904019040 2024-09-12T17:11:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6904019040 0x7f6904019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6904019040 0x7f6904019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f68f40c1440 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.727+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f68f40c1440 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f68f40c1440 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.731+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f68f40c1440 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c998313d90 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x55c99830db20 2024-09-12T17:11:26.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c998312020 con 0x7f68f40c1440 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998312870 con 0x55c99830db20 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998312c60 con 0x55c99830db20 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.735+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998312c60 con 0x55c99830db20 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 zone default found 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 4 Realm: () 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 zonegroup default 2024-09-12T17:11:26.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c9983130f0 con 0x7f6904019040 2024-09-12T17:11:26.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998313140 con 0x55c998313d90 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998318720 con 0x55c998313d90 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998317980 con 0x7f68f40c1440 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94324330165456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998318b80 con 0x7f68f40c1440 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998319540 con 0x55c99830db20 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.739+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94324330165456] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94324330167664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998319540 con 0x55c99830db20 2024-09-12T17:11:26.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998319df0 con 0x55c998313d90 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94324330167664] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94324330174112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831a640 con 0x55c998313d90 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.743+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9983190d0 con 0x7f68f40c1440 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94324330179408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831b420 con 0x7f68f40c1440 2024-09-12T17:11:26.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831be20 con 0x55c99830db20 2024-09-12T17:11:26.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94324330179408] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94324330174112] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94324330176912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831af70 con 0x55c99830db20 2024-09-12T17:11:26.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.747+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831c6c0 con 0x7f6904019040 2024-09-12T17:11:26.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.751+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94324330176912] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94324330182960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831af70 con 0x7f6904019040 2024-09-12T17:11:26.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831cb90 con 0x7f6904019040 2024-09-12T17:11:26.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94324330182960] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94324330186336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831cb50 con 0x7f6904019040 2024-09-12T17:11:26.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.755+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831d570 con 0x7f6904019040 2024-09-12T17:11:26.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94324330186336] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94324330188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831d530 con 0x7f6904019040 2024-09-12T17:11:26.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=0 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=1 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=2 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=3 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=4 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=5 2024-09-12T17:11:26.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.759+0000 7f690eeca9c0 20 add_watcher() i=6 2024-09-12T17:11:26.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94324330188896] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 add_watcher() i=7 2024-09-12T17:11:26.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998320990 con 0x55c99830db20 2024-09-12T17:11:26.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94324330184688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831de80 con 0x55c99830db20 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94324330184688] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f67c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 5 note: GC not initialized 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f67c27e4640 20 reqs_thread_entry: start 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 Filter name: none 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f67bb7fe640 20 reqs_thread_entry: start 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.763+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998343bb0 con 0x55c99830db20 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998344950 con 0x7f68f40c1440 2024-09-12T17:11:26.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-12T17:11:26.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:11:26.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-12T17:11:26.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99834a5a0 con 0x55c99830db20 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94324330373232 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998347240 con 0x55c99830db20 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94324330176912 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f68fc04d040 con 0x55c99830db20 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f67e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94324330176912 notifier 4391 bl.length()=849 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(65 notify.4 [notify cookie 94324330373232 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f67e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:26.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f67e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:26.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f67e3fff640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f67d0003eb0 con 0x55c99830db20 2024-09-12T17:11:26.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94324330373232 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c9982d81f0 con 0x55c99830db20 2024-09-12T17:11:26.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.767+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99834a070 con 0x7f68f40c1440 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94324330373232 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c998344d70 con 0x7f68f40c1440 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== watch-notify(notify (1) cookie 94324330165456 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f6904010040 con 0x7f68f40c1440 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f67e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94324330165456 notifier 4391 bl.length()=166 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f67e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-12T17:11:26.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f67e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-12T17:11:26.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f67e3fff640 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f67d0003eb0 con 0x7f68f40c1440 2024-09-12T17:11:26.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(68 notify.0 [notify cookie 94324330373232 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== watch-notify(notify_complete (2) cookie 94324330373232 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6904026bb0 con 0x7f68f40c1440 2024-09-12T17:11:26.776 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:11:26.771245Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f67c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94324330184688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998341980 con 0x55c99830db20 2024-09-12T17:11:26.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94324330184688] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.771+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94324330165456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998341980 con 0x7f68f40c1440 2024-09-12T17:11:26.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94324330165456] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690eeca9c0 20 remove_watcher() i=0 2024-09-12T17:11:26.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690eeca9c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94324330167664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998341980 con 0x55c99830db20 2024-09-12T17:11:26.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94324330167664] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690eeca9c0 20 remove_watcher() i=1 2024-09-12T17:11:26.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.775+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94324330174112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c998341980 con 0x55c998313d90 2024-09-12T17:11:26.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690c1cf640 1 -- 172.21.15.193:0/2086153996 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94324330174112] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68f40f3020 con 0x55c998313d90 2024-09-12T17:11:26.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 20 remove_watcher() i=2 2024-09-12T17:11:26.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94324330179408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c9983174d0 con 0x7f68f40c1440 2024-09-12T17:11:26.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690d1d1640 1 -- 172.21.15.193:0/2086153996 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94324330179408] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690402f040 con 0x7f68f40c1440 2024-09-12T17:11:26.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 20 remove_watcher() i=3 2024-09-12T17:11:26.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94324330176912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831ab50 con 0x55c99830db20 2024-09-12T17:11:26.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94324330176912] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x55c99830db20 2024-09-12T17:11:26.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 20 remove_watcher() i=4 2024-09-12T17:11:26.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.779+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94324330182960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831a190 con 0x7f6904019040 2024-09-12T17:11:26.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94324330182960] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690eeca9c0 20 remove_watcher() i=5 2024-09-12T17:11:26.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94324330186336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831ab50 con 0x7f6904019040 2024-09-12T17:11:26.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94324330186336] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690eeca9c0 20 remove_watcher() i=6 2024-09-12T17:11:26.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.783+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94324330188896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c99831c660 con 0x7f6904019040 2024-09-12T17:11:26.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94324330188896] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68fc01b030 con 0x7f6904019040 2024-09-12T17:11:26.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 20 remove_watcher() i=7 2024-09-12T17:11:26.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6904019040 msgr2=0x7f6904019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6904019040 0x7f6904019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c99830db20 msgr2=0x55c99830ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c99830db20 0x55c99830ffb0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68f40c1440 msgr2=0x7f68f40dd800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68f40c1440 0x7f68f40dd800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c998313d90 msgr2=0x55c998316180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c998313d90 0x55c998316180 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67d8039a20 msgr2=0x7f67d803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67d8039a20 0x7f67d803bee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f690400f010 tx=0x7f690401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 msgr2=0x55c9983027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f68f40d7040 tx=0x7f68f40eb6e0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690c9d0640 1 -- 172.21.15.193:0/2086153996 reap_dead start 2024-09-12T17:11:26.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 shutdown_connections 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/2086153996 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982fb290 0x55c9983027c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 >> 172.21.15.193:0/2086153996 conn(0x55c9982f76c0 msgr2=0x55c9982f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 shutdown_connections 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/2086153996 wait complete. 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 msgr2=0x7f67e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 0x7f67e403bf30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c9982dfd70 tx=0x7f6904003070 comp rx=0 tx=0).stop 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 msgr2=0x55c9982eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68f4018f40 tx=0x7f68f40180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 shutdown_connections 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67e4039a70 0x7f67e403bf30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/793538229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9982eea80 0x55c9982eeea0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 >> 172.21.15.193:0/793538229 conn(0x55c9982e4430 msgr2=0x55c9982e4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 shutdown_connections 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/793538229 wait complete. 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 msgr2=0x55c9982de5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 0x55c9982de5a0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 msgr2=0x7f67f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 0x7f67f403bf30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f68f40ae000 tx=0x7f68f40a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 msgr2=0x55c9982d70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f68fc000f90 tx=0x7f68fc001260 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 shutdown_connections 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c9982dc1b0 0x55c9982de5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f4039a70 0x7f67f403bf30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 --2- 172.21.15.193:0/595307608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c9981e80d0 0x55c9982d70f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 >> 172.21.15.193:0/595307608 conn(0x55c9981dfa50 msgr2=0x55c9982c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 shutdown_connections 2024-09-12T17:11:26.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.787+0000 7f690eeca9c0 1 -- 172.21.15.193:0/595307608 wait complete. 2024-09-12T17:11:26.802 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:11:26.771245Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:11:26.803 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:11:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7a6679c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564440fde150 0x564440fe0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7a6679c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564440e8e9c0 con 0x564440fd9fb0 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7a6679c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564440ede6d0 con 0x564440fde150 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7796c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564440fde150 0x564440fe0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7816d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x564440fd9fb0 0x564440fda390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36110/0 (socket says 172.21.15.193:36110) 2024-09-12T17:11:26.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7816d640 1 -- 172.21.15.193:0/3079347140 learned_addr learned my addr 172.21.15.193:0/3079347140 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7796c640 1 -- 172.21.15.193:0/3079347140 >> v1:172.21.15.62:6789/0 conn(0x564440fd9fb0 legacy=0x564440fda390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.875+0000 7fce7796c640 1 -- 172.21.15.193:0/3079347140 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564440e82ca0 con 0x564440fde150 2024-09-12T17:11:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7796c640 1 --2- 172.21.15.193:0/3079347140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fde150 0x564440fe0540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00a480 tx=0x7fce6c01b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30de40abdb576b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7716b640 1 -- 172.21.15.193:0/3079347140 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0aa570 con 0x564440fde150 2024-09-12T17:11:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7716b640 1 -- 172.21.15.193:0/3079347140 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c0af070 con 0x564440fde150 2024-09-12T17:11:26.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7716b640 1 -- 172.21.15.193:0/3079347140 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0aa860 con 0x564440fde150 2024-09-12T17:11:26.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 -- 172.21.15.193:0/3079347140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fde150 msgr2=0x564440fe0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/3079347140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fde150 0x564440fe0540 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00a480 tx=0x7fce6c01b310 comp rx=0 tx=0).stop 2024-09-12T17:11:26.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 -- 172.21.15.193:0/3079347140 shutdown_connections 2024-09-12T17:11:26.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/3079347140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fde150 0x564440fe0540 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 -- 172.21.15.193:0/3079347140 >> 172.21.15.193:0/3079347140 conn(0x564440fd5ad0 msgr2=0x564440fd7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 -- 172.21.15.193:0/3079347140 shutdown_connections 2024-09-12T17:11:26.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.879+0000 7fce7a6679c0 1 -- 172.21.15.193:0/3079347140 wait complete. 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.891+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.891+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.891+0000 7fce7a6679c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.891+0000 7fce7a6679c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564440ee2680 con 0x564440fd9fb0 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51364/0 (socket says 172.21.15.193:51364) 2024-09-12T17:11:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 -- 172.21.15.193:0/2869944732 learned_addr learned my addr 172.21.15.193:0/2869944732 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 -- 172.21.15.193:0/2869944732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564440e5dda0 con 0x564440fd9fb0 2024-09-12T17:11:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 --2- 172.21.15.193:0/2869944732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce68001e50 tx=0x7fce68001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521dcd8efccef32a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fcd6660c640 1 -- 172.21.15.193:0/2869944732 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce68012020 con 0x564440fd9fb0 2024-09-12T17:11:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fcd6660c640 1 -- 172.21.15.193:0/2869944732 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6800e7c0 con 0x564440fd9fb0 2024-09-12T17:11:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fcd6660c640 1 -- 172.21.15.193:0/2869944732 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6800eaa0 con 0x564440fd9fb0 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2869944732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 msgr2=0x564440f50a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2869944732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce68001e50 tx=0x7fce68001e80 comp rx=0 tx=0).stop 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2869944732 shutdown_connections 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2869944732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x564440f50a10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2869944732 >> 172.21.15.193:0/2869944732 conn(0x564440fd5ad0 msgr2=0x5644410c1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2869944732 shutdown_connections 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2869944732 wait complete. 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7a6679c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564440e84a50 con 0x564440fd9fb0 2024-09-12T17:11:26.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51376/0 (socket says 172.21.15.193:51376) 2024-09-12T17:11:26.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.895+0000 7fce7816d640 1 -- 172.21.15.193:0/563026021 learned_addr learned my addr 172.21.15.193:0/563026021 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7816d640 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644410cf4f0 con 0x564440fd9fb0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7816d640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564440f505f0 tx=0x7fce68000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 -- 172.21.15.193:0/563026021 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce68012030 con 0x564440fd9fb0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644410cf780 con 0x564440fd9fb0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 -- 172.21.15.193:0/563026021 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6801a680 con 0x564440fd9fb0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 -- 172.21.15.193:0/563026021 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6801a9a0 con 0x564440fd9fb0 2024-09-12T17:11:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644410d0090 con 0x564440fd9fb0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 -- 172.21.15.193:0/563026021 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce68015020 con 0x564440fd9fb0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 0x7fcd6003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fcd64e09640 1 -- 172.21.15.193:0/563026021 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fce68020070 con 0x564440fd9fb0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7796c640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 0x7fcd6003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 0x5644410d6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644410d65a0 con 0x564440fde150 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7896e640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 0x5644410d6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7796c640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 0x7fcd6003bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0ae000 tx=0x7fce6c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7896e640 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 0x5644410d6060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7896e640 1 -- 172.21.15.193:0/563026021 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce7000a4d0 con 0x564440fde150 2024-09-12T17:11:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644410d03d0 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7896e640 1 -- 172.21.15.193:0/563026021 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce7000a4d0 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.899+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644410d8300 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7896e640 1 -- 172.21.15.193:0/563026021 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fce7000a4d0 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644410d7530 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7896e640 1 -- 172.21.15.193:0/563026021 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce7000a4d0 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644410d7980 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7896e640 1 -- 172.21.15.193:0/563026021 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fce7000a4d0 con 0x564440fde150 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564440eef450 con 0x5644410e6610 2024-09-12T17:11:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51380/0 (socket says 172.21.15.193:51380) 2024-09-12T17:11:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7796c640 1 -- 172.21.15.193:0/432599088 learned_addr learned my addr 172.21.15.193:0/432599088 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7796c640 1 -- 172.21.15.193:0/432599088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644410e7070 con 0x5644410e6610 2024-09-12T17:11:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7796c640 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce6c018f40 tx=0x7fce6c0180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fcd5dffb640 1 -- 172.21.15.193:0/432599088 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0c5030 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644410e78d0 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644410e7e40 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fcd5dffb640 1 -- 172.21.15.193:0/432599088 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c0b5950 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.903+0000 7fcd5dffb640 1 -- 172.21.15.193:0/432599088 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0cf060 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd5dffb640 1 -- 172.21.15.193:0/432599088 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce6c0c8030 con 0x5644410e6610 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd5dffb640 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 0x7fcd5003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd5dffb640 1 -- 172.21.15.193:0/432599088 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fce6c0c6070 con 0x5644410e6610 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7896e640 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 0x7fcd5003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7896e640 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 0x7fcd5003bf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5644410d7050 tx=0x7fce70005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564440f51240 con 0x5644410f3ea0 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51392/0 (socket says 172.21.15.193:51392) 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 -- 172.21.15.193:0/1007319366 learned_addr learned my addr 172.21.15.193:0/1007319366 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 -- 172.21.15.193:0/1007319366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644410f4890 con 0x5644410f3ea0 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 --2- 172.21.15.193:0/1007319366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000bf0 tx=0x7fce6c0c1eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb73dbadf8eb5e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd577fe640 1 -- 172.21.15.193:0/1007319366 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0d8070 con 0x5644410f3ea0 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd577fe640 1 -- 172.21.15.193:0/1007319366 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c0c04d0 con 0x5644410f3ea0 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fcd577fe640 1 -- 172.21.15.193:0/1007319366 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0e6040 con 0x5644410f3ea0 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- 172.21.15.193:0/1007319366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 msgr2=0x5644410f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/1007319366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce6c000bf0 tx=0x7fce6c0c1eb0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- 172.21.15.193:0/1007319366 shutdown_connections 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/1007319366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410f42a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- 172.21.15.193:0/1007319366 >> 172.21.15.193:0/1007319366 conn(0x5644410ef2c0 msgr2=0x5644410ed500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- 172.21.15.193:0/1007319366 shutdown_connections 2024-09-12T17:11:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- 172.21.15.193:0/1007319366 wait complete. 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 Processor -- start 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- start start 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7a6679c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5644410f2df0 con 0x5644410f3ea0 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410fa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51404/0 (socket says 172.21.15.193:51404) 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.907+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 learned_addr learned my addr 172.21.15.193:0/2754857618 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644410fa940 con 0x5644410f3ea0 2024-09-12T17:11:26.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7796c640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410fa3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005af0 tx=0x7fce6c0ebad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 -- 172.21.15.193:0/2754857618 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0f1020 con 0x5644410f3ea0 2024-09-12T17:11:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644410fabd0 con 0x5644410f3ea0 2024-09-12T17:11:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 -- 172.21.15.193:0/2754857618 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c0ea370 con 0x5644410f3ea0 2024-09-12T17:11:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 -- 172.21.15.193:0/2754857618 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce6c0ea520 con 0x5644410f3ea0 2024-09-12T17:11:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644410fb580 con 0x5644410f3ea0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 -- 172.21.15.193:0/2754857618 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fce6c0f4020 con 0x5644410f3ea0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd48039a70 0x7fcd4803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fcd55ffb640 1 -- 172.21.15.193:0/2754857618 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fce6c0f7c40 con 0x5644410f3ea0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7896e640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd48039a70 0x7fcd4803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5644411056e0 0x564441107b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644411082c0 con 0x5644411056e0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7816d640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5644411056e0 0x564441107b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7896e640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd48039a70 0x7fcd4803bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x5644410d0310 tx=0x7fce7001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7816d640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5644411056e0 0x564441107b70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce68008030 con 0x5644411056e0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 realm 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644411086d0 con 0x5644411056e0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce68008030 con 0x5644411056e0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564441108fa0 con 0x5644411056e0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce68008030 con 0x5644411056e0 2024-09-12T17:11:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.911+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564441109340 con 0x5644411056e0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fce68008030 con 0x5644411056e0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644411097e0 con 0x5644411056e0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fce68008030 con 0x5644411056e0 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 20 searching for the correct realm 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56444110b750 0x56444110db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7796c640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56444110b750 0x56444110db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7796c640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56444110b750 0x56444110db40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7796c640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fce6c0f6020 0x7fce6c0f8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7896e640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fce6c0f6020 0x7fce6c0f8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7896e640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fce6c0f6020 0x7fce6c0f8aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7896e640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fce70031040 0x7fce70032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fce70031040 0x7fce70032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fce70031040 0x7fce70032430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.915+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.919+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.923+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x56444110b750 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce70031040 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x5644411056e0 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56444110e1c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fce7001f070 con 0x7fce6c0f6020 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:26.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56444110a1f0 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56444110aa90 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564441109e30 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:26.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 zone default found 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 4 Realm: () 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 zonegroup default 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56444110aa90 con 0x7fce70031040 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.927+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564441110010 con 0x56444110b750 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5644411103b0 con 0x56444110b750 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 20 started sync module instance, tier type = 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:26.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56444110f4b0 con 0x7fce6c0f6020 2024-09-12T17:11:26.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94851149396176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441110c50 con 0x7fce6c0f6020 2024-09-12T17:11:26.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411114a0 con 0x5644411056e0 2024-09-12T17:11:26.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94851149396176] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94851149399968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411110d0 con 0x5644411056e0 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.931+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441111bf0 con 0x56444110b750 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94851149399968] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94851149403840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441111fe0 con 0x56444110b750 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411129a0 con 0x7fce6c0f6020 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94851149407744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441113090 con 0x7fce6c0f6020 2024-09-12T17:11:26.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441113bb0 con 0x5644411056e0 2024-09-12T17:11:26.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.935+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94851149403840] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94851149407744] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94851149411968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441113b70 con 0x5644411056e0 2024-09-12T17:11:26.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441114450 con 0x7fce70031040 2024-09-12T17:11:26.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94851149411968] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94851149401024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441113b70 con 0x7fce70031040 2024-09-12T17:11:26.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.939+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411148f0 con 0x7fce70031040 2024-09-12T17:11:26.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.943+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94851149401024] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.943+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.943+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94851149414224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441114820 con 0x7fce70031040 2024-09-12T17:11:26.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.943+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411152a0 con 0x7fce70031040 2024-09-12T17:11:26.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94851149417872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441115710 con 0x7fce70031040 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=0 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=1 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=2 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=3 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=4 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=5 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94851149414224] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=6 2024-09-12T17:11:26.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94851149417872] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 20 add_watcher() i=7 2024-09-12T17:11:26.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:26.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564441114370 con 0x5644411056e0 2024-09-12T17:11:26.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94851149415280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441115bf0 con 0x5644411056e0 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.947+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94851149415280] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fcd2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 5 note: GC not initialized 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fcd2d7e2640 20 reqs_thread_entry: start 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:26.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 Filter name: none 2024-09-12T17:11:26.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fcc9effd640 20 reqs_thread_entry: start 2024-09-12T17:11:26.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:26.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56444113b4b0 con 0x5644411056e0 2024-09-12T17:11:26.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T17:11:26.956 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:11:26.771245Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:26.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fcd2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:26.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94851149415280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441116010 con 0x5644411056e0 2024-09-12T17:11:26.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94851149415280] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94851149396176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441114370 con 0x7fce6c0f6020 2024-09-12T17:11:26.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94851149396176] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.951+0000 7fce7a6679c0 20 remove_watcher() i=0 2024-09-12T17:11:26.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 2 removed watcher, disabling cache 2024-09-12T17:11:26.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94851149399968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56444110f8d0 con 0x5644411056e0 2024-09-12T17:11:26.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94851149399968] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 20 remove_watcher() i=1 2024-09-12T17:11:26.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94851149403840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56444110f8d0 con 0x56444110b750 2024-09-12T17:11:26.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7796c640 1 -- 172.21.15.193:0/2754857618 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94851149403840] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6c0da030 con 0x56444110b750 2024-09-12T17:11:26.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 20 remove_watcher() i=2 2024-09-12T17:11:26.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.955+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94851149407744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5644411116c0 con 0x7fce6c0f6020 2024-09-12T17:11:26.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7896e640 1 -- 172.21.15.193:0/2754857618 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94851149407744] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce70040040 con 0x7fce6c0f6020 2024-09-12T17:11:26.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7a6679c0 20 remove_watcher() i=3 2024-09-12T17:11:26.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94851149411968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441112600 con 0x5644411056e0 2024-09-12T17:11:26.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94851149411968] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x5644411056e0 2024-09-12T17:11:26.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7a6679c0 20 remove_watcher() i=4 2024-09-12T17:11:26.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.959+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94851149401024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441113680 con 0x7fce70031040 2024-09-12T17:11:26.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94851149401024] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7a6679c0 20 remove_watcher() i=5 2024-09-12T17:11:26.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94851149414224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441112600 con 0x7fce70031040 2024-09-12T17:11:26.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94851149414224] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7a6679c0 20 remove_watcher() i=6 2024-09-12T17:11:26.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.963+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94851149417872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564441112600 con 0x7fce70031040 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94851149417872] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fce6804c040 con 0x7fce70031040 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 20 remove_watcher() i=7 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fce70031040 msgr2=0x7fce70032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fce70031040 0x7fce70032430 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5644411056e0 msgr2=0x564441107b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5644411056e0 0x564441107b70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fce6c0f6020 msgr2=0x7fce6c0f8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fce6c0f6020 0x7fce6c0f8aa0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56444110b750 msgr2=0x56444110db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56444110b750 0x56444110db40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd48039a70 msgr2=0x7fcd4803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd48039a70 0x7fcd4803bf30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x5644410d0310 tx=0x7fce7001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 msgr2=0x5644410fa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/2754857618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410f3ea0 0x5644410fa3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005af0 tx=0x7fce6c0ebad0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 reap_dead start 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7816d640 1 -- 172.21.15.193:0/2754857618 reap_dead start 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 shutdown_connections 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 >> 172.21.15.193:0/2754857618 conn(0x5644410ef2c0 msgr2=0x5644410ed4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 shutdown_connections 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/2754857618 wait complete. 2024-09-12T17:11:26.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 msgr2=0x7fcd5003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 0x7fcd5003bf80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x5644410d7050 tx=0x7fce70005850 comp rx=0 tx=0).stop 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 msgr2=0x5644410e6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce6c018f40 tx=0x7fce6c0180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 shutdown_connections 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd50039ac0 0x7fcd5003bf80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/432599088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5644410e6610 0x5644410e6a30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 >> 172.21.15.193:0/432599088 conn(0x5644410dbfc0 msgr2=0x5644410dc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 shutdown_connections 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/432599088 wait complete. 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 msgr2=0x5644410d6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 0x5644410d6060 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 msgr2=0x7fcd6003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 0x7fcd6003bf30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0ae000 tx=0x7fce6c0a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 msgr2=0x5644410cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x564440f505f0 tx=0x7fce68000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 shutdown_connections 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564440fde150 0x5644410d6060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fcd60039a70 0x7fcd6003bf30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 --2- 172.21.15.193:0/563026021 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564440fd9fb0 0x5644410cef90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 >> 172.21.15.193:0/563026021 conn(0x564440fd5ad0 msgr2=0x564440f4f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 shutdown_connections 2024-09-12T17:11:26.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:26.967+0000 7fce7a6679c0 1 -- 172.21.15.193:0/563026021 wait complete. 2024-09-12T17:11:26.980 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:11:26.771245Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:26.981 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T17:11:26.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-12T17:11:26.981 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-12T17:11:27.059 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.059 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d59189c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a9cf4d7140 0x55a9cf4d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d59189c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9cf3879c0 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d59189c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55a9cf3d76d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d2c1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a9cf4d7140 0x55a9cf4d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d341e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55a9cf4d2fa0 0x55a9cf4d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36122/0 (socket says 172.21.15.193:36122) 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d2c1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a9cf4d7140 0x55a9cf4d9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51410/0 (socket says 172.21.15.193:51410) 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d341e640 1 -- 172.21.15.193:0/3512064705 learned_addr learned my addr 172.21.15.193:0/3512064705 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/3512064705 >> v1:172.21.15.62:6789/0 conn(0x55a9cf4d2fa0 legacy=0x55a9cf4d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.055+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/3512064705 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf37bca0 con 0x55a9cf4d7140 2024-09-12T17:11:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/3512064705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d7140 0x55a9cf4d9530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800a480 tx=0x7fd7c801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5995c0e7887531 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d241c640 1 -- 172.21.15.193:0/3512064705 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80aa570 con 0x55a9cf4d7140 2024-09-12T17:11:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d241c640 1 -- 172.21.15.193:0/3512064705 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80af070 con 0x55a9cf4d7140 2024-09-12T17:11:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d241c640 1 -- 172.21.15.193:0/3512064705 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80aa860 con 0x55a9cf4d7140 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3512064705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d7140 msgr2=0x55a9cf4d9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/3512064705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d7140 0x55a9cf4d9530 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800a480 tx=0x7fd7c801b310 comp rx=0 tx=0).stop 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3512064705 shutdown_connections 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/3512064705 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d7140 0x55a9cf4d9530 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3512064705 >> 172.21.15.193:0/3512064705 conn(0x55a9cf4ceac0 msgr2=0x55a9cf4d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3512064705 shutdown_connections 2024-09-12T17:11:27.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.059+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3512064705 wait complete. 2024-09-12T17:11:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a9cf3db680 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51420/0 (socket says 172.21.15.193:51420) 2024-09-12T17:11:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 -- 172.21.15.193:0/3703364240 learned_addr learned my addr 172.21.15.193:0/3703364240 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 -- 172.21.15.193:0/3703364240 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf356da0 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 --2- 172.21.15.193:0/3703364240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001e00 tx=0x7fd7c400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191d01919a3043f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd6c160a640 1 -- 172.21.15.193:0/3703364240 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c4012020 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd6c160a640 1 -- 172.21.15.193:0/3703364240 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c400e690 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd6c160a640 1 -- 172.21.15.193:0/3703364240 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c400ea10 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3703364240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 msgr2=0x55a9cf5be6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/3703364240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd7c4001e00 tx=0x7fd7c400b6d0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3703364240 shutdown_connections 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/3703364240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5be6d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3703364240 >> 172.21.15.193:0/3703364240 conn(0x55a9cf4ceac0 msgr2=0x55a9cf5ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3703364240 shutdown_connections 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- 172.21.15.193:0/3703364240 wait complete. 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d59189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a9cf37da50 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51430/0 (socket says 172.21.15.193:51430) 2024-09-12T17:11:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.075+0000 7fd7d341e640 1 -- 172.21.15.193:0/1034071582 learned_addr learned my addr 172.21.15.193:0/1034071582 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d341e640 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf5c62a0 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d341e640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b710 tx=0x7fd7c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 -- 172.21.15.193:0/1034071582 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c4012030 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9cf5c6530 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 -- 172.21.15.193:0/1034071582 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c401a750 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 -- 172.21.15.193:0/1034071582 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c401aa70 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9cf5c6ee0 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 -- 172.21.15.193:0/1034071582 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7c4015020 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 0x7fd6b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd6bfe07640 1 -- 172.21.15.193:0/1034071582 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd7c4020030 con 0x55a9cf4d2fa0 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 0x7fd6b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 0x55a9cf449240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf449780 con 0x55a9cf4d7140 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 0x55a9cf449240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 0x7fd6b803bf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80ae000 tx=0x7fd7c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.079+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 0x55a9cf449240 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/1034071582 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7cc00a4d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf449bb0 con 0x55a9cf4d7140 2024-09-12T17:11:27.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/1034071582 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7cc00a4d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf5d1390 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/1034071582 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd7cc00a4d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf44a110 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/1034071582 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7cc00a4d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf5d1be0 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/1034071582 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd7cc00a4d0 con 0x55a9cf4d7140 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a9cf3e8450 con 0x55a9cf5df5c0 2024-09-12T17:11:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51432/0 (socket says 172.21.15.193:51432) 2024-09-12T17:11:27.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/288261893 learned_addr learned my addr 172.21.15.193:0/288261893 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/288261893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf5e0020 con 0x55a9cf5df5c0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8000c10 tx=0x7fd7c80180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd6bd602640 1 -- 172.21.15.193:0/288261893 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80c5030 con 0x55a9cf5df5c0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9cf5e0880 con 0x55a9cf5df5c0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9cf5e0df0 con 0x55a9cf5df5c0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.083+0000 7fd6bd602640 1 -- 172.21.15.193:0/288261893 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80b5950 con 0x55a9cf5df5c0 2024-09-12T17:11:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6bd602640 1 -- 172.21.15.193:0/288261893 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80cf060 con 0x55a9cf5df5c0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6bd602640 1 -- 172.21.15.193:0/288261893 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7c80c8030 con 0x55a9cf5df5c0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6bd602640 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 0x7fd6ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6bd602640 1 -- 172.21.15.193:0/288261893 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd7c80c6070 con 0x55a9cf5df5c0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 0x7fd6ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 0x7fd6ac03bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55a9cf44a4b0 tx=0x7fd7cc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d59189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d59189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a9cf5bef00 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51446/0 (socket says 172.21.15.193:51446) 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/4253653958 learned_addr learned my addr 172.21.15.193:0/4253653958 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/4253653958 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf5ed7e0 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/4253653958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80059b0 tx=0x7fd7c80c0f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246fd42d41e704ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6b6ffd640 1 -- 172.21.15.193:0/4253653958 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80d8070 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6b6ffd640 1 -- 172.21.15.193:0/4253653958 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80c1440 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.087+0000 7fd6b6ffd640 1 -- 172.21.15.193:0/4253653958 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80c03a0 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/4253653958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 msgr2=0x55a9cf5ed1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/4253653958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80059b0 tx=0x7fd7c80c0f30 comp rx=0 tx=0).stop 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/4253653958 shutdown_connections 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/4253653958 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5ed1f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/4253653958 >> 172.21.15.193:0/4253653958 conn(0x55a9cf5e8210 msgr2=0x55a9cf5e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/4253653958 shutdown_connections 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/4253653958 wait complete. 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 Processor -- start 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- start start 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a9cf5ebd40 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d2c1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51450/0 (socket says 172.21.15.193:51450) 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 learned_addr learned my addr 172.21.15.193:0/753945388 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9cf5f3880 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80059b0 tx=0x7fd7c80ebab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 -- 172.21.15.193:0/753945388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80f1070 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9cf5f3b10 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9cf5f44c0 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 -- 172.21.15.193:0/753945388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c80ea350 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 -- 172.21.15.193:0/753945388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7c80fb060 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 -- 172.21.15.193:0/753945388 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd7c80f4070 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd69c039a70 0x7fd69c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd6b57fa640 1 -- 172.21.15.193:0/753945388 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd7c80e8040 con 0x55a9cf5ecdf0 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd69c039a70 0x7fd69c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf5fe660 0x55a9cf600af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.091+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf601240 con 0x55a9cf5fe660 2024-09-12T17:11:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf5fe660 0x55a9cf600af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd69c039a70 0x7fd69c03bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55a9cf44a0e0 tx=0x7fd7cc01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf5fe660 0x55a9cf600af0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 realm 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf601650 con 0x55a9cf5fe660 2024-09-12T17:11:27.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf601f20 con 0x55a9cf5fe660 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6022c0 con 0x55a9cf5fe660 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf602b10 con 0x55a9cf5fe660 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 20 searching for the correct realm 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a9cf604540 0x55a9cf606a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a9cf604540 0x55a9cf606a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a9cf604540 0x55a9cf606a00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d2c1d640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd7c80f6070 0x7fd7c80dd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd7c80f6070 0x7fd7c80dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd7c80f6070 0x7fd7c80dd450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd7cc031040 0x7fd7cc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.095+0000 7fd7d341e640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd7cc031040 0x7fd7cc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd7cc031040 0x7fd7cc032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.099+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.103+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf604540 2024-09-12T17:11:27.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7cc031040 2024-09-12T17:11:27.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x55a9cf5fe660 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6070d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd7cc01f070 con 0x7fd7c80f6070 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:27.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf603360 con 0x55a9cf5fe660 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf603750 con 0x55a9cf5fe660 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.107+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf603750 con 0x55a9cf5fe660 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 zone default found 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 4 Realm: () 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 zonegroup default 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf607550 con 0x7fd7cc031040 2024-09-12T17:11:27.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf609040 con 0x55a9cf604540 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf609480 con 0x55a9cf604540 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 started sync module instance, tier type = 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6083e0 con 0x7fd7c80f6070 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94187817043920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf608040 con 0x7fd7c80f6070 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60a390 con 0x55a9cf5fe660 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.111+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94187817043920] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94187817048256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60a390 con 0x55a9cf5fe660 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60ada0 con 0x55a9cf604540 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94187817052400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60b5f0 con 0x55a9cf604540 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60bff0 con 0x7fd7c80f6070 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.115+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94187817048256] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94187817049824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60c3e0 con 0x7fd7c80f6070 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60cda0 con 0x55a9cf5fe660 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94187817049824] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94187817052400] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94187817054528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60c8f0 con 0x55a9cf5fe660 2024-09-12T17:11:27.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.119+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60d640 con 0x7fd7cc031040 2024-09-12T17:11:27.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94187817054528] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94187817057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60c8f0 con 0x7fd7cc031040 2024-09-12T17:11:27.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60da60 con 0x7fd7cc031040 2024-09-12T17:11:27.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94187817063760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60ded0 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.123+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60e9c0 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94187817057024] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94187817063760] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94187817067664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60da20 con 0x7fd7cc031040 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=0 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=1 2024-09-12T17:11:27.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=2 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=3 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=4 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=5 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=6 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94187817067664] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 20 add_watcher() i=7 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.127+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf611ac0 con 0x55a9cf5fe660 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94187817061968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60ef40 con 0x55a9cf5fe660 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94187817061968] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 5 note: GC not initialized 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd688fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 Filter name: none 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd6027fc640 20 reqs_thread_entry: start 2024-09-12T17:11:27.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf634a90 con 0x55a9cf5fe660 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 20 rados_obj.operate() r=0 bl.length=673 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf63b580 con 0x55a9cf5fe660 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94187817250928 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf636d50 con 0x55a9cf5fe660 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94187817054528 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7fd7c4033040 con 0x55a9cf5fe660 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd6b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94187817054528 notifier 4405 bl.length()=758 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd6b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd6b6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd6b6ffd640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd698003eb0 con 0x55a9cf5fe660 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.131+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94187817250928 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94187817250928 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd7c4049040 con 0x55a9cf5fe660 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf63b070 con 0x55a9cf5fe660 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d59189c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94187817250928 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6368a0 con 0x7fd7c80f6070 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== watch-notify(notify (1) cookie 94187817043920 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fd7cc0247b0 con 0x7fd7c80f6070 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd6b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94187817043920 notifier 4405 bl.length()=159 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.0 [notify cookie 94187817250928 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd6b67fc640 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd6080032d0 con 0x7fd7c80f6070 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== watch-notify(notify_complete (2) cookie 94187817250928 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd7cc024980 con 0x7fd7c80f6070 2024-09-12T17:11:27.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.146 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:11:26.771245Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94187817061968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6328a0 con 0x55a9cf5fe660 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94187817061968] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.135+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94187817043920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6328a0 con 0x7fd7c80f6070 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94187817043920] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d59189c0 20 remove_watcher() i=0 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d59189c0 2 removed watcher, disabling cache 2024-09-12T17:11:27.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94187817048256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6328a0 con 0x55a9cf5fe660 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94187817048256] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d59189c0 20 remove_watcher() i=1 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.139+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94187817052400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6328a0 con 0x55a9cf604540 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d2c1d640 1 -- 172.21.15.193:0/753945388 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94187817052400] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c80f3030 con 0x55a9cf604540 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d59189c0 20 remove_watcher() i=2 2024-09-12T17:11:27.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94187817049824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6098c0 con 0x7fd7c80f6070 2024-09-12T17:11:27.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d3c1f640 1 -- 172.21.15.193:0/753945388 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94187817049824] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7cc040040 con 0x7fd7c80f6070 2024-09-12T17:11:27.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d59189c0 20 remove_watcher() i=3 2024-09-12T17:11:27.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.143+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94187817054528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60a8f0 con 0x55a9cf5fe660 2024-09-12T17:11:27.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94187817054528] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x55a9cf5fe660 2024-09-12T17:11:27.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d59189c0 20 remove_watcher() i=4 2024-09-12T17:11:27.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94187817057024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf609ee0 con 0x7fd7cc031040 2024-09-12T17:11:27.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94187817057024] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d59189c0 20 remove_watcher() i=5 2024-09-12T17:11:27.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.147+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94187817063760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf6098c0 con 0x7fd7cc031040 2024-09-12T17:11:27.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94187817063760] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 20 remove_watcher() i=6 2024-09-12T17:11:27.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94187817067664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9cf60a8f0 con 0x7fd7cc031040 2024-09-12T17:11:27.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94187817067664] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd7c4008030 con 0x7fd7cc031040 2024-09-12T17:11:27.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 20 remove_watcher() i=7 2024-09-12T17:11:27.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd7cc031040 msgr2=0x7fd7cc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd7cc031040 0x7fd7cc032940 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf5fe660 msgr2=0x55a9cf600af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf5fe660 0x55a9cf600af0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd7c80f6070 msgr2=0x7fd7c80dd450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd7c80f6070 0x7fd7c80dd450 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a9cf604540 msgr2=0x55a9cf606a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a9cf604540 0x55a9cf606a00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd69c039a70 msgr2=0x7fd69c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd69c039a70 0x7fd69c03bf30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55a9cf44a0e0 tx=0x7fd7cc01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 msgr2=0x55a9cf5f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d341e640 1 -- 172.21.15.193:0/753945388 reap_dead start 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80059b0 tx=0x7fd7c80ebab0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 shutdown_connections 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/753945388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5ecdf0 0x55a9cf5f3320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 >> 172.21.15.193:0/753945388 conn(0x55a9cf5e8210 msgr2=0x55a9cf5e6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 shutdown_connections 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/753945388 wait complete. 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 msgr2=0x7fd6ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 0x7fd6ac03bf30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55a9cf44a4b0 tx=0x7fd7cc005850 comp rx=0 tx=0).stop 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 msgr2=0x55a9cf5df9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8000c10 tx=0x7fd7c80180b0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 shutdown_connections 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6ac039a70 0x7fd6ac03bf30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/288261893 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf5df5c0 0x55a9cf5df9e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.151+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 >> 172.21.15.193:0/288261893 conn(0x55a9cf5d4f70 msgr2=0x55a9cf5d5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 shutdown_connections 2024-09-12T17:11:27.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/288261893 wait complete. 2024-09-12T17:11:27.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 msgr2=0x55a9cf449240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 0x55a9cf449240 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 msgr2=0x7fd6b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 0x7fd6b803bf30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80ae000 tx=0x7fd7c80a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 msgr2=0x55a9cf5c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400b710 tx=0x7fd7c4000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 shutdown_connections 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a9cf4d7140 0x55a9cf449240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd6b8039a70 0x7fd6b803bf30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 --2- 172.21.15.193:0/1034071582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a9cf4d2fa0 0x55a9cf5c5d40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 >> 172.21.15.193:0/1034071582 conn(0x55a9cf4ceac0 msgr2=0x55a9cf5b8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 shutdown_connections 2024-09-12T17:11:27.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.155+0000 7fd7d59189c0 1 -- 172.21.15.193:0/1034071582 wait complete. 2024-09-12T17:11:27.167 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:11:26.771245Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:27.168 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T17:11:27.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-12T17:11:27.168 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-12T17:11:27.243 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.243 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec61ba59c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55df9bbfaaf0 0x55df9bbfaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec61ba59c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df9bb389c0 con 0x55df9bbf94f0 2024-09-12T17:11:27.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec61ba59c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55df9bb886d0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec5f6ab640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55df9bbfaaf0 0x55df9bbfaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec5eeaa640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55df9bbf94f0 0x55df9bbf9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36560/0 (socket says 172.21.15.193:36560) 2024-09-12T17:11:27.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.239+0000 7fec5eeaa640 1 -- 172.21.15.193:0/1833306418 learned_addr learned my addr 172.21.15.193:0/1833306418 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5f6ab640 1 -- 172.21.15.193:0/1833306418 >> v1:172.21.15.62:6789/0 conn(0x55df9bbf94f0 legacy=0x55df9bbf9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5f6ab640 1 -- 172.21.15.193:0/1833306418 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bb2cca0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/1833306418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbfaaf0 0x55df9bbfaed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec5400a420 tx=0x7fec5401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e67ef3fd97a3f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5e6a9640 1 -- 172.21.15.193:0/1833306418 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540af070 con 0x55df9bbfaaf0 2024-09-12T17:11:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5e6a9640 1 -- 172.21.15.193:0/1833306418 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540aa530 con 0x55df9bbfaaf0 2024-09-12T17:11:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec5e6a9640 1 -- 172.21.15.193:0/1833306418 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540aa850 con 0x55df9bbfaaf0 2024-09-12T17:11:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1833306418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbfaaf0 msgr2=0x55df9bbfaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1833306418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbfaaf0 0x55df9bbfaed0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fec5400a420 tx=0x7fec5401afd0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1833306418 shutdown_connections 2024-09-12T17:11:27.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1833306418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbfaaf0 0x55df9bbfaed0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1833306418 >> 172.21.15.193:0/1833306418 conn(0x55df9bc7fad0 msgr2=0x55df9bc81ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1833306418 shutdown_connections 2024-09-12T17:11:27.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.243+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1833306418 wait complete. 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df9bb8c680 con 0x55df9bbf94f0 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec5f6ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec5f6ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51894/0 (socket says 172.21.15.193:51894) 2024-09-12T17:11:27.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec5f6ab640 1 -- 172.21.15.193:0/833859953 learned_addr learned my addr 172.21.15.193:0/833859953 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec5f6ab640 1 -- 172.21.15.193:0/833859953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bb07da0 con 0x55df9bbf94f0 2024-09-12T17:11:27.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/833859953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec540ad040 tx=0x7fec54003340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a80ec3f62549d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7feb4d60a640 1 -- 172.21.15.193:0/833859953 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540af040 con 0x55df9bbf94f0 2024-09-12T17:11:27.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7feb4d60a640 1 -- 172.21.15.193:0/833859953 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540aba10 con 0x55df9bbf94f0 2024-09-12T17:11:27.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7feb4d60a640 1 -- 172.21.15.193:0/833859953 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540abcf0 con 0x55df9bbf94f0 2024-09-12T17:11:27.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- 172.21.15.193:0/833859953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 msgr2=0x55df9bd71b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/833859953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fec540ad040 tx=0x7fec54003340 comp rx=0 tx=0).stop 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- 172.21.15.193:0/833859953 shutdown_connections 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/833859953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd71b70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- 172.21.15.193:0/833859953 >> 172.21.15.193:0/833859953 conn(0x55df9bc7fad0 msgr2=0x55df9bd6d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- 172.21.15.193:0/833859953 shutdown_connections 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.259+0000 7fec61ba59c0 1 -- 172.21.15.193:0/833859953 wait complete. 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df9bb2ea50 con 0x55df9bbf94f0 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5f6ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5f6ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51904/0 (socket says 172.21.15.193:51904) 2024-09-12T17:11:27.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5f6ab640 1 -- 172.21.15.193:0/1972395722 learned_addr learned my addr 172.21.15.193:0/1972395722 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5f6ab640 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bd79570 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec54000f90 tx=0x55df9bbfa430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 -- 172.21.15.193:0/1972395722 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540af040 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9bd79800 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 -- 172.21.15.193:0/1972395722 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec540b37b0 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 -- 172.21.15.193:0/1972395722 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec540b3a90 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9bd7a1b0 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 -- 172.21.15.193:0/1972395722 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fec540b3c30 con 0x55df9bbf94f0 2024-09-12T17:11:27.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 0x7feb4403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7feb4be07640 1 -- 172.21.15.193:0/1972395722 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fec540eab30 con 0x55df9bbf94f0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 0x7feb4403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 0x55df9bd80180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.263+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bd806c0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 0x55df9bd80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 0x7feb4403bf80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec50001d80 tx=0x7fec500012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 0x55df9bd80180 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 -- 172.21.15.193:0/1972395722 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec580083f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bd80ac0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 -- 172.21.15.193:0/1972395722 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec580083f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bd823c0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 -- 172.21.15.193:0/1972395722 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec580083f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bd815f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 -- 172.21.15.193:0/1972395722 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec580083f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bd81a40 con 0x55df9bbfaaf0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5feac640 1 -- 172.21.15.193:0/1972395722 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec580083f0 con 0x55df9bbfaaf0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec61ba59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df9bb99450 con 0x55df9bd906d0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51920/0 (socket says 172.21.15.193:51920) 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 -- 172.21.15.193:0/1778087364 learned_addr learned my addr 172.21.15.193:0/1778087364 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 -- 172.21.15.193:0/1778087364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bd91130 con 0x55df9bd906d0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.267+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d660 tx=0x7fec5000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 -- 172.21.15.193:0/1778087364 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5000c6b0 con 0x55df9bd906d0 2024-09-12T17:11:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9bd91990 con 0x55df9bd906d0 2024-09-12T17:11:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 -- 172.21.15.193:0/1778087364 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5000c850 con 0x55df9bd906d0 2024-09-12T17:11:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 -- 172.21.15.193:0/1778087364 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5000cb30 con 0x55df9bd906d0 2024-09-12T17:11:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9bd91f00 con 0x55df9bd906d0 2024-09-12T17:11:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 -- 172.21.15.193:0/1778087364 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fec50023020 con 0x55df9bd906d0 2024-09-12T17:11:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 0x7feb3803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb49602640 1 -- 172.21.15.193:0/1778087364 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fec50021020 con 0x55df9bd906d0 2024-09-12T17:11:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5feac640 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 0x7feb3803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5feac640 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 0x7feb3803bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55df9bd81110 tx=0x7fec58003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec61ba59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df9bd722e0 con 0x55df9bd9e090 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51936/0 (socket says 172.21.15.193:51936) 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5eeaa640 1 -- 172.21.15.193:0/1005223734 learned_addr learned my addr 172.21.15.193:0/1005223734 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5eeaa640 1 -- 172.21.15.193:0/1005223734 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bd9ea80 con 0x55df9bd9e090 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/1005223734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec50050f10 tx=0x7fec50023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a7cdffe8ec3a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb42ffd640 1 -- 172.21.15.193:0/1005223734 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec50047070 con 0x55df9bd9e090 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb42ffd640 1 -- 172.21.15.193:0/1005223734 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec5000cd20 con 0x55df9bd9e090 2024-09-12T17:11:27.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.271+0000 7feb42ffd640 1 -- 172.21.15.193:0/1005223734 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5001bcc0 con 0x55df9bd9e090 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1005223734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 msgr2=0x55df9bd9e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1005223734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fec50050f10 tx=0x7fec50023420 comp rx=0 tx=0).stop 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1005223734 shutdown_connections 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1005223734 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bd9e490 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1005223734 >> 172.21.15.193:0/1005223734 conn(0x55df9bd994b0 msgr2=0x55df9bd976f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1005223734 shutdown_connections 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1005223734 wait complete. 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 Processor -- start 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- start start 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bda45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55df9bd9cfe0 con 0x55df9bd9e090 2024-09-12T17:11:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bda45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec5eeaa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bda45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51950/0 (socket says 172.21.15.193:51950) 2024-09-12T17:11:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 learned_addr learned my addr 172.21.15.193:0/2448879573 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9bda4b50 con 0x55df9bd9e090 2024-09-12T17:11:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bda45f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec50023850 tx=0x7fec50050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 -- 172.21.15.193:0/2448879573 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec50032030 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df9bda4de0 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 -- 172.21.15.193:0/2448879573 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec50048040 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9bda4de0 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 -- 172.21.15.193:0/2448879573 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec5003c060 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 -- 172.21.15.193:0/2448879573 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fec50035030 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb28039a20 0x7feb2803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7feb417fa640 1 -- 172.21.15.193:0/2448879573 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fec50033070 con 0x55df9bd9e090 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.275+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb28039a20 0x7feb2803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bdaf720 0x55df9bdb1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb2300 con 0x55df9bdaf720 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bdaf720 0x55df9bdb1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb28039a20 0x7feb2803bee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec5800f010 tx=0x7fec5801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bdaf720 0x55df9bdb1bb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 realm 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb2710 con 0x55df9bdaf720 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:27.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb2fe0 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb3380 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb3bd0 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:27.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 20 searching for the correct realm 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55df9bdb5940 0x55df9bdb7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55df9bdb5940 0x55df9bdb7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55df9bdb5940 0x55df9bdb7d30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5eeaa640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fec5001a590 0x7fec5001e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec5001a590 2024-09-12T17:11:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fec5001a590 0x7fec5001e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fec5001a590 0x7fec5001e8f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fec58019040 0x7fec58019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.279+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fec58019040 0x7fec58019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fec58019040 0x7fec58019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec5001a590 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.283+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec5001a590 2024-09-12T17:11:27.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec5001a590 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.287+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec5001a590 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdb5940 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x55df9bdaf720 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fec540f3040 con 0x7fec5001a590 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb45e0 con 0x55df9bdaf720 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb4e80 con 0x55df9bdaf720 2024-09-12T17:11:27.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.291+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb4e80 con 0x55df9bdaf720 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 zone default found 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 4 Realm: () 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 zonegroup default 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb8270 con 0x7fec58019040 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdba110 con 0x55df9bdb5940 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdba4b0 con 0x55df9bdb5940 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 started sync module instance, tier type = 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:27.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb9550 con 0x7fec5001a590 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418880928064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdb9d60 con 0x7fec5001a590 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbb1b0 con 0x55df9bdaf720 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.295+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418880928064] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418880932192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbb5a0 con 0x55df9bdaf720 2024-09-12T17:11:27.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbbf60 con 0x55df9bdb5940 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418880936624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbc7b0 con 0x55df9bdb5940 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbd170 con 0x7fec5001a590 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418880932192] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418880941248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbd0e0 con 0x7fec5001a590 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.299+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbdf00 con 0x55df9bdaf720 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.303+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418880936624] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.303+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418880941248] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.303+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.303+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418880938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbda10 con 0x55df9bdaf720 2024-09-12T17:11:27.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.303+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbe7d0 con 0x7fec58019040 2024-09-12T17:11:27.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.307+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418880938752] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.307+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.307+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418880943456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbe450 con 0x7fec58019040 2024-09-12T17:11:27.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.307+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbeca0 con 0x7fec58019040 2024-09-12T17:11:27.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.311+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418880943456] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.311+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.311+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418880946352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbeaa0 con 0x7fec58019040 2024-09-12T17:11:27.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.311+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbf590 con 0x7fec58019040 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418880950368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbf550 con 0x7fec58019040 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=0 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=1 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=2 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=3 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=4 2024-09-12T17:11:27.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=5 2024-09-12T17:11:27.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418880946352] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.315+0000 7fec61ba59c0 20 add_watcher() i=6 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418880950368] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 add_watcher() i=7 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbe510 con 0x55df9bdaf720 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418880947472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbff50 con 0x55df9bdaf720 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418880947472] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7feb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 5 note: GC not initialized 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7feb14fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 Filter name: none 2024-09-12T17:11:27.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fea8e7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde5bc0 con 0x55df9bdaf720 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 20 rados_obj.operate() r=0 bl.length=582 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:27.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.319+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdec120 con 0x55df9bdaf720 2024-09-12T17:11:27.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94418881133520 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde7b80 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94418880938752 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fec540d6040 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7feb42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94418880938752 notifier 4412 bl.length()=732 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7feb42ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7feb42ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7feb42ffd640 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feb24003eb0 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94418881133520 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94418881133520 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55df9bd7a1b0 con 0x55df9bdaf720 2024-09-12T17:11:27.329 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-12T17:11:26.771245Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7feb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418880947472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde39d0 con 0x55df9bdaf720 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94418880947472] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418880928064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde39d0 con 0x7fec5001a590 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.323+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94418880928064] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec61ba59c0 20 remove_watcher() i=0 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec61ba59c0 2 removed watcher, disabling cache 2024-09-12T17:11:27.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418880932192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde39d0 con 0x55df9bdaf720 2024-09-12T17:11:27.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94418880932192] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec61ba59c0 20 remove_watcher() i=1 2024-09-12T17:11:27.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.327+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418880936624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bde39d0 con 0x55df9bdb5940 2024-09-12T17:11:27.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec5eeaa640 1 -- 172.21.15.193:0/2448879573 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94418880936624] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5001b420 con 0x55df9bdb5940 2024-09-12T17:11:27.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 20 remove_watcher() i=2 2024-09-12T17:11:27.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418880941248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdba960 con 0x7fec5001a590 2024-09-12T17:11:27.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec5feac640 1 -- 172.21.15.193:0/2448879573 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94418880941248] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec5802f040 con 0x7fec5001a590 2024-09-12T17:11:27.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 20 remove_watcher() i=3 2024-09-12T17:11:27.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418880938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbbab0 con 0x55df9bdaf720 2024-09-12T17:11:27.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94418880938752] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x55df9bdaf720 2024-09-12T17:11:27.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 20 remove_watcher() i=4 2024-09-12T17:11:27.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.331+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418880943456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbccc0 con 0x7fec58019040 2024-09-12T17:11:27.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.335+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94418880943456] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.335+0000 7fec61ba59c0 20 remove_watcher() i=5 2024-09-12T17:11:27.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.335+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418880946352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbc300 con 0x7fec58019040 2024-09-12T17:11:27.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94418880946352] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 20 remove_watcher() i=6 2024-09-12T17:11:27.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418880950368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9bdbbab0 con 0x7fec58019040 2024-09-12T17:11:27.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94418880950368] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec540cd070 con 0x7fec58019040 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 20 remove_watcher() i=7 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fec58019040 msgr2=0x7fec58019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fec58019040 0x7fec58019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bdaf720 msgr2=0x55df9bdb1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bdaf720 0x55df9bdb1bb0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fec5001a590 msgr2=0x7fec5001e8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fec5001a590 0x7fec5001e8f0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55df9bdb5940 msgr2=0x55df9bdb7d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55df9bdb5940 0x55df9bdb7d30 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb28039a20 msgr2=0x7feb2803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb28039a20 0x7feb2803bee0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fec5800f010 tx=0x7fec5801b070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 msgr2=0x55df9bda45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/2448879573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd9e090 0x55df9bda45f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec50023850 tx=0x7fec50050e70 comp rx=0 tx=0).stop 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 reap_dead start 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec5f6ab640 1 -- 172.21.15.193:0/2448879573 reap_dead start 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 shutdown_connections 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 >> 172.21.15.193:0/2448879573 conn(0x55df9bd994b0 msgr2=0x55df9bd976c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 shutdown_connections 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.339+0000 7fec61ba59c0 1 -- 172.21.15.193:0/2448879573 wait complete. 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 msgr2=0x7feb3803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 0x7feb3803bf30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55df9bd81110 tx=0x7fec58003070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 msgr2=0x55df9bd90af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d660 tx=0x7fec5000da60 comp rx=0 tx=0).stop 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 shutdown_connections 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb38039a70 0x7feb3803bf30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1778087364 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bd906d0 0x55df9bd90af0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 >> 172.21.15.193:0/1778087364 conn(0x55df9bd86080 msgr2=0x55df9bd86460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 shutdown_connections 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1778087364 wait complete. 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 msgr2=0x55df9bd80180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 0x55df9bd80180 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 msgr2=0x7feb4403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 0x7feb4403bf80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec50001d80 tx=0x7fec500012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 msgr2=0x55df9bd79010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fec54000f90 tx=0x55df9bbfa430 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 shutdown_connections 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55df9bbfaaf0 0x55df9bd80180 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7feb44039ac0 0x7feb4403bf80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 --2- 172.21.15.193:0/1972395722 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55df9bbf94f0 0x55df9bd79010 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 >> 172.21.15.193:0/1972395722 conn(0x55df9bc7fad0 msgr2=0x55df9bd6c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 shutdown_connections 2024-09-12T17:11:27.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.343+0000 7fec61ba59c0 1 -- 172.21.15.193:0/1972395722 wait complete. 2024-09-12T17:11:27.356 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-12T17:11:26.771245Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:27.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T17:11:27.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-12T17:11:27.357 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-12T17:11:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e3cd09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e00ebe0730 0x55e00ebdf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e3cd09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e00eb1e9c0 con 0x55e00ebe0200 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e3cd09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e00eb6e6d0 con 0x55e00ebe0730 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e0fd5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e00ebe0730 0x55e00ebdf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e0fd5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e00ebe0730 0x55e00ebdf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51954/0 (socket says 172.21.15.193:51954) 2024-09-12T17:11:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e17d6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e00ebe0200 0x55e00ebdebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36564/0 (socket says 172.21.15.193:36564) 2024-09-12T17:11:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e0fd5640 1 -- 172.21.15.193:0/3443782174 learned_addr learned my addr 172.21.15.193:0/3443782174 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e0fd5640 1 -- 172.21.15.193:0/3443782174 >> v1:172.21.15.62:6789/0 conn(0x55e00ebe0200 legacy=0x55e00ebdebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85d3fff640 1 -- 172.21.15.193:0/3443782174 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571718689 0 0) 0x55e00eb1e9c0 con 0x55e00ebe0200 2024-09-12T17:11:27.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.427+0000 7f85e0fd5640 1 -- 172.21.15.193:0/3443782174 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00eb12ca0 con 0x55e00ebe0730 2024-09-12T17:11:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/3443782174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ebdf300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85d800a5c0 tx=0x7f85d801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6717488936dac497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85d3fff640 1 -- 172.21.15.193:0/3443782174 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80b0070 con 0x55e00ebe0730 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85d3fff640 1 -- 172.21.15.193:0/3443782174 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80ab540 con 0x55e00ebe0730 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85d3fff640 1 -- 172.21.15.193:0/3443782174 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80ab840 con 0x55e00ebe0730 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/3443782174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 msgr2=0x55e00ebdf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/3443782174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ebdf300 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f85d800a5c0 tx=0x7f85d801b280 comp rx=0 tx=0).stop 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/3443782174 shutdown_connections 2024-09-12T17:11:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/3443782174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ebdf300 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/3443782174 >> 172.21.15.193:0/3443782174 conn(0x55e00ec65a20 msgr2=0x55e00ec67e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/3443782174 shutdown_connections 2024-09-12T17:11:27.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.431+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/3443782174 wait complete. 2024-09-12T17:11:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e3cd09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e3cd09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb72680 con 0x55e00ebe0200 2024-09-12T17:11:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e17d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e17d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51958/0 (socket says 172.21.15.193:51958) 2024-09-12T17:11:27.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.443+0000 7f85e17d6640 1 -- 172.21.15.193:0/1906892496 learned_addr learned my addr 172.21.15.193:0/1906892496 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 -- 172.21.15.193:0/1906892496 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00eaedda0 con 0x55e00ebe0200 2024-09-12T17:11:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 --2- 172.21.15.193:0/1906892496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85d4001eb0 tx=0x7f85d400b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77fc802ce4cd7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f84cf606640 1 -- 172.21.15.193:0/1906892496 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d400d640 con 0x55e00ebe0200 2024-09-12T17:11:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f84cf606640 1 -- 172.21.15.193:0/1906892496 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d4008070 con 0x55e00ebe0200 2024-09-12T17:11:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f84cf606640 1 -- 172.21.15.193:0/1906892496 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d400d970 con 0x55e00ebe0200 2024-09-12T17:11:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1906892496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 msgr2=0x55e00ed579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/1906892496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f85d4001eb0 tx=0x7f85d400b6b0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1906892496 shutdown_connections 2024-09-12T17:11:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/1906892496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0200 0x55e00ed579c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1906892496 >> 172.21.15.193:0/1906892496 conn(0x55e00ec65a20 msgr2=0x55e00ed53610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1906892496 shutdown_connections 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1906892496 wait complete. 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e3cd09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb14a50 con 0x55e00ebe0730 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51962/0 (socket says 172.21.15.193:51962) 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 -- 172.21.15.193:0/2262040088 learned_addr learned my addr 172.21.15.193:0/2262040088 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00ed5f8c0 con 0x55e00ebe0730 2024-09-12T17:11:27.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.447+0000 7f85e17d6640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000f70 tx=0x7f85d4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 -- 172.21.15.193:0/2262040088 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d401a690 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 -- 172.21.15.193:0/2262040088 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d401a830 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e00ed5fb50 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 -- 172.21.15.193:0/2262040088 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d401ab50 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00ed60500 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 -- 172.21.15.193:0/2262040088 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85d4017070 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 0x7f84c803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f84cde03640 1 -- 172.21.15.193:0/2262040088 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f85d4015020 con 0x55e00ebe0730 2024-09-12T17:11:27.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 0x7f84c803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 0x55e00ed668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed66df0 con 0x55e00ed644c0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 0x55e00ed668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 0x7f84c803bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ad000 tx=0x7f85d80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 0x55e00ed668b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2262040088 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85dc00a4d0 con 0x55e00ed644c0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed671f0 con 0x55e00ed644c0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2262040088 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85dc00a4d0 con 0x55e00ed644c0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed68af0 con 0x55e00ed644c0 2024-09-12T17:11:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2262040088 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85dc00a4d0 con 0x55e00ed644c0 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed67d20 con 0x55e00ed644c0 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2262040088 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85dc00a4d0 con 0x55e00ed644c0 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.451+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed68140 con 0x55e00ed644c0 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2262040088 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85dc00a4d0 con 0x55e00ed644c0 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb7f450 con 0x55e00ed76e50 2024-09-12T17:11:27.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51970/0 (socket says 172.21.15.193:51970) 2024-09-12T17:11:27.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2230055 learned_addr learned my addr 172.21.15.193:0/2230055 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2230055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00ed778b0 con 0x55e00ed76e50 2024-09-12T17:11:27.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f85d8018eb0 tx=0x7f85d8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 -- 172.21.15.193:0/2230055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80b0040 con 0x55e00ed76e50 2024-09-12T17:11:27.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e00ed78110 con 0x55e00ed76e50 2024-09-12T17:11:27.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00ed78620 con 0x55e00ed76e50 2024-09-12T17:11:27.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 -- 172.21.15.193:0/2230055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80c6070 con 0x55e00ed76e50 2024-09-12T17:11:27.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 -- 172.21.15.193:0/2230055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80b6d50 con 0x55e00ed76e50 2024-09-12T17:11:27.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 -- 172.21.15.193:0/2230055 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85d80cb460 con 0x55e00ed76e50 2024-09-12T17:11:27.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 0x7f84b803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f84c6ffd640 1 -- 172.21.15.193:0/2230055 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f85d80a8070 con 0x55e00ed76e50 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.455+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 0x7f84b803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 0x7f84b803bf20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55e00ed680c0 tx=0x7f85dc005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e00ed58210 con 0x55e00ed84680 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51972/0 (socket says 172.21.15.193:51972) 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 -- 172.21.15.193:0/1821738589 learned_addr learned my addr 172.21.15.193:0/1821738589 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 -- 172.21.15.193:0/1821738589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00ed85070 con 0x55e00ed84680 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/1821738589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85d80eb620 tx=0x7f85d80ed110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fec037d8003a3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f84c4ff9640 1 -- 172.21.15.193:0/1821738589 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80aae50 con 0x55e00ed84680 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f84c4ff9640 1 -- 172.21.15.193:0/1821738589 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80cbc70 con 0x55e00ed84680 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f84c4ff9640 1 -- 172.21.15.193:0/1821738589 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80b53d0 con 0x55e00ed84680 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1821738589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 msgr2=0x55e00ed84a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/1821738589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f85d80eb620 tx=0x7f85d80ed110 comp rx=0 tx=0).stop 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1821738589 shutdown_connections 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/1821738589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed84a80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1821738589 >> 172.21.15.193:0/1821738589 conn(0x55e00ed7faa0 msgr2=0x55e00ed7dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1821738589 shutdown_connections 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/1821738589 wait complete. 2024-09-12T17:11:27.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 Processor -- start 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- start start 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e3cd09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e00ed835d0 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:51982/0 (socket says 172.21.15.193:51982) 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 learned_addr learned my addr 172.21.15.193:0/2067679474 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00ed8b170 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.459+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ed200 tx=0x7f85d80eb5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 -- 172.21.15.193:0/2067679474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80aae50 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e00ed8b400 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 -- 172.21.15.193:0/2067679474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80eb9b0 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00ed8bdb0 con 0x55e00ed84680 2024-09-12T17:11:27.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 -- 172.21.15.193:0/2067679474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d80ebc90 con 0x55e00ed84680 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 -- 172.21.15.193:0/2067679474 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85d80f5060 con 0x55e00ed84680 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039c10 0x7f84ac03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f84b6ffd640 1 -- 172.21.15.193:0/2067679474 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f85d80d7070 con 0x55e00ed84680 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039c10 0x7f84ac03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed95ef0 0x55e00ed98380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed98ad0 con 0x55e00ed95ef0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed95ef0 0x55e00ed98380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed95ef0 0x55e00ed98380 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039c10 0x7f84ac03c0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e00ed67840 tx=0x7f85dc01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 realm 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed98ee0 con 0x55e00ed95ef0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed997b0 con 0x55e00ed95ef0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed99b50 con 0x55e00ed95ef0 2024-09-12T17:11:27.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9a3a0 con 0x55e00ed95ef0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 20 searching for the correct realm 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e00ed9c110 0x55e00ed9e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.463+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e00ed9c110 0x55e00ed9e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e00ed9c110 0x55e00ed9e500 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e0fd5640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85d80ee020 0x7f85d80f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85d80ee020 0x7f85d80f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85d80ee020 0x7f85d80f8a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e1fd7640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85dc031040 0x7f85dc032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85dc031040 0x7f85dc032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85dc031040 0x7f85dc032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x7f85dc031040 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x7f85dc031040 2024-09-12T17:11:27.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.467+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x7f85dc031040 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x7f85dc031040 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x7f85dc031040 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d402e070 con 0x55e00ed95ef0 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.471+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed9c110 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.475+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85dc031040 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x55e00ed95ef0 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ea40 con 0x7f85d80ee020 2024-09-12T17:11:27.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85dc01f070 con 0x7f85d80ee020 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9acf0 con 0x55e00ed95ef0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9b590 con 0x55e00ed95ef0 2024-09-12T17:11:27.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ede0 con 0x55e00ed95ef0 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 zone default found 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 4 Realm: () 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 zonegroup default 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9ee40 con 0x7f85dc031040 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda0c70 con 0x55e00ed9c110 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda10b0 con 0x55e00ed9c110 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 started sync module instance, tier type = 2024-09-12T17:11:27.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda0110 con 0x7f85d80ee020 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.479+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420810204464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00ed9fd70 con 0x7f85d80ee020 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda1fe0 con 0x55e00ed95ef0 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94420810204464] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94420810208528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda1fe0 con 0x55e00ed95ef0 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda29f0 con 0x55e00ed9c110 2024-09-12T17:11:27.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.483+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94420810208528] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.487+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.487+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94420810210096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda1f50 con 0x55e00ed9c110 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.487+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda3730 con 0x7f85d80ee020 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.491+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.491+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94420810216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda3fd0 con 0x7f85d80ee020 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.491+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda4a10 con 0x55e00ed95ef0 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.491+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94420810216000] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.491+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94420810210096] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94420810220768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda3b20 con 0x55e00ed95ef0 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda52b0 con 0x7f85dc031040 2024-09-12T17:11:27.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94420810220768] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420810214800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda3b20 con 0x7f85dc031040 2024-09-12T17:11:27.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.495+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda5740 con 0x7f85dc031040 2024-09-12T17:11:27.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.499+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.499+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94420810214800] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.499+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420810224176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda5bb0 con 0x7f85dc031040 2024-09-12T17:11:27.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.499+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda4c70 con 0x7f85dc031040 2024-09-12T17:11:27.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.499+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94420810224176] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94420810225408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda5b20 con 0x7f85dc031040 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=0 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=1 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=2 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=3 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=4 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=5 2024-09-12T17:11:27.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=6 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94420810225408] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 add_watcher() i=7 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda9600 con 0x55e00ed95ef0 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94420810228000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda6a60 con 0x55e00ed95ef0 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94420810228000] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f8497fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.503+0000 7f85e3cd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 5 note: GC not initialized 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f8496fe5640 20 reqs_thread_entry: start 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 20 Filter name: none 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f8494fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:27.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00edcc760 con 0x55e00ed95ef0 2024-09-12T17:11:27.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 20 rados_obj.operate() r=0 bl.length=556 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00edd2de0 con 0x55e00ed95ef0 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:27.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94420810410192 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00edce5d0 con 0x55e00ed95ef0 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94420810220768 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e00ed60500 con 0x55e00ed95ef0 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f84c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94420810220768 notifier 4419 bl.length()=567 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f84c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f84c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94420810410192 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f84c4ff9640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f84a4003eb0 con 0x55e00ed95ef0 2024-09-12T17:11:27.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94420810410192 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e00ed5fb50 con 0x55e00ed95ef0 2024-09-12T17:11:27.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.507+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00edd28d0 con 0x7f85d80ee020 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e3cd09c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94420810410192 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e00edce5d0 con 0x7f85d80ee020 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== watch-notify(notify (1) cookie 94420810204464 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f85dc0247b0 con 0x7f85d80ee020 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f84b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94420810204464 notifier 4419 bl.length()=159 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f84b7fff640 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f84080032d0 con 0x7f85d80ee020 2024-09-12T17:11:27.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(67 notify.0 [notify cookie 94420810410192 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== watch-notify(notify_complete (2) cookie 94420810410192 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f85dc024980 con 0x7f85d80ee020 2024-09-12T17:11:27.516 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:27.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f8497fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94420810228000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00edce5d0 con 0x55e00ed95ef0 2024-09-12T17:11:27.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94420810228000] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.511+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94420810204464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00edce5a0 con 0x7f85d80ee020 2024-09-12T17:11:27.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94420810204464] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e3cd09c0 20 remove_watcher() i=0 2024-09-12T17:11:27.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e3cd09c0 2 removed watcher, disabling cache 2024-09-12T17:11:27.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94420810208528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00edce5a0 con 0x55e00ed95ef0 2024-09-12T17:11:27.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94420810208528] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e3cd09c0 20 remove_watcher() i=1 2024-09-12T17:11:27.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.515+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94420810210096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda6120 con 0x55e00ed9c110 2024-09-12T17:11:27.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e0fd5640 1 -- 172.21.15.193:0/2067679474 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94420810210096] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d80b3040 con 0x55e00ed9c110 2024-09-12T17:11:27.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 20 remove_watcher() i=2 2024-09-12T17:11:27.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94420810216000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda0530 con 0x7f85d80ee020 2024-09-12T17:11:27.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e1fd7640 1 -- 172.21.15.193:0/2067679474 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94420810216000] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85dc040040 con 0x7f85d80ee020 2024-09-12T17:11:27.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 20 remove_watcher() i=3 2024-09-12T17:11:27.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94420810220768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda1b30 con 0x55e00ed95ef0 2024-09-12T17:11:27.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94420810220768] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x55e00ed95ef0 2024-09-12T17:11:27.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 20 remove_watcher() i=4 2024-09-12T17:11:27.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.519+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94420810214800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda0530 con 0x7f85dc031040 2024-09-12T17:11:27.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94420810214800] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e3cd09c0 20 remove_watcher() i=5 2024-09-12T17:11:27.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94420810224176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda44e0 con 0x7f85dc031040 2024-09-12T17:11:27.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94420810224176] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e3cd09c0 20 remove_watcher() i=6 2024-09-12T17:11:27.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.523+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94420810225408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e00eda1b30 con 0x7f85dc031040 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94420810225408] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d4058060 con 0x7f85dc031040 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 20 remove_watcher() i=7 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85dc031040 msgr2=0x7f85dc032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85dc031040 0x7f85dc032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed95ef0 msgr2=0x55e00ed98380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed95ef0 0x55e00ed98380 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85d80ee020 msgr2=0x7f85d80f8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85d80ee020 0x7f85d80f8a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e00ed9c110 msgr2=0x55e00ed9e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e00ed9c110 0x55e00ed9e500 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039c10 msgr2=0x7f84ac03c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039c10 0x7f84ac03c0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e00ed67840 tx=0x7f85dc01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 msgr2=0x55e00ed8ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ed200 tx=0x7f85d80eb5b0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e17d6640 1 -- 172.21.15.193:0/2067679474 reap_dead start 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 shutdown_connections 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2067679474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed84680 0x55e00ed8ac10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 >> 172.21.15.193:0/2067679474 conn(0x55e00ed7faa0 msgr2=0x55e00ed7dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 shutdown_connections 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2067679474 wait complete. 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 msgr2=0x7f84b803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 0x7f84b803bf20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55e00ed680c0 tx=0x7f85dc005850 comp rx=0 tx=0).stop 2024-09-12T17:11:27.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 msgr2=0x55e00ed77270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f85d8018eb0 tx=0x7f85d8018020 comp rx=0 tx=0).stop 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 shutdown_connections 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84b8039a60 0x7f84b803bf20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2230055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ed76e50 0x55e00ed77270 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 >> 172.21.15.193:0/2230055 conn(0x55e00ed6c800 msgr2=0x55e00ed6cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 shutdown_connections 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2230055 wait complete. 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 msgr2=0x55e00ed668b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 0x55e00ed668b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 msgr2=0x7f84c803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 0x7f84c803bf80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ad000 tx=0x7f85d80a5040 comp rx=0 tx=0).stop 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 msgr2=0x55e00ed5f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f85d4000f70 tx=0x7f85d4000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 shutdown_connections 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e00ed644c0 0x55e00ed668b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84c8039ac0 0x7f84c803bf80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 --2- 172.21.15.193:0/2262040088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e00ebe0730 0x55e00ed5f360 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 >> 172.21.15.193:0/2262040088 conn(0x55e00ec65a20 msgr2=0x55e00ed58ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 shutdown_connections 2024-09-12T17:11:27.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.527+0000 7f85e3cd09c0 1 -- 172.21.15.193:0/2262040088 wait complete. 2024-09-12T17:11:27.541 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:27.542 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:11:27.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:11:27.542 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T17:11:27.612 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.612 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd376c049c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561d5c6b2a20 0x561d5c740c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd376c049c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d5c5f29c0 con 0x561d5c7411c0 2024-09-12T17:11:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd376c049c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561d5c6426d0 con 0x561d5c6b2a20 2024-09-12T17:11:27.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd373f09640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x561d5c7411c0 0x561d5c7435b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36576/0 (socket says 172.21.15.193:36576) 2024-09-12T17:11:27.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.607+0000 7fd37470a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561d5c6b2a20 0x561d5c740c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd373f09640 1 -- 172.21.15.193:0/3061955186 learned_addr learned my addr 172.21.15.193:0/3061955186 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:27.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd37470a640 1 -- 172.21.15.193:0/3061955186 >> v1:172.21.15.62:6789/0 conn(0x561d5c7411c0 legacy=0x561d5c7435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd37470a640 1 -- 172.21.15.193:0/3061955186 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c5e6ca0 con 0x561d5c6b2a20 2024-09-12T17:11:27.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd37470a640 1 --2- 172.21.15.193:0/3061955186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c740c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00a480 tx=0x7fd35c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aa44cafc8768 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd373708640 1 -- 172.21.15.193:0/3061955186 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0af070 con 0x561d5c6b2a20 2024-09-12T17:11:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd373708640 1 -- 172.21.15.193:0/3061955186 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0aa530 con 0x561d5c6b2a20 2024-09-12T17:11:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd373708640 1 -- 172.21.15.193:0/3061955186 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0aa830 con 0x561d5c6b2a20 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 -- 172.21.15.193:0/3061955186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 msgr2=0x561d5c740c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3061955186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c740c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00a480 tx=0x7fd35c01b280 comp rx=0 tx=0).stop 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 -- 172.21.15.193:0/3061955186 shutdown_connections 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3061955186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c740c80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 -- 172.21.15.193:0/3061955186 >> 172.21.15.193:0/3061955186 conn(0x561d5c738970 msgr2=0x561d5c73ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 -- 172.21.15.193:0/3061955186 shutdown_connections 2024-09-12T17:11:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.611+0000 7fd376c049c0 1 -- 172.21.15.193:0/3061955186 wait complete. 2024-09-12T17:11:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d5c646680 con 0x561d5c6b2a20 2024-09-12T17:11:27.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd37470a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd37470a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52004/0 (socket says 172.21.15.193:52004) 2024-09-12T17:11:27.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd37470a640 1 -- 172.21.15.193:0/1283050462 learned_addr learned my addr 172.21.15.193:0/1283050462 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd37470a640 1 -- 172.21.15.193:0/1283050462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c5c1da0 con 0x561d5c6b2a20 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd37470a640 1 --2- 172.21.15.193:0/1283050462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0aa500 tx=0x7fd35c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad82ab380565e55b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd26260c640 1 -- 172.21.15.193:0/1283050462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0af070 con 0x561d5c6b2a20 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd26260c640 1 -- 172.21.15.193:0/1283050462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0bb070 con 0x561d5c6b2a20 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd26260c640 1 -- 172.21.15.193:0/1283050462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0aa850 con 0x561d5c6b2a20 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- 172.21.15.193:0/1283050462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 msgr2=0x561d5c73e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1283050462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd35c0aa500 tx=0x7fd35c003030 comp rx=0 tx=0).stop 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- 172.21.15.193:0/1283050462 shutdown_connections 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1283050462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c73e160 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- 172.21.15.193:0/1283050462 >> 172.21.15.193:0/1283050462 conn(0x561d5c738970 msgr2=0x561d5c825480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- 172.21.15.193:0/1283050462 shutdown_connections 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- 172.21.15.193:0/1283050462 wait complete. 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.627+0000 7fd376c049c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d5c5e8a50 con 0x561d5c6b2a20 2024-09-12T17:11:27.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd37470a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd37470a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52020/0 (socket says 172.21.15.193:52020) 2024-09-12T17:11:27.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd37470a640 1 -- 172.21.15.193:0/3098301330 learned_addr learned my addr 172.21.15.193:0/3098301330 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd37470a640 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c833480 con 0x561d5c6b2a20 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd37470a640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd35c019930 tx=0x7fd35c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 -- 172.21.15.193:0/3098301330 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0b6690 con 0x561d5c6b2a20 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d5c833710 con 0x561d5c6b2a20 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 -- 172.21.15.193:0/3098301330 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0c3070 con 0x561d5c6b2a20 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5c8340c0 con 0x561d5c6b2a20 2024-09-12T17:11:27.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 -- 172.21.15.193:0/3098301330 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd35c0b6960 con 0x561d5c6b2a20 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 -- 172.21.15.193:0/3098301330 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd35c0ce060 con 0x561d5c6b2a20 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 0x7fd25c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd260e09640 1 -- 172.21.15.193:0/3098301330 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd35c0eb1c0 con 0x561d5c6b2a20 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd373f09640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 0x7fd25c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 0x561d5c83a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c83a5d0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd374f0b640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 0x561d5c83a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd373f09640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 0x7fd25c03bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd36c001650 tx=0x7fd36c006720 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd374f0b640 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 0x561d5c83a090 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd374f0b640 1 -- 172.21.15.193:0/3098301330 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3640083f0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.631+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c83a9d0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd374f0b640 1 -- 172.21.15.193:0/3098301330 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3640083f0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c83c2d0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd374f0b640 1 -- 172.21.15.193:0/3098301330 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3640083f0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c83b500 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd374f0b640 1 -- 172.21.15.193:0/3098301330 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3640083f0 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c83b920 con 0x561d5c7411c0 2024-09-12T17:11:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd374f0b640 1 -- 172.21.15.193:0/3098301330 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3640083f0 con 0x561d5c7411c0 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d5c653450 con 0x561d5c84a630 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52034/0 (socket says 172.21.15.193:52034) 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd373f09640 1 -- 172.21.15.193:0/1384452874 learned_addr learned my addr 172.21.15.193:0/1384452874 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd373f09640 1 -- 172.21.15.193:0/1384452874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c84b090 con 0x561d5c84a630 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd373f09640 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd36c006960 tx=0x7fd36c015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd259ffb640 1 -- 172.21.15.193:0/1384452874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c015240 con 0x561d5c84a630 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d5c84b8f0 con 0x561d5c84a630 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5c84be60 con 0x561d5c84a630 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd259ffb640 1 -- 172.21.15.193:0/1384452874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c011440 con 0x561d5c84a630 2024-09-12T17:11:27.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.635+0000 7fd259ffb640 1 -- 172.21.15.193:0/1384452874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c011720 con 0x561d5c84a630 2024-09-12T17:11:27.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd259ffb640 1 -- 172.21.15.193:0/1384452874 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd36c0118c0 con 0x561d5c84a630 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd259ffb640 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 0x7fd24c03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd259ffb640 1 -- 172.21.15.193:0/1384452874 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd36c01b030 con 0x561d5c84a630 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 0x7fd24c03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 0x7fd24c03bf20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561d5c83b8a0 tx=0x7fd364003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d5c73e8f0 con 0x561d5c857fa0 2024-09-12T17:11:27.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52048/0 (socket says 172.21.15.193:52048) 2024-09-12T17:11:27.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd373f09640 1 -- 172.21.15.193:0/1263858357 learned_addr learned my addr 172.21.15.193:0/1263858357 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd373f09640 1 -- 172.21.15.193:0/1263858357 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c858990 con 0x561d5c857fa0 2024-09-12T17:11:27.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd373f09640 1 --2- 172.21.15.193:0/1263858357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd36c050180 tx=0x7fd36c050350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762422b8a4383442 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd2537fe640 1 -- 172.21.15.193:0/1263858357 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c013950 con 0x561d5c857fa0 2024-09-12T17:11:27.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd2537fe640 1 -- 172.21.15.193:0/1263858357 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c04d020 con 0x561d5c857fa0 2024-09-12T17:11:27.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd2537fe640 1 -- 172.21.15.193:0/1263858357 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c013430 con 0x561d5c857fa0 2024-09-12T17:11:27.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- 172.21.15.193:0/1263858357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 msgr2=0x561d5c8583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1263858357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd36c050180 tx=0x7fd36c050350 comp rx=0 tx=0).stop 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- 172.21.15.193:0/1263858357 shutdown_connections 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1263858357 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c8583a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- 172.21.15.193:0/1263858357 >> 172.21.15.193:0/1263858357 conn(0x561d5c8533c0 msgr2=0x561d5c851600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- 172.21.15.193:0/1263858357 shutdown_connections 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- 172.21.15.193:0/1263858357 wait complete. 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 Processor -- start 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- start start 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.639+0000 7fd376c049c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561d5c856ef0 con 0x561d5c857fa0 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd373f09640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52054/0 (socket says 172.21.15.193:52054) 2024-09-12T17:11:27.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 learned_addr learned my addr 172.21.15.193:0/1108613525 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d5c85e9f0 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd373f09640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd36c028500 tx=0x7fd36c0500e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 -- 172.21.15.193:0/1108613525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c038070 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d5c85ec80 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 -- 172.21.15.193:0/1108613525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd36c01d780 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d5c85ec80 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 -- 172.21.15.193:0/1108613525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd36c01daa0 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 -- 172.21.15.193:0/1108613525 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd36c03b070 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd244039a70 0x7fd24403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd251ffb640 1 -- 172.21.15.193:0/1108613525 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd36c04e030 con 0x561d5c857fa0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd244039a70 0x7fd24403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c8695d0 0x561d5c86ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86c1b0 con 0x561d5c8695d0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd37470a640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c8695d0 0x561d5c86ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd37470a640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c8695d0 0x561d5c86ba60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd244039a70 0x7fd24403bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd36400f010 tx=0x7fd36401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 realm 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86c5c0 con 0x561d5c8695d0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:27.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.643+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86ce90 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86d230 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86d6d0 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 20 searching for the correct realm 2024-09-12T17:11:27.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561d5c86f640 0x561d5c871a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd373f09640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561d5c86f640 0x561d5c871a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd373f09640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561d5c86f640 0x561d5c871a30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c03a030 con 0x561d5c86f640 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd373f09640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd36c03d060 0x7fd36c033450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd36c03d060 0x7fd36c033450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd36c03d060 0x7fd36c033450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd374f0b640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd364019040 0x7fd364019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd364019040 0x7fd364019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd364019040 0x7fd364019930 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0d9040 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.647+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd35c0d9040 con 0x561d5c8695d0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.651+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.655+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c86f640 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd364019040 2024-09-12T17:11:27.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x561d5c8695d0 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561d5c872060 con 0x7fd36c03d060 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:27.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86e0e0 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86e980 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c86dd20 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 zone default found 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 4 Realm: () 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 zonegroup default 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8724e0 con 0x7fd364019040 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c874380 con 0x561d5c86f640 2024-09-12T17:11:27.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.659+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c874720 con 0x561d5c86f640 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 20 started sync module instance, tier type = 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8737c0 con 0x7fd36c03d060 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94684106406880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c874f70 con 0x7fd36c03d060 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8757c0 con 0x561d5c8695d0 2024-09-12T17:11:27.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94684106406880] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94684106410688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c875390 con 0x561d5c8695d0 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.663+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c875e90 con 0x561d5c86f640 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94684106414464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c876730 con 0x561d5c86f640 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8770f0 con 0x7fd36c03d060 2024-09-12T17:11:27.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94684106410688] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94684106419264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c877060 con 0x7fd36c03d060 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c877e40 con 0x561d5c8695d0 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94684106414464] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.667+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94684106419264] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94684106416768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c877990 con 0x561d5c8695d0 2024-09-12T17:11:27.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8786e0 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94684106416768] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94684106421472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8783d0 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.671+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c878c20 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94684106421472] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94684106424368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c878a20 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c879510 con 0x7fd364019040 2024-09-12T17:11:27.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94684106424368] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94684106428384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8794d0 con 0x7fd364019040 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=0 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=1 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=2 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=3 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=4 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=5 2024-09-12T17:11:27.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.675+0000 7fd376c049c0 20 add_watcher() i=6 2024-09-12T17:11:27.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94684106428384] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 add_watcher() i=7 2024-09-12T17:11:27.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:27.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c87c930 con 0x561d5c8695d0 2024-09-12T17:11:27.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94684106425488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c879e50 con 0x561d5c8695d0 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94684106425488] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd22a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 5 note: GC not initialized 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd2297e2640 20 reqs_thread_entry: start 2024-09-12T17:11:27.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 Filter name: none 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd19affd640 20 reqs_thread_entry: start 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c89f730 con 0x561d5c8695d0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.679+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8a0120 con 0x561d5c8695d0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8a1130 con 0x7fd36c03d060 2024-09-12T17:11:27.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd22a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94684106425488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c863b90 con 0x561d5c8695d0 2024-09-12T17:11:27.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94684106425488] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94684106406880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c878490 con 0x7fd36c03d060 2024-09-12T17:11:27.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94684106406880] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 20 remove_watcher() i=0 2024-09-12T17:11:27.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 2 removed watcher, disabling cache 2024-09-12T17:11:27.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.683+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94684106410688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c873be0 con 0x561d5c8695d0 2024-09-12T17:11:27.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94684106410688] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd376c049c0 20 remove_watcher() i=1 2024-09-12T17:11:27.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94684106414464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c874ac0 con 0x561d5c86f640 2024-09-12T17:11:27.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd373f09640 1 -- 172.21.15.193:0/1108613525 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94684106414464] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36c060040 con 0x561d5c86f640 2024-09-12T17:11:27.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd376c049c0 20 remove_watcher() i=2 2024-09-12T17:11:27.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.687+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94684106419264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c873be0 con 0x7fd36c03d060 2024-09-12T17:11:27.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd374f0b640 1 -- 172.21.15.193:0/1108613525 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94684106419264] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd36402f040 con 0x7fd36c03d060 2024-09-12T17:11:27.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd376c049c0 20 remove_watcher() i=3 2024-09-12T17:11:27.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94684106416768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c876c40 con 0x561d5c8695d0 2024-09-12T17:11:27.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94684106416768] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x561d5c8695d0 2024-09-12T17:11:27.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd376c049c0 20 remove_watcher() i=4 2024-09-12T17:11:27.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.691+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94684106421472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c876c40 con 0x7fd364019040 2024-09-12T17:11:27.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94684106421472] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd376c049c0 20 remove_watcher() i=5 2024-09-12T17:11:27.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94684106424368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8774e0 con 0x7fd364019040 2024-09-12T17:11:27.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94684106424368] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd376c049c0 20 remove_watcher() i=6 2024-09-12T17:11:27.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.695+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94684106428384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561d5c8774e0 con 0x7fd364019040 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94684106428384] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd35c0e7040 con 0x7fd364019040 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 20 remove_watcher() i=7 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd364019040 msgr2=0x7fd364019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd364019040 0x7fd364019930 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c8695d0 msgr2=0x561d5c86ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c8695d0 0x561d5c86ba60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd36c03d060 msgr2=0x7fd36c033450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd36c03d060 0x7fd36c033450 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561d5c86f640 msgr2=0x561d5c871a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561d5c86f640 0x561d5c871a30 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd244039a70 msgr2=0x7fd24403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd244039a70 0x7fd24403bf30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd36400f010 tx=0x7fd36401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 msgr2=0x561d5c85e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd37470a640 1 -- 172.21.15.193:0/1108613525 reap_dead start 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd36c028500 tx=0x7fd36c0500e0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 shutdown_connections 2024-09-12T17:11:27.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1108613525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c857fa0 0x561d5c85e490 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 >> 172.21.15.193:0/1108613525 conn(0x561d5c8533c0 msgr2=0x561d5c8515d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 shutdown_connections 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1108613525 wait complete. 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 msgr2=0x7fd24c03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 0x7fd24c03bf20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x561d5c83b8a0 tx=0x7fd364003070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 msgr2=0x561d5c84aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd36c006960 tx=0x7fd36c015820 comp rx=0 tx=0).stop 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 shutdown_connections 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd24c039a60 0x7fd24c03bf20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/1384452874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c84a630 0x561d5c84aa50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 >> 172.21.15.193:0/1384452874 conn(0x561d5c83ffe0 msgr2=0x561d5c8403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 shutdown_connections 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/1384452874 wait complete. 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 msgr2=0x561d5c83a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 0x561d5c83a090 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 msgr2=0x7fd25c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 0x7fd25c03bf30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd36c001650 tx=0x7fd36c006720 comp rx=0 tx=0).stop 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 msgr2=0x561d5c832f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd35c019930 tx=0x7fd35c018020 comp rx=0 tx=0).stop 2024-09-12T17:11:27.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 shutdown_connections 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561d5c7411c0 0x561d5c83a090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd25c039a70 0x7fd25c03bf30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 --2- 172.21.15.193:0/3098301330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561d5c6b2a20 0x561d5c832f20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 >> 172.21.15.193:0/3098301330 conn(0x561d5c738970 msgr2=0x561d5c73cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 shutdown_connections 2024-09-12T17:11:27.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.699+0000 7fd376c049c0 1 -- 172.21.15.193:0/3098301330 wait complete. 2024-09-12T17:11:27.712 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-09-12T17:11:27.713 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:11:27.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T17:11:27.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T17:11:27.713 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T17:11:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.788 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd5a429c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a2b340c5e0 0x55a2b34a0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd5a429c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a2b334c9c0 con 0x55a2b340c200 2024-09-12T17:11:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd5a429c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55a2b339c6d0 con 0x55a2b340c5e0 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd3548640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55a2b340c200 0x55a2b349d030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36582/0 (socket says 172.21.15.193:36582) 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd3548640 1 -- 172.21.15.193:0/3955762954 learned_addr learned my addr 172.21.15.193:0/3955762954 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.783+0000 7fedd2d47640 1 --2- 172.21.15.193:0/3955762954 >> v2:172.21.15.62:3300/0 conn(0x55a2b340c5e0 0x55a2b34a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2546640 1 -- 172.21.15.193:0/3955762954 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428666611 0 0) 0x55a2b334c9c0 con 0x55a2b340c200 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2546640 1 -- 172.21.15.193:0/3955762954 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedbc001e20 con 0x55a2b340c200 2024-09-12T17:11:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2d47640 1 -- 172.21.15.193:0/3955762954 >> v1:172.21.15.62:6789/0 conn(0x55a2b340c200 legacy=0x55a2b349d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2d47640 1 -- 172.21.15.193:0/3955762954 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b3340ca0 con 0x55a2b340c5e0 2024-09-12T17:11:27.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2d47640 1 --2- 172.21.15.193:0/3955762954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c5e0 0x55a2b34a0760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a480 tx=0x7fedc801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61160580d5300479 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2546640 1 -- 172.21.15.193:0/3955762954 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80b0070 con 0x55a2b340c5e0 2024-09-12T17:11:27.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2546640 1 -- 172.21.15.193:0/3955762954 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc80ab540 con 0x55a2b340c5e0 2024-09-12T17:11:27.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd2546640 1 -- 172.21.15.193:0/3955762954 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80ab820 con 0x55a2b340c5e0 2024-09-12T17:11:27.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3955762954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c5e0 msgr2=0x55a2b34a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3955762954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c5e0 0x55a2b34a0760 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedc800a480 tx=0x7fedc801b280 comp rx=0 tx=0).stop 2024-09-12T17:11:27.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3955762954 shutdown_connections 2024-09-12T17:11:27.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3955762954 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c5e0 0x55a2b34a0760 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3955762954 >> 172.21.15.193:0/3955762954 conn(0x55a2b3492920 msgr2=0x55a2b3494d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3955762954 shutdown_connections 2024-09-12T17:11:27.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.787+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3955762954 wait complete. 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2b33a0680 con 0x55a2b340c200 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd3548640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd3548640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52058/0 (socket says 172.21.15.193:52058) 2024-09-12T17:11:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd3548640 1 -- 172.21.15.193:0/252394696 learned_addr learned my addr 172.21.15.193:0/252394696 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd3548640 1 -- 172.21.15.193:0/252394696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b331bda0 con 0x55a2b340c200 2024-09-12T17:11:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd3548640 1 --2- 172.21.15.193:0/252394696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedc40016a0 tx=0x7fedc4001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c92e254cc6e766 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fecc160a640 1 -- 172.21.15.193:0/252394696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4004530 con 0x55a2b340c200 2024-09-12T17:11:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fecc160a640 1 -- 172.21.15.193:0/252394696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40046d0 con 0x55a2b340c200 2024-09-12T17:11:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fecc160a640 1 -- 172.21.15.193:0/252394696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc40049f0 con 0x55a2b340c200 2024-09-12T17:11:27.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- 172.21.15.193:0/252394696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 msgr2=0x55a2b3585740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/252394696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fedc40016a0 tx=0x7fedc4001b60 comp rx=0 tx=0).stop 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- 172.21.15.193:0/252394696 shutdown_connections 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/252394696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b3585740 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- 172.21.15.193:0/252394696 >> 172.21.15.193:0/252394696 conn(0x55a2b3492920 msgr2=0x55a2b3581380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- 172.21.15.193:0/252394696 shutdown_connections 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- 172.21.15.193:0/252394696 wait complete. 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.803+0000 7fedd5a429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3342a50 con 0x55a2b340c200 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3548640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3548640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52074/0 (socket says 172.21.15.193:52074) 2024-09-12T17:11:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3548640 1 -- 172.21.15.193:0/1565087915 learned_addr learned my addr 172.21.15.193:0/1565087915 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3548640 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b358d2f0 con 0x55a2b340c200 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3548640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55a2b35866d0 tx=0x7fedc4004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 -- 172.21.15.193:0/1565087915 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4013820 con 0x55a2b340c200 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b358d580 con 0x55a2b340c200 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b358df30 con 0x55a2b340c200 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 -- 172.21.15.193:0/1565087915 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc40139c0 con 0x55a2b340c200 2024-09-12T17:11:27.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 -- 172.21.15.193:0/1565087915 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4013ca0 con 0x55a2b340c200 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 -- 172.21.15.193:0/1565087915 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fedc4010070 con 0x55a2b340c200 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 0x7fecb803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fecbfe07640 1 -- 172.21.15.193:0/1565087915 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fedc4018070 con 0x55a2b340c200 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd2d47640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 0x7fecb803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 0x55a2b3593f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b3594440 con 0x55a2b340c5e0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3d49640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 0x55a2b3593f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd2d47640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 0x7fecb803bf80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedc80ad000 tx=0x7fedc80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.807+0000 7fedd3d49640 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 0x55a2b3593f00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd3d49640 1 -- 172.21.15.193:0/1565087915 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedcc0083f0 con 0x55a2b340c5e0 2024-09-12T17:11:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b3594890 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd3d49640 1 -- 172.21.15.193:0/1565087915 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fedcc0083f0 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b3596190 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd3d49640 1 -- 172.21.15.193:0/1565087915 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fedcc0083f0 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35953c0 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd3d49640 1 -- 172.21.15.193:0/1565087915 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fedcc0083f0 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b3595810 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd3d49640 1 -- 172.21.15.193:0/1565087915 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fedcc0083f0 con 0x55a2b340c5e0 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2b33ad450 con 0x55a2b35a44a0 2024-09-12T17:11:27.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52080/0 (socket says 172.21.15.193:52080) 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd2d47640 1 -- 172.21.15.193:0/3792278167 learned_addr learned my addr 172.21.15.193:0/3792278167 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd2d47640 1 -- 172.21.15.193:0/3792278167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b35a4f00 con 0x55a2b35a44a0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd2d47640 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c10 tx=0x7fedc8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fecbd602640 1 -- 172.21.15.193:0/3792278167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80c7070 con 0x55a2b35a44a0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b35a5760 con 0x55a2b35a44a0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b35a5c70 con 0x55a2b35a44a0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fecbd602640 1 -- 172.21.15.193:0/3792278167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc80b7b20 con 0x55a2b35a44a0 2024-09-12T17:11:27.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.811+0000 7fecbd602640 1 -- 172.21.15.193:0/3792278167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80b0040 con 0x55a2b35a44a0 2024-09-12T17:11:27.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecbd602640 1 -- 172.21.15.193:0/3792278167 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fedc80ca070 con 0x55a2b35a44a0 2024-09-12T17:11:27.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecbd602640 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 0x7fecac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecbd602640 1 -- 172.21.15.193:0/3792278167 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fedc80a8070 con 0x55a2b35a44a0 2024-09-12T17:11:27.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd3d49640 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 0x7fecac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd3d49640 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 0x7fecac03bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a2b3594ee0 tx=0x7fedcc003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd5a429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd5a429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2b3585f90 con 0x55a2b35b1d30 2024-09-12T17:11:27.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52094/0 (socket says 172.21.15.193:52094) 2024-09-12T17:11:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd2d47640 1 -- 172.21.15.193:0/2066757717 learned_addr learned my addr 172.21.15.193:0/2066757717 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd2d47640 1 -- 172.21.15.193:0/2066757717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b35b2720 con 0x55a2b35b1d30 2024-09-12T17:11:27.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fedd2d47640 1 --2- 172.21.15.193:0/2066757717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedc80cc030 tx=0x7fedc80cb780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b20e450ec62745 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecb6ffd640 1 -- 172.21.15.193:0/2066757717 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80dd070 con 0x55a2b35b1d30 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecb6ffd640 1 -- 172.21.15.193:0/2066757717 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc8009940 con 0x55a2b35b1d30 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.815+0000 7fecb6ffd640 1 -- 172.21.15.193:0/2066757717 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc8009420 con 0x55a2b35b1d30 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2066757717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 msgr2=0x55a2b35b2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2066757717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fedc80cc030 tx=0x7fedc80cb780 comp rx=0 tx=0).stop 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2066757717 shutdown_connections 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2066757717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b2130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2066757717 >> 172.21.15.193:0/2066757717 conn(0x55a2b35ad150 msgr2=0x55a2b35ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2066757717 shutdown_connections 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2066757717 wait complete. 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 Processor -- start 2024-09-12T17:11:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- start start 2024-09-12T17:11:27.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2b35b0c80 con 0x55a2b35b1d30 2024-09-12T17:11:27.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd2d47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52106/0 (socket says 172.21.15.193:52106) 2024-09-12T17:11:27.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 learned_addr learned my addr 172.21.15.193:0/2403516042 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2b35b87e0 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd2d47640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b8280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedc80b6040 tx=0x7fedc80eae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fecb57fa640 1 -- 172.21.15.193:0/2403516042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80dd030 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2b35b8a70 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2b35b9420 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fecb57fa640 1 -- 172.21.15.193:0/2403516042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc80aae40 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fecb57fa640 1 -- 172.21.15.193:0/2403516042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc80f1060 con 0x55a2b35b1d30 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fecb57fa640 1 -- 172.21.15.193:0/2403516042 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fedc80aa6a0 con 0x55a2b35b1d30 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.819+0000 7fecb57fa640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fec9c039a70 0x7fec9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fecb57fa640 1 -- 172.21.15.193:0/2403516042 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fedc80e9020 con 0x55a2b35b1d30 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fec9c039a70 0x7fec9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b35c35b0 0x55a2b35c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c6190 con 0x55a2b35c35b0 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b35c35b0 0x55a2b35c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fec9c039a70 0x7fec9c03bf30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00f010 tx=0x7fedcc01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b35c35b0 0x55a2b35c5a40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 realm 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c65a0 con 0x55a2b35c35b0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c6e70 con 0x55a2b35c35b0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c7210 con 0x55a2b35c35b0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 20 searching for the correct realm 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2b35c9620 0x55a2b35cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cc090 con 0x55a2b35c9620 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd2d47640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2b35c9620 0x55a2b35cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd2d47640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2b35c9620 0x55a2b35cba10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd2d47640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fedc80cc060 0x7fedc80a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cc090 con 0x7fedc80cc060 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fedc80cc060 0x7fedc80a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fedc80cc060 0x7fedc80a4aa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fedcc019040 0x7fedcc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cc090 con 0x7fedcc019040 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.823+0000 7fedd3548640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fedcc019040 0x7fedcc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fedcc019040 0x7fedcc019930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x7fedcc019040 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x7fedcc019040 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x7fedc80cc060 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c9620 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x7fedcc019040 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.827+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x7fedc80cc060 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c9620 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c76b0 con 0x55a2b35c9620 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc8104040 con 0x7fedcc019040 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c9620 2024-09-12T17:11:27.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c9620 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c35b0 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c35b0 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedcc019040 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c9620 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedc80cc060 2024-09-12T17:11:27.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c35b0 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.831+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedcc019040 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c9620 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedcc019040 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedc80cc060 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c9620 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedcc019040 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x55a2b35c35b0 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4034040 con 0x7fedc80cc060 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:27.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c7f90 con 0x55a2b35c35b0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c8380 con 0x55a2b35c35b0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c8380 con 0x55a2b35c35b0 2024-09-12T17:11:27.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 zone default found 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 4 Realm: () 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 zonegroup default 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.835+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c87a0 con 0x7fedcc019040 2024-09-12T17:11:27.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35c87a0 con 0x55a2b35c9620 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cdee0 con 0x55a2b35c9620 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 started sync module instance, tier type = 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cd380 con 0x7fedc80cc060 2024-09-12T17:11:27.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94157282269088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35ccfe0 con 0x7fedc80cc060 2024-09-12T17:11:27.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35ceda0 con 0x55a2b35c35b0 2024-09-12T17:11:27.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.839+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94157282269088] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94157282271952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35ceda0 con 0x55a2b35c35b0 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cf760 con 0x55a2b35c9620 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94157282276016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d0000 con 0x55a2b35c9620 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d0a00 con 0x7fedc80cc060 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.843+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94157282271952] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94157282273520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d0df0 con 0x7fedc80cc060 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d17b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94157282276016] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94157282273520] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94157282280720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d1300 con 0x55a2b35c35b0 2024-09-12T17:11:27.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d1b50 con 0x7fedcc019040 2024-09-12T17:11:27.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.847+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94157282280720] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94157282284288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cfc60 con 0x7fedcc019040 2024-09-12T17:11:27.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d2450 con 0x7fedcc019040 2024-09-12T17:11:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94157282287424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d28c0 con 0x7fedcc019040 2024-09-12T17:11:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d33a0 con 0x7fedcc019040 2024-09-12T17:11:27.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.851+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94157282284288] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94157282291376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d33a0 con 0x7fedcc019040 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=0 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=1 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=2 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=3 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=4 2024-09-12T17:11:27.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=5 2024-09-12T17:11:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94157282287424] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=6 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94157282291376] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 add_watcher() i=7 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d63d0 con 0x55a2b35c35b0 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94157282285344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35d3850 con 0x55a2b35c35b0 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94157282285344] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fec89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.855+0000 7fedd5a429c0 5 note: GC not initialized 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fec88fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 Filter name: none 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fec027fc640 20 reqs_thread_entry: start 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f90c0 con 0x55a2b35c35b0 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f9600 con 0x55a2b35c35b0 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f9600 con 0x7fedc80cc060 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fec89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:27.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94157282285344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f6f00 con 0x55a2b35c35b0 2024-09-12T17:11:27.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94157282285344] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.859+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94157282269088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f6f00 con 0x7fedc80cc060 2024-09-12T17:11:27.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94157282269088] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd5a429c0 20 remove_watcher() i=0 2024-09-12T17:11:27.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd5a429c0 2 removed watcher, disabling cache 2024-09-12T17:11:27.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94157282271952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cd7a0 con 0x55a2b35c35b0 2024-09-12T17:11:27.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94157282271952] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd5a429c0 20 remove_watcher() i=1 2024-09-12T17:11:27.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.863+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94157282276016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f6f00 con 0x55a2b35c9620 2024-09-12T17:11:27.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd2d47640 1 -- 172.21.15.193:0/2403516042 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94157282276016] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc80c9030 con 0x55a2b35c9620 2024-09-12T17:11:27.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 20 remove_watcher() i=2 2024-09-12T17:11:27.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94157282273520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cd7a0 con 0x7fedc80cc060 2024-09-12T17:11:27.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd3d49640 1 -- 172.21.15.193:0/2403516042 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94157282273520] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02f040 con 0x7fedc80cc060 2024-09-12T17:11:27.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 20 remove_watcher() i=3 2024-09-12T17:11:27.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94157282280720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cf2b0 con 0x55a2b35c35b0 2024-09-12T17:11:27.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94157282280720] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x55a2b35c35b0 2024-09-12T17:11:27.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 20 remove_watcher() i=4 2024-09-12T17:11:27.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.867+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94157282284288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35f6f00 con 0x7fedcc019040 2024-09-12T17:11:27.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94157282284288] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd5a429c0 20 remove_watcher() i=5 2024-09-12T17:11:27.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94157282287424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35ce8f0 con 0x7fedcc019040 2024-09-12T17:11:27.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94157282287424] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd5a429c0 20 remove_watcher() i=6 2024-09-12T17:11:27.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.871+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94157282291376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2b35cd7a0 con 0x7fedcc019040 2024-09-12T17:11:27.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94157282291376] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc401b030 con 0x7fedcc019040 2024-09-12T17:11:27.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 20 remove_watcher() i=7 2024-09-12T17:11:27.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fedcc019040 msgr2=0x7fedcc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fedcc019040 0x7fedcc019930 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b35c35b0 msgr2=0x55a2b35c5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b35c35b0 0x55a2b35c5a40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fedc80cc060 msgr2=0x7fedc80a4aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fedc80cc060 0x7fedc80a4aa0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2b35c9620 msgr2=0x55a2b35cba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2b35c9620 0x55a2b35cba10 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fec9c039a70 msgr2=0x7fec9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fec9c039a70 0x7fec9c03bf30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00f010 tx=0x7fedcc01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 reap_dead start 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 msgr2=0x55a2b35b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/2403516042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35b1d30 0x55a2b35b8280 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fedc80b6040 tx=0x7fedc80eae10 comp rx=0 tx=0).stop 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd3548640 1 -- 172.21.15.193:0/2403516042 reap_dead start 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 shutdown_connections 2024-09-12T17:11:27.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 >> 172.21.15.193:0/2403516042 conn(0x55a2b35ad150 msgr2=0x55a2b35ab360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 shutdown_connections 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/2403516042 wait complete. 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 msgr2=0x7fecac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 0x7fecac03bf30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55a2b3594ee0 tx=0x7fedcc003070 comp rx=0 tx=0).stop 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 msgr2=0x55a2b35a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c10 tx=0x7fedc8018020 comp rx=0 tx=0).stop 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 shutdown_connections 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecac039a70 0x7fecac03bf30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/3792278167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b35a44a0 0x55a2b35a48c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 >> 172.21.15.193:0/3792278167 conn(0x55a2b3599e50 msgr2=0x55a2b359a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 shutdown_connections 2024-09-12T17:11:27.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/3792278167 wait complete. 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 msgr2=0x55a2b3593f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 0x55a2b3593f00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 msgr2=0x7fecb803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 0x7fecb803bf80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedc80ad000 tx=0x7fedc80a5040 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 msgr2=0x55a2b358cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.875+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55a2b35866d0 tx=0x7fedc4004470 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 shutdown_connections 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2b340c5e0 0x55a2b3593f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fecb8039ac0 0x7fecb803bf80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 --2- 172.21.15.193:0/1565087915 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2b340c200 0x55a2b358cd90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 >> 172.21.15.193:0/1565087915 conn(0x55a2b3492920 msgr2=0x55a2b357fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 shutdown_connections 2024-09-12T17:11:27.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.879+0000 7fedd5a429c0 1 -- 172.21.15.193:0/1565087915 wait complete. 2024-09-12T17:11:27.890 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-09-12T17:11:27.891 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:11:27.916 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:27.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-12T17:11:27.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-12T17:11:27.917 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-12T17:11:27.959 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f7581f119c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5625c1670200 0x5625c1701030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f7581f119c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625c15b09c0 con 0x5625c16705e0 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f7581f119c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5625c16006d0 con 0x5625c1670200 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f757fa17640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5625c1670200 0x5625c1701030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f757f216640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5625c16705e0 0x5625c1703580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36592/0 (socket says 172.21.15.193:36592) 2024-09-12T17:11:27.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.955+0000 7f757f216640 1 -- 172.21.15.193:0/2587589345 learned_addr learned my addr 172.21.15.193:0/2587589345 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:27.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757fa17640 1 -- 172.21.15.193:0/2587589345 >> v1:172.21.15.62:6789/0 conn(0x5625c16705e0 legacy=0x5625c1703580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757fa17640 1 -- 172.21.15.193:0/2587589345 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c15a4ca0 con 0x5625c1670200 2024-09-12T17:11:27.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757fa17640 1 --2- 172.21.15.193:0/2587589345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c1701030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f757000a480 tx=0x7f757001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5537a0ed996f6b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757ea15640 1 -- 172.21.15.193:0/2587589345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700b0070 con 0x5625c1670200 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757ea15640 1 -- 172.21.15.193:0/2587589345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75700ab540 con 0x5625c1670200 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f757ea15640 1 -- 172.21.15.193:0/2587589345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700ab840 con 0x5625c1670200 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 -- 172.21.15.193:0/2587589345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 msgr2=0x5625c1701030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2587589345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c1701030 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f757000a480 tx=0x7f757001b280 comp rx=0 tx=0).stop 2024-09-12T17:11:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 -- 172.21.15.193:0/2587589345 shutdown_connections 2024-09-12T17:11:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2587589345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c1701030 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 -- 172.21.15.193:0/2587589345 >> 172.21.15.193:0/2587589345 conn(0x5625c16f6920 msgr2=0x5625c16f8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 -- 172.21.15.193:0/2587589345 shutdown_connections 2024-09-12T17:11:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.959+0000 7f7581f119c0 1 -- 172.21.15.193:0/2587589345 wait complete. 2024-09-12T17:11:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5625c1604680 con 0x5625c1670200 2024-09-12T17:11:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52114/0 (socket says 172.21.15.193:52114) 2024-09-12T17:11:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 -- 172.21.15.193:0/340774482 learned_addr learned my addr 172.21.15.193:0/340774482 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 -- 172.21.15.193:0/340774482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c157fda0 con 0x5625c1670200 2024-09-12T17:11:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 --2- 172.21.15.193:0/340774482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7570018eb0 tx=0x7f7570003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc7698e1cab3d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f746de0b640 1 -- 172.21.15.193:0/340774482 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700b0040 con 0x5625c1670200 2024-09-12T17:11:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f746de0b640 1 -- 172.21.15.193:0/340774482 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75700bb070 con 0x5625c1670200 2024-09-12T17:11:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f746de0b640 1 -- 172.21.15.193:0/340774482 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700ab6f0 con 0x5625c1670200 2024-09-12T17:11:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- 172.21.15.193:0/340774482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 msgr2=0x5625c17e9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 --2- 172.21.15.193:0/340774482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7570018eb0 tx=0x7f7570003030 comp rx=0 tx=0).stop 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- 172.21.15.193:0/340774482 shutdown_connections 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 --2- 172.21.15.193:0/340774482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17e9860 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- 172.21.15.193:0/340774482 >> 172.21.15.193:0/340774482 conn(0x5625c16f6920 msgr2=0x5625c17e54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- 172.21.15.193:0/340774482 shutdown_connections 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- 172.21.15.193:0/340774482 wait complete. 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f7581f119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5625c15a6a50 con 0x5625c1670200 2024-09-12T17:11:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52130/0 (socket says 172.21.15.193:52130) 2024-09-12T17:11:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.975+0000 7f757fa17640 1 -- 172.21.15.193:0/1002891308 learned_addr learned my addr 172.21.15.193:0/1002891308 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f757fa17640 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c17f1330 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f757fa17640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f75700b8040 tx=0x7f7570018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 -- 172.21.15.193:0/1002891308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700b0030 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c17f15c0 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 -- 172.21.15.193:0/1002891308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75700bb070 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 -- 172.21.15.193:0/1002891308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75700b68e0 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c17f1f70 con 0x5625c1670200 2024-09-12T17:11:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 -- 172.21.15.193:0/1002891308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f75700b6a80 con 0x5625c1670200 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 0x7f746803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7467fff640 1 -- 172.21.15.193:0/1002891308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f75700a8070 con 0x5625c1670200 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f757f216640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 0x7f746803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 0x5625c17f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c17f8480 con 0x5625c16705e0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 0x5625c17f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f757f216640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 0x7f746803bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7574004180 tx=0x7f7574001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 0x5625c17f7f40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 -- 172.21.15.193:0/1002891308 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f757800a4d0 con 0x5625c16705e0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c17f88d0 con 0x5625c16705e0 2024-09-12T17:11:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 -- 172.21.15.193:0/1002891308 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f757800a4d0 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c17fa1d0 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 -- 172.21.15.193:0/1002891308 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f757800a4d0 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c17f9400 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.979+0000 7f7580218640 1 -- 172.21.15.193:0/1002891308 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f757800a4d0 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c17f9820 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7580218640 1 -- 172.21.15.193:0/1002891308 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f757800a4d0 con 0x5625c16705e0 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:27.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5625c1611450 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52136/0 (socket says 172.21.15.193:52136) 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f757f216640 1 -- 172.21.15.193:0/2855001767 learned_addr learned my addr 172.21.15.193:0/2855001767 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f757f216640 1 -- 172.21.15.193:0/2855001767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c1808f90 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f757f216640 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f757400d660 tx=0x7f757400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f74657fa640 1 -- 172.21.15.193:0/2855001767 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757400c6b0 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f74657fa640 1 -- 172.21.15.193:0/2855001767 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757400c850 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c18097f0 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f74657fa640 1 -- 172.21.15.193:0/2855001767 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757400cb30 con 0x5625c1808530 2024-09-12T17:11:27.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.983+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c1809d60 con 0x5625c1808530 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f74657fa640 1 -- 172.21.15.193:0/2855001767 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7574023020 con 0x5625c1808530 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f74657fa640 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 0x7f745803bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f74657fa640 1 -- 172.21.15.193:0/2855001767 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7574021020 con 0x5625c1808530 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7580218640 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 0x7f745803bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5625c17e9ff0 con 0x5625c1814ef0 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7580218640 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 0x7f745803bf70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5625c17f97a0 tx=0x7f7578005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52152/0 (socket says 172.21.15.193:52152) 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 -- 172.21.15.193:0/3671693759 learned_addr learned my addr 172.21.15.193:0/3671693759 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 -- 172.21.15.193:0/3671693759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c18158a0 con 0x5625c1814ef0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 --2- 172.21.15.193:0/3671693759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7574050f10 tx=0x7f7574023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb0933e9a63d4138 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f745effd640 1 -- 172.21.15.193:0/3671693759 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f757400ccd0 con 0x5625c1814ef0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f745effd640 1 -- 172.21.15.193:0/3671693759 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757401bcc0 con 0x5625c1814ef0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f745effd640 1 -- 172.21.15.193:0/3671693759 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7574019a70 con 0x5625c1814ef0 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- 172.21.15.193:0/3671693759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 msgr2=0x5625c18152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3671693759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7574050f10 tx=0x7f7574023430 comp rx=0 tx=0).stop 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- 172.21.15.193:0/3671693759 shutdown_connections 2024-09-12T17:11:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3671693759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c18152d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- 172.21.15.193:0/3671693759 >> 172.21.15.193:0/3671693759 conn(0x5625c1811320 msgr2=0x5625c180f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- 172.21.15.193:0/3671693759 shutdown_connections 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- 172.21.15.193:0/3671693759 wait complete. 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 Processor -- start 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- start start 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f7581f119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5625c1815f00 con 0x5625c1814ef0 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52160/0 (socket says 172.21.15.193:52160) 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.987+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 learned_addr learned my addr 172.21.15.193:0/3133241223 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625c181c980 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757f216640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7574025580 tx=0x7f7574050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 -- 172.21.15.193:0/3133241223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7574019c80 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625c181cc10 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625c181d5c0 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 -- 172.21.15.193:0/3133241223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7574035030 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 -- 172.21.15.193:0/3133241223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7574019610 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 -- 172.21.15.193:0/3133241223 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f757404a070 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7448039a20 0x7f744803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f745d7fa640 1 -- 172.21.15.193:0/3133241223 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f7574048020 con 0x5625c1814ef0 2024-09-12T17:11:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7580218640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7448039a20 0x7f744803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c18275a0 0x5625c1829a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182a180 con 0x5625c18275a0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c18275a0 0x5625c1829a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7580218640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7448039a20 0x7f744803bee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5625c17f8f20 tx=0x7f757801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c18275a0 0x5625c1829a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 realm 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182a590 con 0x5625c18275a0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182ae60 con 0x5625c18275a0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182b200 con 0x5625c18275a0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.991+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182b6a0 con 0x5625c18275a0 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7581f119c0 20 searching for the correct realm 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5625c182d610 0x5625c182fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757f216640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5625c182d610 0x5625c182fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757f216640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5625c182d610 0x5625c182fa00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757f216640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f757401a590 0x7f7574042570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f757401a590 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7580218640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f757401a590 0x7f7574042570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7580218640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f757401a590 0x7f7574042570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7580218640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7578031040 0x7f7578032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7578031040 0x7f7578032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7578031040 0x7f7578032940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.995+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f757401a590 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f757401a590 2024-09-12T17:11:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:27.999+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f757401a590 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f757401a590 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x5625c182d610 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.003+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830080 con 0x7f7578031040 2024-09-12T17:11:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f75700fe040 con 0x5625c18275a0 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f75700fe040 con 0x7f757401a590 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f757801f070 con 0x7f757401a590 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182bf80 con 0x5625c18275a0 2024-09-12T17:11:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182c370 con 0x5625c18275a0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182c370 con 0x5625c18275a0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 zone default found 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 4 Realm: () 2024-09-12T17:11:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 zonegroup default 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182c790 con 0x7f7578031040 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c182cbb0 con 0x5625c182d610 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c1831ed0 con 0x5625c182d610 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 started sync module instance, tier type = 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.007+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1831370 con 0x7f757401a590 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720160372576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1830fd0 con 0x7f757401a590 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1832db0 con 0x5625c18275a0 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720160372576] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720160375520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1832db0 con 0x5625c18275a0 2024-09-12T17:11:28.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.011+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1833770 con 0x5625c182d610 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720160375520] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720160377088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1832d20 con 0x5625c182d610 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1834470 con 0x7f757401a590 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720160383184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1834ba0 con 0x7f757401a590 2024-09-12T17:11:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c18356a0 con 0x5625c18275a0 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720160377088] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.015+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720160383184] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720160387472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1835660 con 0x5625c18275a0 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1835ac0 con 0x7f7578031040 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720160387472] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720160381712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1835a70 con 0x7f7578031040 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.019+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c18364d0 con 0x7f7578031040 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.023+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720160381712] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.023+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.023+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720160384496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c18364d0 con 0x7f7578031040 2024-09-12T17:11:28.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.023+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836e90 con 0x7f7578031040 2024-09-12T17:11:28.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.023+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720160384496] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720160391472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836e90 con 0x7f7578031040 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=0 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=1 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=2 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=3 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=4 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=5 2024-09-12T17:11:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=6 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720160391472] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 add_watcher() i=7 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c183a180 con 0x5625c18275a0 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720160394064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1837420 con 0x5625c18275a0 2024-09-12T17:11:28.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720160394064] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 5 note: GC not initialized 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7434fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.027+0000 7f7581f119c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 20 Filter name: none 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f73ae7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c185cff0 con 0x5625c18275a0 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c185da10 con 0x5625c18275a0 2024-09-12T17:11:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5625c185ea20 con 0x7f757401a590 2024-09-12T17:11:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7435fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720160394064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1821b80 con 0x5625c18275a0 2024-09-12T17:11:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94720160394064] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720160372576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836b50 con 0x7f757401a590 2024-09-12T17:11:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.031+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94720160372576] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 20 remove_watcher() i=0 2024-09-12T17:11:28.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 2 removed watcher, disabling cache 2024-09-12T17:11:28.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720160375520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836b50 con 0x5625c18275a0 2024-09-12T17:11:28.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94720160375520] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 20 remove_watcher() i=1 2024-09-12T17:11:28.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720160377088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c18322e0 con 0x5625c182d610 2024-09-12T17:11:28.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f757f216640 1 -- 172.21.15.193:0/3133241223 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94720160377088] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f757401b420 con 0x5625c182d610 2024-09-12T17:11:28.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 20 remove_watcher() i=2 2024-09-12T17:11:28.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.035+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720160383184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836b50 con 0x7f757401a590 2024-09-12T17:11:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f7580218640 1 -- 172.21.15.193:0/3133241223 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94720160383184] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7578040040 con 0x7f757401a590 2024-09-12T17:11:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f7581f119c0 20 remove_watcher() i=3 2024-09-12T17:11:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720160387472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1832900 con 0x5625c18275a0 2024-09-12T17:11:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94720160387472] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x5625c18275a0 2024-09-12T17:11:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f7581f119c0 20 remove_watcher() i=4 2024-09-12T17:11:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.039+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720160381712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c18322e0 con 0x7f7578031040 2024-09-12T17:11:28.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94720160381712] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f7581f119c0 20 remove_watcher() i=5 2024-09-12T17:11:28.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720160384496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1836b50 con 0x7f7578031040 2024-09-12T17:11:28.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94720160384496] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f7581f119c0 20 remove_watcher() i=6 2024-09-12T17:11:28.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.043+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720160391472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5625c1832900 con 0x7f7578031040 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94720160391472] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f75700b3040 con 0x7f7578031040 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 20 remove_watcher() i=7 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7578031040 msgr2=0x7f7578032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7578031040 0x7f7578032940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c18275a0 msgr2=0x5625c1829a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c18275a0 0x5625c1829a30 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f757401a590 msgr2=0x7f7574042570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f757401a590 0x7f7574042570 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5625c182d610 msgr2=0x5625c182fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5625c182d610 0x5625c182fa00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7448039a20 msgr2=0x7f744803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7448039a20 0x7f744803bee0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5625c17f8f20 tx=0x7f757801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f757fa17640 1 -- 172.21.15.193:0/3133241223 reap_dead start 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 msgr2=0x5625c181c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7574025580 tx=0x7f7574050e70 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 shutdown_connections 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/3133241223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1814ef0 0x5625c181c420 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 >> 172.21.15.193:0/3133241223 conn(0x5625c1811320 msgr2=0x5625c180f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 shutdown_connections 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/3133241223 wait complete. 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 msgr2=0x7f745803bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 0x7f745803bf70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5625c17f97a0 tx=0x7f7578005850 comp rx=0 tx=0).stop 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 msgr2=0x5625c1808950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f757400d660 tx=0x7f757400da60 comp rx=0 tx=0).stop 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 shutdown_connections 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7458039ab0 0x7f745803bf70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/2855001767 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1808530 0x5625c1808950 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 >> 172.21.15.193:0/2855001767 conn(0x5625c17fdee0 msgr2=0x5625c17fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 shutdown_connections 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/2855001767 wait complete. 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 msgr2=0x5625c17f7f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 0x5625c17f7f40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 msgr2=0x7f746803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 0x7f746803bf30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7574004180 tx=0x7f7574001340 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 msgr2=0x5625c17f0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f75700b8040 tx=0x7f7570018020 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 shutdown_connections 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5625c16705e0 0x5625c17f7f40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7468039a70 0x7f746803bf30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 --2- 172.21.15.193:0/1002891308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5625c1670200 0x5625c17f0dd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 >> 172.21.15.193:0/1002891308 conn(0x5625c16f6920 msgr2=0x5625c17e3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 shutdown_connections 2024-09-12T17:11:28.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.047+0000 7f7581f119c0 1 -- 172.21.15.193:0/1002891308 wait complete. 2024-09-12T17:11:28.061 INFO:teuthology.orchestra.run.smithi193.stdout:["myfoo"] 2024-09-12T17:11:28.062 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T17:11:28.070 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-12T17:11:28.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-12T17:11:28.121 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-12T17:11:28.154 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:28.154 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:28.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39dbf199c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f80849f1d0 0x55f80849f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39dbf199c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8083519c0 con 0x55f8084a2310 2024-09-12T17:11:28.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39dbf199c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f8083a16d0 con 0x55f80849f1d0 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d9a1f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f80849f1d0 0x55f80849f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d9a1f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f80849f1d0 0x55f80849f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52172/0 (socket says 172.21.15.193:52172) 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d921e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f8084a2310 0x55f8084a4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36608/0 (socket says 172.21.15.193:36608) 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3254807809 learned_addr learned my addr 172.21.15.193:0/3254807809 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3254807809 >> v1:172.21.15.62:6789/0 conn(0x55f8084a2310 legacy=0x55f8084a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.151+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3254807809 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f808345ca0 con 0x55f80849f1d0 2024-09-12T17:11:28.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/3254807809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80849f5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00a5c0 tx=0x7f39cc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fcaf6346cd6834 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39d8a1d640 1 -- 172.21.15.193:0/3254807809 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0a6070 con 0x55f80849f1d0 2024-09-12T17:11:28.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39d8a1d640 1 -- 172.21.15.193:0/3254807809 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0af070 con 0x55f80849f1d0 2024-09-12T17:11:28.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39d8a1d640 1 -- 172.21.15.193:0/3254807809 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0aa5c0 con 0x55f80849f1d0 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3254807809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 msgr2=0x55f80849f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3254807809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80849f5b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00a5c0 tx=0x7f39cc01b340 comp rx=0 tx=0).stop 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3254807809 shutdown_connections 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3254807809 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80849f5b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3254807809 >> 172.21.15.193:0/3254807809 conn(0x55f808412ae0 msgr2=0x55f808412ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3254807809 shutdown_connections 2024-09-12T17:11:28.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.155+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3254807809 wait complete. 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.167+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.167+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.167+0000 7f39dbf199c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.167+0000 7f39dbf199c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f8083a5680 con 0x55f80849f1d0 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52174/0 (socket says 172.21.15.193:52174) 2024-09-12T17:11:28.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 -- 172.21.15.193:0/1339773521 learned_addr learned my addr 172.21.15.193:0/1339773521 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 -- 172.21.15.193:0/1339773521 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f808320da0 con 0x55f80849f1d0 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/1339773521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ac040 tx=0x7f39cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b55a421b9c28b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f38c7e07640 1 -- 172.21.15.193:0/1339773521 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0aa970 con 0x55f80849f1d0 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f38c7e07640 1 -- 172.21.15.193:0/1339773521 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0aab10 con 0x55f80849f1d0 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f38c7e07640 1 -- 172.21.15.193:0/1339773521 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0aae30 con 0x55f80849f1d0 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1339773521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 msgr2=0x55f80858a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/1339773521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0ac040 tx=0x7f39cc003030 comp rx=0 tx=0).stop 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1339773521 shutdown_connections 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/1339773521 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f80858a860 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1339773521 >> 172.21.15.193:0/1339773521 conn(0x55f808412ae0 msgr2=0x55f8085864e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1339773521 shutdown_connections 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1339773521 wait complete. 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39dbf199c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f808347a50 con 0x55f80849f1d0 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52186/0 (socket says 172.21.15.193:52186) 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 -- 172.21.15.193:0/961054552 learned_addr learned my addr 172.21.15.193:0/961054552 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f808592320 con 0x55f80849f1d0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.171+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f39cc01b170 tx=0x7f39cc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 -- 172.21.15.193:0/961054552 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0c6690 con 0x55f80849f1d0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8085925b0 con 0x55f80849f1d0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 -- 172.21.15.193:0/961054552 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39cc0cc070 con 0x55f80849f1d0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 -- 172.21.15.193:0/961054552 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39cc0c6960 con 0x55f80849f1d0 2024-09-12T17:11:28.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f808592f60 con 0x55f80849f1d0 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 -- 172.21.15.193:0/961054552 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f39cc0c6c10 con 0x55f80849f1d0 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 0x7f38c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f38c6604640 1 -- 172.21.15.193:0/961054552 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f39cc0ebde0 con 0x55f80849f1d0 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39d921e640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 0x7f38c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 0x55f808598f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f808599470 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 0x55f808598f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39d921e640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 0x7f38c003bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39c4001e40 tx=0x7f39c40013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 0x55f808598f30 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 -- 172.21.15.193:0/961054552 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d400a4d0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085998c0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 -- 172.21.15.193:0/961054552 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39d400a4d0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80859b1c0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 -- 172.21.15.193:0/961054552 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39d400a4d0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80859a3f0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39da220640 1 -- 172.21.15.193:0/961054552 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39d400a4d0 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.175+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f80859a810 con 0x55f8084a2310 2024-09-12T17:11:28.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39da220640 1 -- 172.21.15.193:0/961054552 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39d400a4d0 con 0x55f8084a2310 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f8083b2450 con 0x55f8085a9520 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52190/0 (socket says 172.21.15.193:52190) 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39d921e640 1 -- 172.21.15.193:0/3935239748 learned_addr learned my addr 172.21.15.193:0/3935239748 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39d921e640 1 -- 172.21.15.193:0/3935239748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8085a9f80 con 0x55f8085a9520 2024-09-12T17:11:28.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39d921e640 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f39c400e670 tx=0x7f39c400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 -- 172.21.15.193:0/3935239748 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c4022070 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8085aa7e0 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 -- 172.21.15.193:0/3935239748 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c400d660 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 -- 172.21.15.193:0/3935239748 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c4006070 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8085aad50 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 -- 172.21.15.193:0/3935239748 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f39c4025070 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 0x7f38b403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f38bf7fe640 1 -- 172.21.15.193:0/3935239748 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f39c4051b10 con 0x55f8085a9520 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.179+0000 7f39da220640 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 0x7f38b403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39da220640 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 0x7f38b403bf20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55f80859a790 tx=0x7f39d4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f80858aff0 con 0x55f8085b6ed0 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52192/0 (socket says 172.21.15.193:52192) 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 -- 172.21.15.193:0/1411753157 learned_addr learned my addr 172.21.15.193:0/1411753157 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 -- 172.21.15.193:0/1411753157 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8085b78c0 con 0x55f8085b6ed0 2024-09-12T17:11:28.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 --2- 172.21.15.193:0/1411753157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39c400cfd0 tx=0x7f39c401ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad02cf2ef2d7af3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f38bd7fa640 1 -- 172.21.15.193:0/1411753157 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c400c760 con 0x55f8085b6ed0 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f38bd7fa640 1 -- 172.21.15.193:0/1411753157 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c40263b0 con 0x55f8085b6ed0 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f38bd7fa640 1 -- 172.21.15.193:0/1411753157 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c400dcc0 con 0x55f8085b6ed0 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1411753157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 msgr2=0x55f8085b72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/1411753157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f39c400cfd0 tx=0x7f39c401ae00 comp rx=0 tx=0).stop 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1411753157 shutdown_connections 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/1411753157 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085b72d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1411753157 >> 172.21.15.193:0/1411753157 conn(0x55f8085b22f0 msgr2=0x55f8085b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1411753157 shutdown_connections 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- 172.21.15.193:0/1411753157 wait complete. 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 Processor -- start 2024-09-12T17:11:28.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- start start 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39dbf199c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f8085b5e20 con 0x55f8085b6ed0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52202/0 (socket says 172.21.15.193:52202) 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 learned_addr learned my addr 172.21.15.193:0/3869828994 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.183+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8085bd9a0 con 0x55f8085b6ed0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d921e640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f39c401af50 tx=0x7f39c404fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 -- 172.21.15.193:0/3869828994 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c401a320 con 0x55f8085b6ed0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8085bd9a0 con 0x55f8085b6ed0 2024-09-12T17:11:28.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 -- 172.21.15.193:0/3869828994 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c401a4c0 con 0x55f8085b6ed0 2024-09-12T17:11:28.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8085bd9a0 con 0x55f8085b6ed0 2024-09-12T17:11:28.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 -- 172.21.15.193:0/3869828994 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c401a670 con 0x55f8085b6ed0 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 -- 172.21.15.193:0/3869828994 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f39c4035020 con 0x55f8085b6ed0 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38a4039a70 0x7f38a403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f38ab7fe640 1 -- 172.21.15.193:0/3869828994 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f39c4033020 con 0x55f8085b6ed0 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39da220640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38a4039a70 0x7f38a403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8085c8350 0x55f8085ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085caf30 con 0x55f8085c8350 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8085c8350 0x55f8085ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39da220640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38a4039a70 0x7f38a403bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f808599f10 tx=0x7f39d401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8085c8350 0x55f8085ca7e0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 realm 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cb340 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cbc10 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cbfb0 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cc410 con 0x55f8085c8350 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 20 searching for the correct realm 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f8085ce380 0x55f8085d0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x55f8085ce380 2024-09-12T17:11:28.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.187+0000 7f39d921e640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f8085ce380 0x55f8085d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d921e640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f8085ce380 0x55f8085d0770 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d921e640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f39c4040040 0x7f39c404e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39c4040040 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39da220640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f39c4040040 0x7f39c404e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39da220640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f39c4040040 0x7f39c404e230 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39da220640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f39d4031040 0x7f39d4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39d4031040 2024-09-12T17:11:28.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f39d4031040 0x7f39d4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f39d4031040 0x7f39d4032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x55f8085c8350 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x55f8085c8350 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39d4031040 2024-09-12T17:11:28.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.191+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39d4031040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39c4040040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x55f8085ce380 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x55f8085c8350 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d0df0 con 0x7f39d4031040 2024-09-12T17:11:28.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085c8350 2024-09-12T17:11:28.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39c4040040 2024-09-12T17:11:28.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39d4031040 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.195+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085c8350 2024-09-12T17:11:28.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085c8350 2024-09-12T17:11:28.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39d4031040 2024-09-12T17:11:28.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39c4040040 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085c8350 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39d4031040 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39d4031040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39c4040040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.199+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085ce380 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39d4031040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x55f8085c8350 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f39cc0f1040 con 0x7f39c4040040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d401f070 con 0x7f39c4040040 2024-09-12T17:11:28.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cccf0 con 0x55f8085c8350 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cd0e0 con 0x55f8085c8350 2024-09-12T17:11:28.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cd0e0 con 0x55f8085c8350 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 zone default found 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 4 Realm: () 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 zonegroup default 2024-09-12T17:11:28.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cd500 con 0x7f39d4031040 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cd500 con 0x55f8085ce380 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d2c40 con 0x55f8085ce380 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 started sync module instance, tier type = 2024-09-12T17:11:28.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:28.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.203+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94523780572368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d1d40 con 0x7f39c4040040 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3b20 con 0x55f8085c8350 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94523780572368] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94523780575312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3b20 con 0x55f8085c8350 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.207+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d4530 con 0x55f8085ce380 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94523780575312] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94523780576880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3a90 con 0x55f8085ce380 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d5280 con 0x7f39c4040040 2024-09-12T17:11:28.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94523780583168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d5b20 con 0x7f39c4040040 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d6520 con 0x55f8085c8350 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94523780576880] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.211+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94523780583168] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94523780581664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d5670 con 0x55f8085c8350 2024-09-12T17:11:28.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d6df0 con 0x7f39d4031040 2024-09-12T17:11:28.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94523780581664] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94523780587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d5670 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.215+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d7290 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94523780587568] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94523780590944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d7250 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d7c50 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94523780590944] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94523780589376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d7c10 con 0x7f39d4031040 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=0 2024-09-12T17:11:28.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=1 2024-09-12T17:11:28.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=2 2024-09-12T17:11:28.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=3 2024-09-12T17:11:28.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=4 2024-09-12T17:11:28.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=5 2024-09-12T17:11:28.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.219+0000 7f39dbf199c0 20 add_watcher() i=6 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94523780589376] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39dbf199c0 20 add_watcher() i=7 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39dbf199c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8085db070 con 0x55f8085c8350 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94523780593968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d8530 con 0x55f8085c8350 2024-09-12T17:11:28.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94523780593968] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f388b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.223+0000 7f39dbf199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39dbf199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39dbf199c0 5 note: GC not initialized 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f388a7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39dbf199c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39dbf199c0 20 Filter name: none 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f37fbfff640 20 reqs_thread_entry: start 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085fdb60 con 0x55f8085ce380 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085fdb60 con 0x55f8085ce380 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085fdb60 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cccf0 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cccf0 con 0x7f39c4040040 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.227+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.231+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39d4031040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085c8350 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x55f8085ce380 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d20e0 con 0x7f39c4040040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got myfoo 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.235+0000 7f39dbf199c0 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:28.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f388b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94523780593968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085cccf0 con 0x55f8085c8350 2024-09-12T17:11:28.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94523780593968] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94523780572368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d7900 con 0x7f39c4040040 2024-09-12T17:11:28.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94523780572368] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39dbf199c0 20 remove_watcher() i=0 2024-09-12T17:11:28.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39dbf199c0 2 removed watcher, disabling cache 2024-09-12T17:11:28.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.239+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94523780575312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d24d0 con 0x55f8085c8350 2024-09-12T17:11:28.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94523780575312] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 20 remove_watcher() i=1 2024-09-12T17:11:28.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94523780576880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d24d0 con 0x55f8085ce380 2024-09-12T17:11:28.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39d921e640 1 -- 172.21.15.193:0/3869828994 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94523780576880] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c4024030 con 0x55f8085ce380 2024-09-12T17:11:28.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 20 remove_watcher() i=2 2024-09-12T17:11:28.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94523780583168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3670 con 0x7f39c4040040 2024-09-12T17:11:28.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39da220640 1 -- 172.21.15.193:0/3869828994 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94523780583168] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4040040 con 0x7f39c4040040 2024-09-12T17:11:28.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 20 remove_watcher() i=3 2024-09-12T17:11:28.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.243+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94523780581664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3670 con 0x55f8085c8350 2024-09-12T17:11:28.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94523780581664] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x55f8085c8350 2024-09-12T17:11:28.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39dbf199c0 20 remove_watcher() i=4 2024-09-12T17:11:28.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94523780587568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3670 con 0x7f39d4031040 2024-09-12T17:11:28.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94523780587568] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39dbf199c0 20 remove_watcher() i=5 2024-09-12T17:11:28.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.247+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94523780590944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d6030 con 0x7f39d4031040 2024-09-12T17:11:28.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.251+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94523780590944] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.251+0000 7f39dbf199c0 20 remove_watcher() i=6 2024-09-12T17:11:28.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.251+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94523780589376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8085d3670 con 0x7f39d4031040 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94523780589376] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc0b3cd0 con 0x7f39d4031040 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 20 remove_watcher() i=7 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f39d4031040 msgr2=0x7f39d4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f39d4031040 0x7f39d4032940 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8085c8350 msgr2=0x55f8085ca7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8085c8350 0x55f8085ca7e0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f39c4040040 msgr2=0x7f39c404e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f39c4040040 0x7f39c404e230 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f8085ce380 msgr2=0x55f8085d0770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f8085ce380 0x55f8085d0770 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38a4039a70 msgr2=0x7f38a403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38a4039a70 0x7f38a403bf30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x55f808599f10 tx=0x7f39d401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39d9a1f640 1 -- 172.21.15.193:0/3869828994 reap_dead start 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 msgr2=0x55f8085bd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f39c401af50 tx=0x7f39c404fdf0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 shutdown_connections 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3869828994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085b6ed0 0x55f8085bd440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 >> 172.21.15.193:0/3869828994 conn(0x55f8085b22f0 msgr2=0x55f8085b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 shutdown_connections 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3869828994 wait complete. 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 msgr2=0x7f38b403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 0x7f38b403bf20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x55f80859a790 tx=0x7f39d4005850 comp rx=0 tx=0).stop 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 msgr2=0x55f8085a9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f39c400e670 tx=0x7f39c400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 shutdown_connections 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38b4039a60 0x7f38b403bf20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/3935239748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f8085a9520 0x55f8085a9940 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 >> 172.21.15.193:0/3935239748 conn(0x55f80859eed0 msgr2=0x55f80859f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 shutdown_connections 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/3935239748 wait complete. 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 msgr2=0x55f808598f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 0x55f808598f30 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 msgr2=0x7f38c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 0x7f38c003bf30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f39c4001e40 tx=0x7f39c40013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 msgr2=0x55f808591dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f39cc01b170 tx=0x7f39cc0180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 shutdown_connections 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f8084a2310 0x55f808598f30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f38c0039a70 0x7f38c003bf30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 --2- 172.21.15.193:0/961054552 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f80849f1d0 0x55f808591dc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 >> 172.21.15.193:0/961054552 conn(0x55f808412ae0 msgr2=0x55f808584f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 shutdown_connections 2024-09-12T17:11:28.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.255+0000 7f39dbf199c0 1 -- 172.21.15.193:0/961054552 wait complete. 2024-09-12T17:11:28.268 INFO:teuthology.orchestra.run.smithi193.stdout:["myfoo"] 2024-09-12T17:11:28.269 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-12T17:11:28.283 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.300 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.315 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.362 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-12T17:11:28.425 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.496 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.569 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:28.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:28.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:28.569 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:11:28.606 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:28.606 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:28.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda458429c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ffc560e200 0x55ffc569cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda458429c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ffc554e9c0 con 0x55ffc569d170 2024-09-12T17:11:28.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda458429c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ffc559e6d0 con 0x55ffc560e200 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda43348640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ffc560e200 0x55ffc569cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda43348640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ffc560e200 0x55ffc569cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52216/0 (socket says 172.21.15.193:52216) 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda42b47640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ffc569d170 0x55ffc569f560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36622/0 (socket says 172.21.15.193:36622) 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda43348640 1 -- 172.21.15.193:0/4226137339 learned_addr learned my addr 172.21.15.193:0/4226137339 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda43348640 1 -- 172.21.15.193:0/4226137339 >> v1:172.21.15.62:6789/0 conn(0x55ffc569d170 legacy=0x55ffc569f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.603+0000 7fda43348640 1 -- 172.21.15.193:0/4226137339 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc5542ca0 con 0x55ffc560e200 2024-09-12T17:11:28.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda43348640 1 --2- 172.21.15.193:0/4226137339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc569cc30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00a4e0 tx=0x7fda3c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07c66b74c88abd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda42346640 1 -- 172.21.15.193:0/4226137339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0aa540 con 0x55ffc560e200 2024-09-12T17:11:28.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda42346640 1 -- 172.21.15.193:0/4226137339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c0aa6e0 con 0x55ffc560e200 2024-09-12T17:11:28.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda42346640 1 -- 172.21.15.193:0/4226137339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0aaa40 con 0x55ffc560e200 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 -- 172.21.15.193:0/4226137339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 msgr2=0x55ffc569cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 --2- 172.21.15.193:0/4226137339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc569cc30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00a4e0 tx=0x7fda3c01b090 comp rx=0 tx=0).stop 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 -- 172.21.15.193:0/4226137339 shutdown_connections 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 --2- 172.21.15.193:0/4226137339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc569cc30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 -- 172.21.15.193:0/4226137339 >> 172.21.15.193:0/4226137339 conn(0x55ffc5694920 msgr2=0x55ffc5696d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 -- 172.21.15.193:0/4226137339 shutdown_connections 2024-09-12T17:11:28.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.607+0000 7fda458429c0 1 -- 172.21.15.193:0/4226137339 wait complete. 2024-09-12T17:11:28.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.623+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.623+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.623+0000 7fda458429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.623+0000 7fda458429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ffc55a2680 con 0x55ffc560e200 2024-09-12T17:11:28.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52222/0 (socket says 172.21.15.193:52222) 2024-09-12T17:11:28.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 -- 172.21.15.193:0/2977095470 learned_addr learned my addr 172.21.15.193:0/2977095470 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 -- 172.21.15.193:0/2977095470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc551dda0 con 0x55ffc560e200 2024-09-12T17:11:28.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 --2- 172.21.15.193:0/2977095470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda3c019740 tx=0x7fda3c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f339e0276c72cd8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fd93160a640 1 -- 172.21.15.193:0/2977095470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0b9070 con 0x55ffc560e200 2024-09-12T17:11:28.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fd93160a640 1 -- 172.21.15.193:0/2977095470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c0aaa90 con 0x55ffc560e200 2024-09-12T17:11:28.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fd93160a640 1 -- 172.21.15.193:0/2977095470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0aad70 con 0x55ffc560e200 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- 172.21.15.193:0/2977095470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 msgr2=0x55ffc5785770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 --2- 172.21.15.193:0/2977095470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fda3c019740 tx=0x7fda3c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- 172.21.15.193:0/2977095470 shutdown_connections 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 --2- 172.21.15.193:0/2977095470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc5785770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- 172.21.15.193:0/2977095470 >> 172.21.15.193:0/2977095470 conn(0x55ffc5694920 msgr2=0x55ffc57813b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- 172.21.15.193:0/2977095470 shutdown_connections 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- 172.21.15.193:0/2977095470 wait complete. 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda458429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ffc5544a50 con 0x55ffc560e200 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52228/0 (socket says 172.21.15.193:52228) 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 -- 172.21.15.193:0/1128473941 learned_addr learned my addr 172.21.15.193:0/1128473941 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.627+0000 7fda43348640 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc578d1a0 con 0x55ffc560e200 2024-09-12T17:11:28.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda43348640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda3c018cc0 tx=0x7fda3c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 -- 172.21.15.193:0/1128473941 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0b9070 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffc578d430 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 -- 172.21.15.193:0/1128473941 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c0b5b10 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 -- 172.21.15.193:0/1128473941 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0b5df0 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc578dde0 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 -- 172.21.15.193:0/1128473941 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda3c0b3040 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 0x7fd92803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fd92fe07640 1 -- 172.21.15.193:0/1128473941 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fda3c0c4070 con 0x55ffc560e200 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda42b47640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 0x7fd92803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 0x55ffc5793db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57942f0 con 0x55ffc569d170 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda43b49640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 0x55ffc5793db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda42b47640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 0x7fd92803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001e90 tx=0x7fda2c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda43b49640 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 0x55ffc5793db0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda43b49640 1 -- 172.21.15.193:0/1128473941 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda340083f0 con 0x55ffc569d170 2024-09-12T17:11:28.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc578e1e0 con 0x55ffc569d170 2024-09-12T17:11:28.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda43b49640 1 -- 172.21.15.193:0/1128473941 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda340083f0 con 0x55ffc569d170 2024-09-12T17:11:28.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.631+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57960a0 con 0x55ffc569d170 2024-09-12T17:11:28.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda43b49640 1 -- 172.21.15.193:0/1128473941 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda340083f0 con 0x55ffc569d170 2024-09-12T17:11:28.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57952d0 con 0x55ffc569d170 2024-09-12T17:11:28.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda43b49640 1 -- 172.21.15.193:0/1128473941 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda340083f0 con 0x55ffc569d170 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc5795720 con 0x55ffc569d170 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda43b49640 1 -- 172.21.15.193:0/1128473941 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda340083f0 con 0x55ffc569d170 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ffc55af450 con 0x55ffc57a43b0 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52232/0 (socket says 172.21.15.193:52232) 2024-09-12T17:11:28.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda42b47640 1 -- 172.21.15.193:0/2575969793 learned_addr learned my addr 172.21.15.193:0/2575969793 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda42b47640 1 -- 172.21.15.193:0/2575969793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc57a4e10 con 0x55ffc57a43b0 2024-09-12T17:11:28.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda42b47640 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e670 tx=0x7fda2c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fd92d602640 1 -- 172.21.15.193:0/2575969793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c022070 con 0x55ffc57a43b0 2024-09-12T17:11:28.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffc57a5670 con 0x55ffc57a43b0 2024-09-12T17:11:28.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc57a5be0 con 0x55ffc57a43b0 2024-09-12T17:11:28.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fd92d602640 1 -- 172.21.15.193:0/2575969793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c00d660 con 0x55ffc57a43b0 2024-09-12T17:11:28.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.635+0000 7fd92d602640 1 -- 172.21.15.193:0/2575969793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c006070 con 0x55ffc57a43b0 2024-09-12T17:11:28.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd92d602640 1 -- 172.21.15.193:0/2575969793 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda2c025070 con 0x55ffc57a43b0 2024-09-12T17:11:28.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd92d602640 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 0x7fd91c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd92d602640 1 -- 172.21.15.193:0/2575969793 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fda2c051b70 con 0x55ffc57a43b0 2024-09-12T17:11:28.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda43b49640 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 0x7fd91c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda43b49640 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 0x7fd91c03bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e3f0 tx=0x7fda34003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ffc5785f00 con 0x55ffc57b1d60 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52246/0 (socket says 172.21.15.193:52246) 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda42b47640 1 -- 172.21.15.193:0/3969376191 learned_addr learned my addr 172.21.15.193:0/3969376191 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda42b47640 1 -- 172.21.15.193:0/3969376191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc57b2750 con 0x55ffc57b1d60 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda42b47640 1 --2- 172.21.15.193:0/3969376191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda2c04ffe0 tx=0x7fda2c01ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07eb25659e59954 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd926ffd640 1 -- 172.21.15.193:0/3969376191 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c045070 con 0x55ffc57b1d60 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd926ffd640 1 -- 172.21.15.193:0/3969376191 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c0263b0 con 0x55ffc57b1d60 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fd926ffd640 1 -- 172.21.15.193:0/3969376191 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c00dcc0 con 0x55ffc57b1d60 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- 172.21.15.193:0/3969376191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 msgr2=0x55ffc57b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 --2- 172.21.15.193:0/3969376191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fda2c04ffe0 tx=0x7fda2c01ae00 comp rx=0 tx=0).stop 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- 172.21.15.193:0/3969376191 shutdown_connections 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 --2- 172.21.15.193:0/3969376191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b2160 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- 172.21.15.193:0/3969376191 >> 172.21.15.193:0/3969376191 conn(0x55ffc57ad180 msgr2=0x55ffc57ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- 172.21.15.193:0/3969376191 shutdown_connections 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- 172.21.15.193:0/3969376191 wait complete. 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 Processor -- start 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- start start 2024-09-12T17:11:28.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.639+0000 7fda458429c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ffc57b0cb0 con 0x55ffc57b1d60 2024-09-12T17:11:28.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda42b47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52252/0 (socket says 172.21.15.193:52252) 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 learned_addr learned my addr 172.21.15.193:0/1484829168 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc57b8830 con 0x55ffc57b1d60 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda42b47640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda2c01af50 tx=0x7fda2c04ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 -- 172.21.15.193:0/1484829168 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c045070 con 0x55ffc57b1d60 2024-09-12T17:11:28.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ffc57b8ac0 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 -- 172.21.15.193:0/1484829168 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2c01a320 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 -- 172.21.15.193:0/1484829168 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda2c03a060 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc57b8ac0 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 -- 172.21.15.193:0/1484829168 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fda2c033070 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd90c039a20 0x7fd90c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fd9257fa640 1 -- 172.21.15.193:0/1484829168 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fda2c037080 con 0x55ffc57b1d60 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda43b49640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd90c039a20 0x7fd90c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc57c33c0 0x55ffc57c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c5fa0 con 0x55ffc57c33c0 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda43348640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc57c33c0 0x55ffc57c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda43b49640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd90c039a20 0x7fd90c03bee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda3400f010 tx=0x7fda3401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.643+0000 7fda43348640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc57c33c0 0x55ffc57c5850 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 realm 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c6400 con 0x55ffc57c33c0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c6cd0 con 0x55ffc57c33c0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c7070 con 0x55ffc57c33c0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c7510 con 0x55ffc57c33c0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 20 searching for the correct realm 2024-09-12T17:11:28.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ffc57c9480 0x55ffc57cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda42b47640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ffc57c9480 0x55ffc57cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda42b47640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ffc57c9480 0x55ffc57cb870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda42b47640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fda2c035070 0x7fda2c050a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43b49640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fda2c035070 0x7fda2c050a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43b49640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fda2c035070 0x7fda2c050a00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43b49640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fda34019040 0x7fda34019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fda34019040 0x7fda34019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.647+0000 7fda43348640 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fda34019040 0x7fda34019930 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.651+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.655+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c9480 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda34019040 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.659+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cbef0 con 0x7fda2c035070 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c7ef0 con 0x55ffc57c33c0 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c8790 con 0x55ffc57c33c0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c7b30 con 0x55ffc57c33c0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 zone default found 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 4 Realm: () 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:28.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 zonegroup default 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57c8790 con 0x7fda34019040 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cdd40 con 0x55ffc57c9480 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57ce0e0 con 0x55ffc57c9480 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 started sync module instance, tier type = 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.663+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cd1e0 con 0x7fda2c035070 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94557018314192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57ce930 con 0x7fda2c035070 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cf180 con 0x55ffc57c33c0 2024-09-12T17:11:28.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94557018314192] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94557018317952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57ced50 con 0x55ffc57c33c0 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.667+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cf830 con 0x55ffc57c9480 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94557018317952] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94557018319008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cecc0 con 0x55ffc57c9480 2024-09-12T17:11:28.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d0580 con 0x7fda2c035070 2024-09-12T17:11:28.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94557018325504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d0e20 con 0x7fda2c035070 2024-09-12T17:11:28.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.671+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d1820 con 0x55ffc57c33c0 2024-09-12T17:11:28.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.675+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94557018319008] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.675+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94557018325504] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.675+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.675+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94557018324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d0970 con 0x55ffc57c33c0 2024-09-12T17:11:28.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.675+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d20c0 con 0x7fda34019040 2024-09-12T17:11:28.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.679+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94557018324000] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.683+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.683+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94557018329904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d0970 con 0x7fda34019040 2024-09-12T17:11:28.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.683+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d2520 con 0x7fda34019040 2024-09-12T17:11:28.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.683+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94557018329904] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.687+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.687+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94557018333168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d24e0 con 0x7fda34019040 2024-09-12T17:11:28.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.687+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d2f00 con 0x7fda34019040 2024-09-12T17:11:28.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94557018333168] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94557018335728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d2ec0 con 0x7fda34019040 2024-09-12T17:11:28.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=0 2024-09-12T17:11:28.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=1 2024-09-12T17:11:28.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=2 2024-09-12T17:11:28.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=3 2024-09-12T17:11:28.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=4 2024-09-12T17:11:28.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=5 2024-09-12T17:11:28.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=6 2024-09-12T17:11:28.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94557018335728] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 20 add_watcher() i=7 2024-09-12T17:11:28.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:28.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d6350 con 0x55ffc57c33c0 2024-09-12T17:11:28.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.691+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94557018331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d3870 con 0x55ffc57c33c0 2024-09-12T17:11:28.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94557018331472] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fd8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 5 note: GC not initialized 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fd8f8fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:28.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:28.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 Filter name: none 2024-09-12T17:11:28.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fd8727fc640 20 reqs_thread_entry: start 2024-09-12T17:11:28.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57f9670 con 0x7fda2c035070 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57f9f00 con 0x55ffc57c9480 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57fb590 con 0x7fda2c035070 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57fb590 con 0x55ffc57c9480 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(65 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.695+0000 7fda458429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 4.3f 4:fd0a111d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57faf00 con 0x7fda2c035070 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 4.16 4:69bce75d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57ffee0 con 0x55ffc57c9480 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 4.1d 4:b875d38d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc5802a80 con 0x55ffc57c9480 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 4.10 4:0a81f2b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57faf00 con 0x55ffc57c9480 2024-09-12T17:11:28.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 4.7 4:e0a76df3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc5807b60 con 0x7fda34019040 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 4.2c 4:37088d08:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc580a030 con 0x55ffc57c33c0 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc580c860 con 0x55ffc57c33c0 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 4.1c 4:386218bb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc580f2a0 con 0x7fda34019040 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 4.38 4:1f0a6c2d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc580f730 con 0x55ffc57c33c0 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(69 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 4.36 4:6d69afdc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc5812070 con 0x55ffc57c33c0 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 4.15 4:a8462aa2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ffc58044b0 con 0x55ffc57c9480 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(71 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(70 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(74 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(75 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(68 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(76 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fd8f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.699+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94557018331472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57f7700 con 0x55ffc57c33c0 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94557018331472] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94557018314192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc580f6a0 con 0x7fda2c035070 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94557018314192] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 20 remove_watcher() i=0 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 2 removed watcher, disabling cache 2024-09-12T17:11:28.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94557018317952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cd5d0 con 0x55ffc57c33c0 2024-09-12T17:11:28.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94557018317952] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 20 remove_watcher() i=1 2024-09-12T17:11:28.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.703+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94557018319008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57ce480 con 0x55ffc57c9480 2024-09-12T17:11:28.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda42b47640 1 -- 172.21.15.193:0/1484829168 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94557018319008] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda2c05b040 con 0x55ffc57c9480 2024-09-12T17:11:28.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda458429c0 20 remove_watcher() i=2 2024-09-12T17:11:28.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94557018325504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cd5d0 con 0x7fda2c035070 2024-09-12T17:11:28.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda43b49640 1 -- 172.21.15.193:0/1484829168 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94557018325504] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3402f040 con 0x7fda2c035070 2024-09-12T17:11:28.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda458429c0 20 remove_watcher() i=3 2024-09-12T17:11:28.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.707+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94557018324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d01e0 con 0x55ffc57c33c0 2024-09-12T17:11:28.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94557018324000] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x55ffc57c33c0 2024-09-12T17:11:28.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda458429c0 20 remove_watcher() i=4 2024-09-12T17:11:28.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94557018329904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cfc20 con 0x7fda34019040 2024-09-12T17:11:28.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94557018329904] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda458429c0 20 remove_watcher() i=5 2024-09-12T17:11:28.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.711+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94557018333168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57cfc20 con 0x7fda34019040 2024-09-12T17:11:28.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94557018333168] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda458429c0 20 remove_watcher() i=6 2024-09-12T17:11:28.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94557018335728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ffc57d1ff0 con 0x7fda34019040 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94557018335728] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda3c0a9ce0 con 0x7fda34019040 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda458429c0 20 remove_watcher() i=7 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fda34019040 msgr2=0x7fda34019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.715+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fda34019040 0x7fda34019930 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc57c33c0 msgr2=0x55ffc57c5850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc57c33c0 0x55ffc57c5850 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fda2c035070 msgr2=0x7fda2c050a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fda2c035070 0x7fda2c050a00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ffc57c9480 msgr2=0x55ffc57cb870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ffc57c9480 0x55ffc57cb870 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd90c039a20 msgr2=0x7fd90c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd90c039a20 0x7fd90c03bee0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda3400f010 tx=0x7fda3401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 msgr2=0x55ffc57b82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda43348640 1 -- 172.21.15.193:0/1484829168 reap_dead start 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fda2c01af50 tx=0x7fda2c04ff10 comp rx=0 tx=0).stop 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 shutdown_connections 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1484829168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57b1d60 0x55ffc57b82d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 >> 172.21.15.193:0/1484829168 conn(0x55ffc57ad180 msgr2=0x55ffc57ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 shutdown_connections 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1484829168 wait complete. 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 msgr2=0x7fd91c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 0x7fd91c03bf30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e3f0 tx=0x7fda34003070 comp rx=0 tx=0).stop 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 msgr2=0x55ffc57a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e670 tx=0x7fda2c00ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 shutdown_connections 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd91c039a70 0x7fd91c03bf30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/2575969793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc57a43b0 0x55ffc57a47d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 >> 172.21.15.193:0/2575969793 conn(0x55ffc5799d60 msgr2=0x55ffc579a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 shutdown_connections 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/2575969793 wait complete. 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 msgr2=0x55ffc5793db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 0x55ffc5793db0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 msgr2=0x7fd92803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 0x7fd92803bf30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda2c001e90 tx=0x7fda2c0013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 msgr2=0x55ffc578cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fda3c018cc0 tx=0x7fda3c017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 shutdown_connections 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ffc569d170 0x55ffc5793db0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd928039a70 0x7fd92803bf30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 --2- 172.21.15.193:0/1128473941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ffc560e200 0x55ffc578cc40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 >> 172.21.15.193:0/1128473941 conn(0x55ffc5694920 msgr2=0x55ffc577fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 shutdown_connections 2024-09-12T17:11:28.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.719+0000 7fda458429c0 1 -- 172.21.15.193:0/1128473941 wait complete. 2024-09-12T17:11:28.734 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8d996106-34ba-42aa-8283-014f90bfb7e7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:11:27.908881Z","creation_time":"2024-09-12T17:11:27.903968Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T17:11:28.734 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:11:27.908881Z', 'creation_time': '2024-09-12T17:11:27.903968Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:11:28.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:11:28.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-12T17:11:28.734 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-12T17:11:28.815 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:28.816 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:28.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c37a1c9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb89e89af0 0x55bb89e89ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c37a1c9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb89dc79c0 con 0x55bb89e884f0 2024-09-12T17:11:28.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c37a1c9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55bb89e176d0 con 0x55bb89e89af0 2024-09-12T17:11:28.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c35522640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb89e89af0 0x55bb89e89ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c35522640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55bb89e89af0 0x55bb89e89ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52260/0 (socket says 172.21.15.193:52260) 2024-09-12T17:11:28.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.811+0000 7f3c35522640 1 -- 172.21.15.193:0/51085732 learned_addr learned my addr 172.21.15.193:0/51085732 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c35522640 1 -- 172.21.15.193:0/51085732 >> v1:172.21.15.62:6789/0 conn(0x55bb89e884f0 legacy=0x55bb89e88900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c35522640 1 -- 172.21.15.193:0/51085732 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb89dbbca0 con 0x55bb89e89af0 2024-09-12T17:11:28.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c35522640 1 --2- 172.21.15.193:0/51085732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e89af0 0x55bb89e89ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800a5c0 tx=0x7f3c2801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6285e10cfd0abf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c27fff640 1 -- 172.21.15.193:0/51085732 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280a6070 con 0x55bb89e89af0 2024-09-12T17:11:28.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c27fff640 1 -- 172.21.15.193:0/51085732 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c280af070 con 0x55bb89e89af0 2024-09-12T17:11:28.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c27fff640 1 -- 172.21.15.193:0/51085732 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280aa5c0 con 0x55bb89e89af0 2024-09-12T17:11:28.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/51085732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e89af0 msgr2=0x55bb89e89ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/51085732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e89af0 0x55bb89e89ed0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800a5c0 tx=0x7f3c2801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:28.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/51085732 shutdown_connections 2024-09-12T17:11:28.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/51085732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e89af0 0x55bb89e89ed0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/51085732 >> 172.21.15.193:0/51085732 conn(0x55bb89f0ead0 msgr2=0x55bb89f10ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/51085732 shutdown_connections 2024-09-12T17:11:28.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.815+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/51085732 wait complete. 2024-09-12T17:11:28.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb89e1b680 con 0x55bb89e884f0 2024-09-12T17:11:28.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c35522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c35522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52262/0 (socket says 172.21.15.193:52262) 2024-09-12T17:11:28.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c35522640 1 -- 172.21.15.193:0/3073856343 learned_addr learned my addr 172.21.15.193:0/3073856343 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c35522640 1 -- 172.21.15.193:0/3073856343 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb89d96da0 con 0x55bb89e884f0 2024-09-12T17:11:28.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c35522640 1 --2- 172.21.15.193:0/3073856343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3c28018f70 tx=0x7f3c28002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807f8380653c915 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3b23606640 1 -- 172.21.15.193:0/3073856343 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280aa9e0 con 0x55bb89e884f0 2024-09-12T17:11:28.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3b23606640 1 -- 172.21.15.193:0/3073856343 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c280aab80 con 0x55bb89e884f0 2024-09-12T17:11:28.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3b23606640 1 -- 172.21.15.193:0/3073856343 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280aae60 con 0x55bb89e884f0 2024-09-12T17:11:28.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3073856343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 msgr2=0x55bb8a000b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3073856343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3c28018f70 tx=0x7f3c28002fc0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3073856343 shutdown_connections 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3073856343 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a000b70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3073856343 >> 172.21.15.193:0/3073856343 conn(0x55bb89f0ead0 msgr2=0x55bb89ffc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3073856343 shutdown_connections 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3073856343 wait complete. 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.835+0000 7f3c37a1c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb89dbda50 con 0x55bb89e884f0 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52270/0 (socket says 172.21.15.193:52270) 2024-09-12T17:11:28.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35522640 1 -- 172.21.15.193:0/262214249 learned_addr learned my addr 172.21.15.193:0/262214249 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35522640 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8a008590 con 0x55bb89e884f0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35522640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801b170 tx=0x55bb89e89430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 -- 172.21.15.193:0/262214249 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280abec0 con 0x55bb89e884f0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb8a008820 con 0x55bb89e884f0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 -- 172.21.15.193:0/262214249 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c280c6690 con 0x55bb89e884f0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 -- 172.21.15.193:0/262214249 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c280c69b0 con 0x55bb89e884f0 2024-09-12T17:11:28.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8a0091d0 con 0x55bb89e884f0 2024-09-12T17:11:28.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 -- 172.21.15.193:0/262214249 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3c280ce030 con 0x55bb89e884f0 2024-09-12T17:11:28.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 0x7f3b1c03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3b21e03640 1 -- 172.21.15.193:0/262214249 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c280cc020 con 0x55bb89e884f0 2024-09-12T17:11:28.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c34d21640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 0x7f3b1c03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 0x55bb8a00f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a00f6e0 con 0x55bb89e89af0 2024-09-12T17:11:28.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c35d23640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 0x55bb8a00f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.839+0000 7f3c34d21640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 0x7f3b1c03c0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001e60 tx=0x7f3c2c0013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 0x55bb8a00f1a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 -- 172.21.15.193:0/262214249 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c3000a4d0 con 0x55bb89e89af0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a00fb20 con 0x55bb89e89af0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 -- 172.21.15.193:0/262214249 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c3000a4d0 con 0x55bb89e89af0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a011420 con 0x55bb89e89af0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 -- 172.21.15.193:0/262214249 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c3000a4d0 con 0x55bb89e89af0 2024-09-12T17:11:28.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a010560 con 0x55bb89e89af0 2024-09-12T17:11:28.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 -- 172.21.15.193:0/262214249 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c3000a4d0 con 0x55bb89e89af0 2024-09-12T17:11:28.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a010980 con 0x55bb89e89af0 2024-09-12T17:11:28.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c35d23640 1 -- 172.21.15.193:0/262214249 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3c3000a4d0 con 0x55bb89e89af0 2024-09-12T17:11:28.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c37a1c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb89e28450 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52278/0 (socket says 172.21.15.193:52278) 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c34d21640 1 -- 172.21.15.193:0/3257881770 learned_addr learned my addr 172.21.15.193:0/3257881770 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c34d21640 1 -- 172.21.15.193:0/3257881770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8a0201b0 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.843+0000 7f3c34d21640 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c010f90 tx=0x7f3c2c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 -- 172.21.15.193:0/3257881770 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c00a040 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb8a020a10 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 -- 172.21.15.193:0/3257881770 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c017050 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 -- 172.21.15.193:0/3257881770 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c00e7e0 con 0x55bb8a01f750 2024-09-12T17:11:28.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8a020f80 con 0x55bb8a01f750 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 -- 172.21.15.193:0/3257881770 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3c2c00e9d0 con 0x55bb8a01f750 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 0x7f3b0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b1affd640 1 -- 172.21.15.193:0/3257881770 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c2c0521c0 con 0x55bb8a01f750 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 0x7f3b0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 0x7f3b0c03bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55bb8a010900 tx=0x7f3c30005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c37a1c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb8a0012e0 con 0x55bb8a02d0e0 2024-09-12T17:11:28.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52292/0 (socket says 172.21.15.193:52292) 2024-09-12T17:11:28.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c34d21640 1 -- 172.21.15.193:0/488250099 learned_addr learned my addr 172.21.15.193:0/488250099 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c34d21640 1 -- 172.21.15.193:0/488250099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8a02dad0 con 0x55bb8a02d0e0 2024-09-12T17:11:28.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3c34d21640 1 --2- 172.21.15.193:0/488250099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c050510 tx=0x7f3c2c01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf1d6ddaae1c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b18ff9640 1 -- 172.21.15.193:0/488250099 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c025e20 con 0x55bb8a02d0e0 2024-09-12T17:11:28.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b18ff9640 1 -- 172.21.15.193:0/488250099 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c024360 con 0x55bb8a02d0e0 2024-09-12T17:11:28.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.847+0000 7f3b18ff9640 1 -- 172.21.15.193:0/488250099 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c01caa0 con 0x55bb8a02d0e0 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/488250099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 msgr2=0x55bb8a02d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/488250099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c050510 tx=0x7f3c2c01aa60 comp rx=0 tx=0).stop 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/488250099 shutdown_connections 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/488250099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a02d4e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/488250099 >> 172.21.15.193:0/488250099 conn(0x55bb8a028500 msgr2=0x55bb8a026740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/488250099 shutdown_connections 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/488250099 wait complete. 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 Processor -- start 2024-09-12T17:11:28.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- start start 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55bb8a02c030 con 0x55bb8a02d0e0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c34d21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52308/0 (socket says 172.21.15.193:52308) 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 learned_addr learned my addr 172.21.15.193:0/3984529695 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb8a033be0 con 0x55bb8a02d0e0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c34d21640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c01af20 tx=0x7f3c2c0504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3b0affd640 1 -- 172.21.15.193:0/3984529695 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c024360 con 0x55bb8a02d0e0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb8a033e70 con 0x55bb8a02d0e0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3b0affd640 1 -- 172.21.15.193:0/3984529695 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c2c025e20 con 0x55bb8a02d0e0 2024-09-12T17:11:28.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb8a034820 con 0x55bb8a02d0e0 2024-09-12T17:11:28.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3b0affd640 1 -- 172.21.15.193:0/3984529695 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c2c01c410 con 0x55bb8a02d0e0 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.851+0000 7f3b0affd640 1 -- 172.21.15.193:0/3984529695 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3c2c036060 con 0x55bb8a02d0e0 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3b0affd640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b00039a70 0x7f3b0003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3b0affd640 1 -- 172.21.15.193:0/3984529695 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f3c2c039c40 con 0x55bb8a02d0e0 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b00039a70 0x7f3b0003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb8a03e990 0x55bb8a040e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a041570 con 0x55bb8a03e990 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb8a03e990 0x55bb8a040e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b00039a70 0x7f3b0003bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55bb8a010080 tx=0x7f3c3001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb8a03e990 0x55bb8a040e20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 realm 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a041980 con 0x55bb8a03e990 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a042250 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0425f0 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a042e40 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:28.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 20 searching for the correct realm 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bb8a044bb0 0x55bb8a046fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c34d21640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bb8a044bb0 0x55bb8a046fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c34d21640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bb8a044bb0 0x55bb8a046fa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c34d21640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3c2c01c030 0x7f3c2c023760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3c2c01c030 0x7f3c2c023760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.855+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3c2c01c030 0x7f3c2c023760 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35d23640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3c30031040 0x7f3c30032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3c30031040 0x7f3c30032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3c30031040 0x7f3c30032940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.859+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.863+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.867+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a044bb0 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c30031040 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x55bb8a03e990 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0474e0 con 0x7f3c2c01c030 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c3001f070 con 0x7f3c2c01c030 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a043780 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0433c0 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a044120 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 zone default found 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 4 Realm: () 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:28.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:28.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:28.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 zonegroup default 2024-09-12T17:11:28.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a047910 con 0x7f3c30031040 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a049480 con 0x55bb8a044bb0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.871+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a049930 con 0x55bb8a044bb0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 20 started sync module instance, tier type = 2024-09-12T17:11:28.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0487a0 con 0x7f3c2c01c030 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94263962798992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04a240 con 0x7f3c2c01c030 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04aa90 con 0x55bb8a03e990 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94263962798992] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.875+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.879+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94263962803600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04a700 con 0x55bb8a03e990 2024-09-12T17:11:28.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.879+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04b220 con 0x55bb8a044bb0 2024-09-12T17:11:28.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.879+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94263962803600] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94263962807536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04b610 con 0x55bb8a044bb0 2024-09-12T17:11:28.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04bfd0 con 0x7f3c2c01c030 2024-09-12T17:11:28.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94263962811440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04c6c0 con 0x7f3c2c01c030 2024-09-12T17:11:28.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04d1e0 con 0x55bb8a03e990 2024-09-12T17:11:28.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94263962811440] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.883+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94263962807536] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.887+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.887+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94263962804656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04d1a0 con 0x55bb8a03e990 2024-09-12T17:11:28.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.887+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04da80 con 0x7f3c30031040 2024-09-12T17:11:28.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.891+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94263962804656] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.891+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.891+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94263962815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04d1a0 con 0x7f3c30031040 2024-09-12T17:11:28.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.891+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04df20 con 0x7f3c30031040 2024-09-12T17:11:28.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.895+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94263962815664] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.895+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.895+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94263962817920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04de50 con 0x7f3c30031040 2024-09-12T17:11:28.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.895+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04e8d0 con 0x7f3c30031040 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94263962817920] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94263962821568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04ed40 con 0x7f3c30031040 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=0 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=1 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=2 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=3 2024-09-12T17:11:28.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=4 2024-09-12T17:11:28.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=5 2024-09-12T17:11:28.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.899+0000 7f3c37a1c9c0 20 add_watcher() i=6 2024-09-12T17:11:28.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94263962821568] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 20 add_watcher() i=7 2024-09-12T17:11:28.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:28.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04ed40 con 0x55bb8a03e990 2024-09-12T17:11:28.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94263962822800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04ecb0 con 0x55bb8a03e990 2024-09-12T17:11:28.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94263962822800] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3aebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:28.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:28.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 5 note: GC not initialized 2024-09-12T17:11:28.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3aeafe5640 20 reqs_thread_entry: start 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.903+0000 7f3c37a1c9c0 20 Filter name: none 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3ae8fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a074af0 con 0x55bb8a03e990 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a075510 con 0x55bb8a03e990 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:28.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a076520 con 0x7f3c2c01c030 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a073c70 con 0x7f3c2c01c030 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a076520 con 0x55bb8a044bb0 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 4.3f 4:fd0a111d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a075dd0 con 0x7f3c2c01c030 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 4.16 4:69bce75d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a07adb0 con 0x55bb8a044bb0 2024-09-12T17:11:28.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 4.1d 4:b875d38d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a07d6b0 con 0x55bb8a044bb0 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 4.10 4:0a81f2b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0800d0 con 0x55bb8a044bb0 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 4.7 4:e0a76df3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a082ae0 con 0x7f3c30031040 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(67 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 4.2c 4:37088d08:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a082ae0 con 0x55bb8a03e990 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(69 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a082ae0 con 0x55bb8a03e990 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(70 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 4.1c 4:386218bb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a07fc90 con 0x7f3c30031040 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 4.38 4:1f0a6c2d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a07a800 con 0x55bb8a03e990 2024-09-12T17:11:28.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 4.36 4:6d69afdc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a086470 con 0x55bb8a03e990 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 4.15 4:a8462aa2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0892a0 con 0x55bb8a044bb0 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(72 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(73 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(75 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(77 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(76 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.907+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(74 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3aebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94263962822800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a0892a0 con 0x55bb8a03e990 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94263962822800] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94263962798992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04e890 con 0x7f3c2c01c030 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94263962798992] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c37a1c9c0 20 remove_watcher() i=0 2024-09-12T17:11:28.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c37a1c9c0 2 removed watcher, disabling cache 2024-09-12T17:11:28.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.911+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94263962803600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a048b90 con 0x55bb8a03e990 2024-09-12T17:11:28.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.915+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94263962803600] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.915+0000 7f3c37a1c9c0 20 remove_watcher() i=1 2024-09-12T17:11:28.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.915+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94263962807536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04e890 con 0x55bb8a044bb0 2024-09-12T17:11:28.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c34d21640 1 -- 172.21.15.193:0/3984529695 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94263962807536] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c2c04a050 con 0x55bb8a044bb0 2024-09-12T17:11:28.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 20 remove_watcher() i=2 2024-09-12T17:11:28.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94263962811440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a049d90 con 0x7f3c2c01c030 2024-09-12T17:11:28.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c35d23640 1 -- 172.21.15.193:0/3984529695 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94263962811440] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c30040040 con 0x7f3c2c01c030 2024-09-12T17:11:28.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 20 remove_watcher() i=3 2024-09-12T17:11:28.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94263962804656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a048b90 con 0x55bb8a03e990 2024-09-12T17:11:28.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94263962804656] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x55bb8a03e990 2024-09-12T17:11:28.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 20 remove_watcher() i=4 2024-09-12T17:11:28.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.919+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94263962815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04e890 con 0x7f3c30031040 2024-09-12T17:11:28.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.923+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94263962815664] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.923+0000 7f3c37a1c9c0 20 remove_watcher() i=5 2024-09-12T17:11:28.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.923+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94263962817920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04a240 con 0x7f3c30031040 2024-09-12T17:11:28.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94263962817920] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 20 remove_watcher() i=6 2024-09-12T17:11:28.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94263962821568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bb8a04bc30 con 0x7f3c30031040 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94263962821568] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3c280d0d10 con 0x7f3c30031040 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 20 remove_watcher() i=7 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3c30031040 msgr2=0x7f3c30032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3c30031040 0x7f3c30032940 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb8a03e990 msgr2=0x55bb8a040e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb8a03e990 0x55bb8a040e20 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3c2c01c030 msgr2=0x7f3c2c023760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3c2c01c030 0x7f3c2c023760 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bb8a044bb0 msgr2=0x55bb8a046fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55bb8a044bb0 0x55bb8a046fa0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b00039a70 msgr2=0x7f3b0003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b00039a70 0x7f3b0003bf30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55bb8a010080 tx=0x7f3c3001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c35522640 1 -- 172.21.15.193:0/3984529695 reap_dead start 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 msgr2=0x55bb8a033680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c01af20 tx=0x7f3c2c0504a0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 shutdown_connections 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3984529695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a02d0e0 0x55bb8a033680 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 >> 172.21.15.193:0/3984529695 conn(0x55bb8a028500 msgr2=0x55bb8a026710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 shutdown_connections 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.927+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3984529695 wait complete. 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 msgr2=0x7f3b0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 0x7f3b0c03bf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55bb8a010900 tx=0x7f3c30005850 comp rx=0 tx=0).stop 2024-09-12T17:11:28.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 msgr2=0x55bb8a01fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c010f90 tx=0x7f3c2c00f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 shutdown_connections 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b0c039a70 0x7f3b0c03bf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/3257881770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb8a01f750 0x55bb8a01fb70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 >> 172.21.15.193:0/3257881770 conn(0x55bb8a015100 msgr2=0x55bb8a0154e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 shutdown_connections 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/3257881770 wait complete. 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 msgr2=0x55bb8a00f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 0x55bb8a00f1a0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 msgr2=0x7f3b1c03c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 0x7f3b1c03c0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001e60 tx=0x7f3c2c0013e0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 msgr2=0x55bb8a008030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:28.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3c2801b170 tx=0x55bb89e89430 comp rx=0 tx=0).stop 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 shutdown_connections 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55bb89e89af0 0x55bb8a00f1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3b1c039c10 0x7f3b1c03c0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 --2- 172.21.15.193:0/262214249 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55bb89e884f0 0x55bb8a008030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 >> 172.21.15.193:0/262214249 conn(0x55bb89f0ead0 msgr2=0x55bb89ffb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 shutdown_connections 2024-09-12T17:11:28.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:28.931+0000 7f3c37a1c9c0 1 -- 172.21.15.193:0/262214249 wait complete. 2024-09-12T17:11:28.945 INFO:teuthology.orchestra.run.smithi193.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8d996106-34ba-42aa-8283-014f90bfb7e7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:11:27.908881Z","creation_time":"2024-09-12T17:11:27.903968Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-12T17:11:28.946 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:11:27.908881Z', 'creation_time': '2024-09-12T17:11:27.903968Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T17:11:28.956 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:11:28.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:28.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:28.957 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:11:29.022 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.022 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68dcb29c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558040ccf240 0x558040d5dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68dcb29c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558040c0f9c0 con 0x558040d5e130 2024-09-12T17:11:29.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68dcb29c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558040c5f6d0 con 0x558040ccf240 2024-09-12T17:11:29.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68b7b8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558040ccf240 0x558040d5dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68b7b8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558040ccf240 0x558040d5dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52314/0 (socket says 172.21.15.193:52314) 2024-09-12T17:11:29.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68afb7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x558040d5e130 0x558040d60520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36640/0 (socket says 172.21.15.193:36640) 2024-09-12T17:11:29.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68b7b8640 1 -- 172.21.15.193:0/3187950020 learned_addr learned my addr 172.21.15.193:0/3187950020 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68b7b8640 1 -- 172.21.15.193:0/3187950020 >> v1:172.21.15.62:6789/0 conn(0x558040d5e130 legacy=0x558040d60520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.019+0000 7fd68b7b8640 1 -- 172.21.15.193:0/3187950020 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040c03ca0 con 0x558040ccf240 2024-09-12T17:11:29.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/3187950020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5dbf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd68400a4e0 tx=0x7fd68401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600e2bd4848813b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68a7b6640 1 -- 172.21.15.193:0/3187950020 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840aa540 con 0x558040ccf240 2024-09-12T17:11:29.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68a7b6640 1 -- 172.21.15.193:0/3187950020 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840aa6e0 con 0x558040ccf240 2024-09-12T17:11:29.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68a7b6640 1 -- 172.21.15.193:0/3187950020 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840aaa40 con 0x558040ccf240 2024-09-12T17:11:29.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3187950020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 msgr2=0x558040d5dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/3187950020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5dbf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd68400a4e0 tx=0x7fd68401b090 comp rx=0 tx=0).stop 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3187950020 shutdown_connections 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/3187950020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5dbf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3187950020 >> 172.21.15.193:0/3187950020 conn(0x558040d55920 msgr2=0x558040d57d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3187950020 shutdown_connections 2024-09-12T17:11:29.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.023+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3187950020 wait complete. 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68dcb29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68dcb29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558040c63680 con 0x558040ccf240 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68b7b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68b7b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52326/0 (socket says 172.21.15.193:52326) 2024-09-12T17:11:29.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68b7b8640 1 -- 172.21.15.193:0/3681915192 learned_addr learned my addr 172.21.15.193:0/3681915192 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68b7b8640 1 -- 172.21.15.193:0/3681915192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040bdeda0 con 0x558040ccf240 2024-09-12T17:11:29.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.039+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/3681915192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd684017ca0 tx=0x7fd6840033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc799461b215d8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd57960a640 1 -- 172.21.15.193:0/3681915192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840b9030 con 0x558040ccf240 2024-09-12T17:11:29.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd57960a640 1 -- 172.21.15.193:0/3681915192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840aaa80 con 0x558040ccf240 2024-09-12T17:11:29.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd57960a640 1 -- 172.21.15.193:0/3681915192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840aada0 con 0x558040ccf240 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3681915192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 msgr2=0x558040e467c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/3681915192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd684017ca0 tx=0x7fd6840033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3681915192 shutdown_connections 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/3681915192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040e467c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3681915192 >> 172.21.15.193:0/3681915192 conn(0x558040d55920 msgr2=0x558040e42400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3681915192 shutdown_connections 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/3681915192 wait complete. 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558040c05a50 con 0x558040ccf240 2024-09-12T17:11:29.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68b7b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68b7b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52342/0 (socket says 172.21.15.193:52342) 2024-09-12T17:11:29.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68b7b8640 1 -- 172.21.15.193:0/4082592006 learned_addr learned my addr 172.21.15.193:0/4082592006 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68b7b8640 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040d5b830 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd68401b930 tx=0x7fd684017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd577e07640 1 -- 172.21.15.193:0/4082592006 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840b9070 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558040d59c10 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd577e07640 1 -- 172.21.15.193:0/4082592006 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6840c3030 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd577e07640 1 -- 172.21.15.193:0/4082592006 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6840b5c40 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.043+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558040d5a1a0 con 0x558040ccf240 2024-09-12T17:11:29.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd577e07640 1 -- 172.21.15.193:0/4082592006 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd6840b3040 con 0x558040ccf240 2024-09-12T17:11:29.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd577e07640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 0x7fd57003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd577e07640 1 -- 172.21.15.193:0/4082592006 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd6840ba070 con 0x558040ccf240 2024-09-12T17:11:29.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68afb7640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 0x7fd57003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 0x558040e57100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e57640 con 0x558040d5e130 2024-09-12T17:11:29.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 0x558040e57100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68afb7640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 0x7fd57003bf30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd674001e40 tx=0x7fd6740013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 0x558040e57100 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 -- 172.21.15.193:0/4082592006 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd67c0083f0 con 0x558040d5e130 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e57a20 con 0x558040d5e130 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 -- 172.21.15.193:0/4082592006 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd67c0083f0 con 0x558040d5e130 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e59320 con 0x558040d5e130 2024-09-12T17:11:29.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 -- 172.21.15.193:0/4082592006 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd67c0083f0 con 0x558040d5e130 2024-09-12T17:11:29.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e58550 con 0x558040d5e130 2024-09-12T17:11:29.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 -- 172.21.15.193:0/4082592006 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd67c0083f0 con 0x558040d5e130 2024-09-12T17:11:29.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e589a0 con 0x558040d5e130 2024-09-12T17:11:29.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68bfb9640 1 -- 172.21.15.193:0/4082592006 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd67c0083f0 con 0x558040d5e130 2024-09-12T17:11:29.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.047+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558040c70450 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52352/0 (socket says 172.21.15.193:52352) 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68afb7640 1 -- 172.21.15.193:0/1755956718 learned_addr learned my addr 172.21.15.193:0/1755956718 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68afb7640 1 -- 172.21.15.193:0/1755956718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040e68080 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68afb7640 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e670 tx=0x7fd67400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 -- 172.21.15.193:0/1755956718 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674022070 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558040e688e0 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 -- 172.21.15.193:0/1755956718 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67400d660 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558040e68e50 con 0x558040e67620 2024-09-12T17:11:29.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 -- 172.21.15.193:0/1755956718 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674006070 con 0x558040e67620 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 -- 172.21.15.193:0/1755956718 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd674025070 con 0x558040e67620 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 0x7fd56403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd575602640 1 -- 172.21.15.193:0/1755956718 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd674051b00 con 0x558040e67620 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 0x7fd56403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68dcb29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558040e46f50 con 0x558040e73f80 2024-09-12T17:11:29.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.051+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 0x7fd56403bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00e3f0 tx=0x7fd67c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52354/0 (socket says 172.21.15.193:52354) 2024-09-12T17:11:29.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 -- 172.21.15.193:0/185646936 learned_addr learned my addr 172.21.15.193:0/185646936 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 -- 172.21.15.193:0/185646936 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040e74930 con 0x558040e73f80 2024-09-12T17:11:29.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- 172.21.15.193:0/185646936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd67404fe50 tx=0x7fd67404ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58044e07a52e0732 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56effd640 1 -- 172.21.15.193:0/185646936 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674024cd0 con 0x558040e73f80 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56effd640 1 -- 172.21.15.193:0/185646936 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6740263b0 con 0x558040e73f80 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56effd640 1 -- 172.21.15.193:0/185646936 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd67400dcc0 con 0x558040e73f80 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/185646936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 msgr2=0x558040e74360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/185646936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd67404fe50 tx=0x7fd67404ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:29.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/185646936 shutdown_connections 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/185646936 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e74360 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/185646936 >> 172.21.15.193:0/185646936 conn(0x558040e703b0 msgr2=0x558040e6e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/185646936 shutdown_connections 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/185646936 wait complete. 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 Processor -- start 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- start start 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558040e74f90 con 0x558040e73f80 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52358/0 (socket says 172.21.15.193:52358) 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 learned_addr learned my addr 172.21.15.193:0/290329897 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558040e7ba50 con 0x558040e73f80 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68afb7640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd67404ffd0 tx=0x7fd67404fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56d7fa640 1 -- 172.21.15.193:0/290329897 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd674025c40 con 0x558040e73f80 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558040e7ba50 con 0x558040e73f80 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56d7fa640 1 -- 172.21.15.193:0/290329897 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674047030 con 0x558040e73f80 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.055+0000 7fd56d7fa640 1 -- 172.21.15.193:0/290329897 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd67401b8c0 con 0x558040e73f80 2024-09-12T17:11:29.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558040e7ba50 con 0x558040e73f80 2024-09-12T17:11:29.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd56d7fa640 1 -- 172.21.15.193:0/290329897 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd67401ba60 con 0x558040e73f80 2024-09-12T17:11:29.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd56d7fa640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd554039a70 0x7fd55403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd56d7fa640 1 -- 172.21.15.193:0/290329897 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fd674029080 con 0x558040e73f80 2024-09-12T17:11:29.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd554039a70 0x7fd55403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040e86420 0x558040e88870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e88fc0 con 0x558040e86420 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040e86420 0x558040e88870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd554039a70 0x7fd55403bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00f010 tx=0x7fd67c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040e86420 0x558040e88870 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 realm 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e893d0 con 0x558040e86420 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e89ca0 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8a040 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8a4e0 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:29.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 20 searching for the correct realm 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558040e8c450 0x558040e8e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.059+0000 7fd68afb7640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558040e8c450 0x558040e8e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68afb7640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558040e8c450 0x558040e8e840 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68afb7640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd674041040 0x7fd674041850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd674041040 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd674041040 0x7fd674041850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd674041040 0x7fd674041850 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68bfb9640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd67c019040 0x7fd67c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd67c019040 0x7fd67c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd67c019040 0x7fd67c019930 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.063+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd674041040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd674041040 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.067+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e8c450 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x558040e86420 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558040e8eec0 con 0x7fd67c019040 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x558040e8c450 2024-09-12T17:11:29.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd674041040 2024-09-12T17:11:29.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x558040e86420 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.071+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd67c019040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x558040e8c450 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd67c019040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd674041040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x558040e8c450 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd67c019040 2024-09-12T17:11:29.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x558040e86420 2024-09-12T17:11:29.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd6840f4040 con 0x7fd674041040 2024-09-12T17:11:29.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:29.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8aec0 con 0x558040e86420 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8ab00 con 0x558040e86420 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8b7e0 con 0x558040e86420 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.075+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 zone default found 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 4 Realm: () 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 zonegroup default 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e8b7e0 con 0x7fd67c019040 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e90d10 con 0x558040e8c450 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e910b0 con 0x558040e8c450 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 started sync module instance, tier type = 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:29.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e901b0 con 0x7fd674041040 2024-09-12T17:11:29.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009333188000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e91900 con 0x7fd674041040 2024-09-12T17:11:29.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e92150 con 0x558040e86420 2024-09-12T17:11:29.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.079+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009333188000] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.083+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.083+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009333191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e91dc0 con 0x558040e86420 2024-09-12T17:11:29.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.083+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e928c0 con 0x558040e8c450 2024-09-12T17:11:29.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.083+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009333191760] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009333195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e92ce0 con 0x558040e8c450 2024-09-12T17:11:29.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e936a0 con 0x7fd674041040 2024-09-12T17:11:29.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009333199616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e93d90 con 0x7fd674041040 2024-09-12T17:11:29.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.087+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e94890 con 0x558040e86420 2024-09-12T17:11:29.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.091+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009333195696] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.091+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009333199616] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.091+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.091+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009333203840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e94850 con 0x558040e86420 2024-09-12T17:11:29.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.091+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e95160 con 0x7fd67c019040 2024-09-12T17:11:29.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.095+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009333203840] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.099+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.099+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009333192816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e94850 con 0x7fd67c019040 2024-09-12T17:11:29.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.099+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e95600 con 0x7fd67c019040 2024-09-12T17:11:29.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.099+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009333192816] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.103+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.103+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009333206112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e95530 con 0x7fd67c019040 2024-09-12T17:11:29.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.103+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e95fe0 con 0x7fd67c019040 2024-09-12T17:11:29.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.103+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009333209792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e96490 con 0x7fd67c019040 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=0 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=1 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=2 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=3 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=4 2024-09-12T17:11:29.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=5 2024-09-12T17:11:29.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009333206112] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=6 2024-09-12T17:11:29.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009333209792] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 20 add_watcher() i=7 2024-09-12T17:11:29.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:29.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040e95080 con 0x558040e86420 2024-09-12T17:11:29.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.107+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009333207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040e96930 con 0x558040e86420 2024-09-12T17:11:29.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009333207168] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:29.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:29.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 5 note: GC not initialized 2024-09-12T17:11:29.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd540fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:29.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:29.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 Filter name: none 2024-09-12T17:11:29.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd4ba7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:29.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ebc7c0 con 0x7fd674041040 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ebd050 con 0x558040e8c450 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ebe6b0 con 0x7fd674041040 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:29.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ebe6b0 con 0x558040e8c450 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(65 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 4.3f 4:fd0a111d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ebdde0 con 0x7fd674041040 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 4.16 4:69bce75d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ec2fd0 con 0x558040e8c450 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 4.1d 4:b875d38d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ec5840 con 0x558040e8c450 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 4.10 4:0a81f2b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ec8210 con 0x558040e8c450 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 4.7 4:e0a76df3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ecae10 con 0x7fd67c019040 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 4.2c 4:37088d08:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ecd680 con 0x558040e86420 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ecff30 con 0x558040e86420 2024-09-12T17:11:29.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 4.1c 4:386218bb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd67c019040 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 4.38 4:1f0a6c2d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ed5c60 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 4.36 4:6d69afdc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040ed8b20 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 4.15 4:a8462aa2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558040edb990 con 0x558040e8c450 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.111+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(68 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(69 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(71 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(76 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(74 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(75 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(70 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009333207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed5c60 con 0x558040e86420 2024-09-12T17:11:29.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94009333207168] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009333188000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd674041040 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94009333188000] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68dcb29c0 20 remove_watcher() i=0 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68dcb29c0 2 removed watcher, disabling cache 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.115+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009333191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x558040e86420 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.119+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94009333191760] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.119+0000 7fd68dcb29c0 20 remove_watcher() i=1 2024-09-12T17:11:29.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.119+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009333195696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x558040e8c450 2024-09-12T17:11:29.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68afb7640 1 -- 172.21.15.193:0/290329897 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94009333195696] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd674051050 con 0x558040e8c450 2024-09-12T17:11:29.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 20 remove_watcher() i=2 2024-09-12T17:11:29.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009333199616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd674041040 2024-09-12T17:11:29.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68bfb9640 1 -- 172.21.15.193:0/290329897 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94009333199616] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd67c02f040 con 0x7fd674041040 2024-09-12T17:11:29.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 20 remove_watcher() i=3 2024-09-12T17:11:29.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009333203840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x558040e86420 2024-09-12T17:11:29.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94009333203840] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x558040e86420 2024-09-12T17:11:29.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 20 remove_watcher() i=4 2024-09-12T17:11:29.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.123+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009333192816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd67c019040 2024-09-12T17:11:29.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94009333192816] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68dcb29c0 20 remove_watcher() i=5 2024-09-12T17:11:29.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009333206112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd67c019040 2024-09-12T17:11:29.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94009333206112] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68dcb29c0 20 remove_watcher() i=6 2024-09-12T17:11:29.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.127+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009333209792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558040ed2df0 con 0x7fd67c019040 2024-09-12T17:11:29.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94009333209792] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6840e7040 con 0x7fd67c019040 2024-09-12T17:11:29.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 20 remove_watcher() i=7 2024-09-12T17:11:29.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd67c019040 msgr2=0x7fd67c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd67c019040 0x7fd67c019930 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040e86420 msgr2=0x558040e88870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040e86420 0x558040e88870 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd674041040 msgr2=0x7fd674041850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd674041040 0x7fd674041850 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558040e8c450 msgr2=0x558040e8e840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558040e8c450 0x558040e8e840 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd554039a70 msgr2=0x7fd55403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd554039a70 0x7fd55403bf30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00f010 tx=0x7fd67c01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68b7b8640 1 -- 172.21.15.193:0/290329897 reap_dead start 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 msgr2=0x558040e7b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd67404ffd0 tx=0x7fd67404fde0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 shutdown_connections 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/290329897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e73f80 0x558040e7b4f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 >> 172.21.15.193:0/290329897 conn(0x558040e703b0 msgr2=0x558040e6e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 shutdown_connections 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/290329897 wait complete. 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 msgr2=0x7fd56403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 0x7fd56403bf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00e3f0 tx=0x7fd67c003070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 msgr2=0x558040e67a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e670 tx=0x7fd67400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 shutdown_connections 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd564039a70 0x7fd56403bf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/1755956718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040e67620 0x558040e67a40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 >> 172.21.15.193:0/1755956718 conn(0x558040e5cfd0 msgr2=0x558040e5d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 shutdown_connections 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/1755956718 wait complete. 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 msgr2=0x558040e57100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 0x558040e57100 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 msgr2=0x7fd57003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 0x7fd57003bf30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd674001e40 tx=0x7fd6740013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 msgr2=0x558040d5b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd68401b930 tx=0x7fd684017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 shutdown_connections 2024-09-12T17:11:29.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558040d5e130 0x558040e57100 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd570039a70 0x7fd57003bf30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 --2- 172.21.15.193:0/4082592006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558040ccf240 0x558040d5b2d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 >> 172.21.15.193:0/4082592006 conn(0x558040d55920 msgr2=0x558040e40e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.131+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 shutdown_connections 2024-09-12T17:11:29.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.135+0000 7fd68dcb29c0 1 -- 172.21.15.193:0/4082592006 wait complete. 2024-09-12T17:11:29.148 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8d996106-34ba-42aa-8283-014f90bfb7e7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:11:27.908881Z","creation_time":"2024-09-12T17:11:27.903968Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-12T17:11:29.148 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:11:27.908881Z', 'creation_time': '2024-09-12T17:11:27.903968Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:11:29.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T17:11:29.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-12T17:11:29.149 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-12T17:11:29.225 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.225 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f87604319c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d52167fdf0 0x55d5216801d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f87604319c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5215359c0 con 0x55d521682fd0 2024-09-12T17:11:29.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f87604319c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d5215856d0 con 0x55d52167fdf0 2024-09-12T17:11:29.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875df37640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d52167fdf0 0x55d5216801d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875df37640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d52167fdf0 0x55d5216801d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52362/0 (socket says 172.21.15.193:52362) 2024-09-12T17:11:29.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875d736640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d521682fd0 0x55d5216853c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36656/0 (socket says 172.21.15.193:36656) 2024-09-12T17:11:29.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875df37640 1 -- 172.21.15.193:0/317228637 learned_addr learned my addr 172.21.15.193:0/317228637 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875df37640 1 -- 172.21.15.193:0/317228637 >> v1:172.21.15.62:6789/0 conn(0x55d521682fd0 legacy=0x55d5216853c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.223+0000 7f875df37640 1 -- 172.21.15.193:0/317228637 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d521529ca0 con 0x55d52167fdf0 2024-09-12T17:11:29.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f875df37640 1 --2- 172.21.15.193:0/317228637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d5216801d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f875000a5c0 tx=0x7f875001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10abaabb29fd5dce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f875cf35640 1 -- 172.21.15.193:0/317228637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500a6070 con 0x55d52167fdf0 2024-09-12T17:11:29.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f875cf35640 1 -- 172.21.15.193:0/317228637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87500af070 con 0x55d52167fdf0 2024-09-12T17:11:29.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f875cf35640 1 -- 172.21.15.193:0/317228637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500aa5c0 con 0x55d52167fdf0 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 -- 172.21.15.193:0/317228637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 msgr2=0x55d5216801d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 --2- 172.21.15.193:0/317228637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d5216801d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f875000a5c0 tx=0x7f875001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 -- 172.21.15.193:0/317228637 shutdown_connections 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 --2- 172.21.15.193:0/317228637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d5216801d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 -- 172.21.15.193:0/317228637 >> 172.21.15.193:0/317228637 conn(0x55d52167b910 msgr2=0x55d52167dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 -- 172.21.15.193:0/317228637 shutdown_connections 2024-09-12T17:11:29.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.227+0000 7f87604319c0 1 -- 172.21.15.193:0/317228637 wait complete. 2024-09-12T17:11:29.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f87604319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f87604319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d521589680 con 0x55d52167fdf0 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f875df37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f875df37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52370/0 (socket says 172.21.15.193:52370) 2024-09-12T17:11:29.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f875df37640 1 -- 172.21.15.193:0/1914270649 learned_addr learned my addr 172.21.15.193:0/1914270649 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f875df37640 1 -- 172.21.15.193:0/1914270649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d521504da0 con 0x55d52167fdf0 2024-09-12T17:11:29.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f875df37640 1 --2- 172.21.15.193:0/1914270649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8750018f70 tx=0x7f8750003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8c7f579bcaab9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f864be07640 1 -- 172.21.15.193:0/1914270649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500aa8b0 con 0x55d52167fdf0 2024-09-12T17:11:29.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f864be07640 1 -- 172.21.15.193:0/1914270649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87500aaa50 con 0x55d52167fdf0 2024-09-12T17:11:29.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.243+0000 7f864be07640 1 -- 172.21.15.193:0/1914270649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500aad30 con 0x55d52167fdf0 2024-09-12T17:11:29.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/1914270649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 msgr2=0x55d52176a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 --2- 172.21.15.193:0/1914270649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8750018f70 tx=0x7f8750003030 comp rx=0 tx=0).stop 2024-09-12T17:11:29.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/1914270649 shutdown_connections 2024-09-12T17:11:29.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 --2- 172.21.15.193:0/1914270649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d52176a4a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/1914270649 >> 172.21.15.193:0/1914270649 conn(0x55d52167b910 msgr2=0x55d5217660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/1914270649 shutdown_connections 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/1914270649 wait complete. 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d52152ba50 con 0x55d52167fdf0 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f875df37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f875df37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52382/0 (socket says 172.21.15.193:52382) 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f875df37640 1 -- 172.21.15.193:0/2516980819 learned_addr learned my addr 172.21.15.193:0/2516980819 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f875df37640 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d521771f70 con 0x55d52167fdf0 2024-09-12T17:11:29.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f875df37640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8750018f70 tx=0x7f87500180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f864a604640 1 -- 172.21.15.193:0/2516980819 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500c6690 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d521772200 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f864a604640 1 -- 172.21.15.193:0/2516980819 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87500c6830 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f864a604640 1 -- 172.21.15.193:0/2516980819 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87500c6b10 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d521772bb0 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.247+0000 7f864a604640 1 -- 172.21.15.193:0/2516980819 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f87500ce030 con 0x55d52167fdf0 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f864a604640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 0x7f864403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f864a604640 1 -- 172.21.15.193:0/2516980819 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f87500cc020 con 0x55d52167fdf0 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875d736640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 0x7f864403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 0x55d521778b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217790c0 con 0x55d521682fd0 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 0x55d521778b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875d736640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 0x7f864403bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87540016b0 tx=0x7f87540066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 0x55d521778b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 -- 172.21.15.193:0/2516980819 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87580083f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d521772f30 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 -- 172.21.15.193:0/2516980819 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87580083f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d52177ae70 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 -- 172.21.15.193:0/2516980819 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f87580083f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d52177a0d0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 -- 172.21.15.193:0/2516980819 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87580083f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d52177a4f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875e738640 1 -- 172.21.15.193:0/2516980819 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f87580083f0 con 0x55d521682fd0 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f87604319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d521596450 con 0x55d521789170 2024-09-12T17:11:29.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52390/0 (socket says 172.21.15.193:52390) 2024-09-12T17:11:29.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.251+0000 7f875d736640 1 -- 172.21.15.193:0/3076050518 learned_addr learned my addr 172.21.15.193:0/3076050518 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 -- 172.21.15.193:0/3076050518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d521789bd0 con 0x55d521789170 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8754004f90 tx=0x7f8754015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 -- 172.21.15.193:0/3076050518 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8754011440 con 0x55d521789170 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d52178a430 con 0x55d521789170 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 -- 172.21.15.193:0/3076050518 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87540115e0 con 0x55d521789170 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d52178a9a0 con 0x55d521789170 2024-09-12T17:11:29.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 -- 172.21.15.193:0/3076050518 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87540118c0 con 0x55d521789170 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 -- 172.21.15.193:0/3076050518 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8754011a60 con 0x55d521789170 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 0x7f863803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f86437fe640 1 -- 172.21.15.193:0/3076050518 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f875401b030 con 0x55d521789170 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875e738640 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 0x7f863803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875e738640 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 0x7f863803bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55d52177a470 tx=0x7f8758003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f87604319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d52176ac30 con 0x55d52179afd0 2024-09-12T17:11:29.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52392/0 (socket says 172.21.15.193:52392) 2024-09-12T17:11:29.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 -- 172.21.15.193:0/36143007 learned_addr learned my addr 172.21.15.193:0/36143007 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.255+0000 7f875d736640 1 -- 172.21.15.193:0/36143007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d52179b9c0 con 0x55d52179afd0 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 --2- 172.21.15.193:0/36143007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87540501f0 tx=0x7f875401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12e22e233326dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f86417fa640 1 -- 172.21.15.193:0/36143007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875401dd30 con 0x55d52179afd0 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f86417fa640 1 -- 172.21.15.193:0/36143007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875404d020 con 0x55d52179afd0 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f86417fa640 1 -- 172.21.15.193:0/36143007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8754013cd0 con 0x55d52179afd0 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/36143007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 msgr2=0x55d52179b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 --2- 172.21.15.193:0/36143007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87540501f0 tx=0x7f875401d3e0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/36143007 shutdown_connections 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 --2- 172.21.15.193:0/36143007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d52179b3d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/36143007 >> 172.21.15.193:0/36143007 conn(0x55d521791f40 msgr2=0x55d521790180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/36143007 shutdown_connections 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/36143007 wait complete. 2024-09-12T17:11:29.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 Processor -- start 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- start start 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d521799f30 con 0x55d52179afd0 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52394/0 (socket says 172.21.15.193:52394) 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 learned_addr learned my addr 172.21.15.193:0/4162084658 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5217a1ab0 con 0x55d52179afd0 2024-09-12T17:11:29.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f875d736640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f875401da40 tx=0x7f8754050180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f862f7fe640 1 -- 172.21.15.193:0/4162084658 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f875401de20 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5217a1d40 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5217a26f0 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f862f7fe640 1 -- 172.21.15.193:0/4162084658 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8754028a30 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.259+0000 7f862f7fe640 1 -- 172.21.15.193:0/4162084658 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8754028d10 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f862f7fe640 1 -- 172.21.15.193:0/4162084658 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8754039060 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f862f7fe640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8628039a70 0x7f862803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f862f7fe640 1 -- 172.21.15.193:0/4162084658 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f875404e030 con 0x55d52179afd0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875e738640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8628039a70 0x7f862803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d5217ac7a0 0x55d5217aec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217af380 con 0x55d5217ac7a0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d5217ac7a0 0x55d5217aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875e738640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8628039a70 0x7f862803bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f875800f010 tx=0x7f875801c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d5217ac7a0 0x55d5217aec30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 realm 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217af790 con 0x55d5217ac7a0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b0060 con 0x55d5217ac7a0 2024-09-12T17:11:29.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b0400 con 0x55d5217ac7a0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b08a0 con 0x55d5217ac7a0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 20 searching for the correct realm 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d5217b2810 0x55d5217b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875d736640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d5217b2810 0x55d5217b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875d736640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d5217b2810 0x55d5217b4c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875d736640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f875403b070 0x7f8754033020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.263+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875e738640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f875403b070 0x7f8754033020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875e738640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f875403b070 0x7f8754033020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875e738640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f875801a940 0x7f8758011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f875801a940 0x7f8758011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f875801a940 0x7f8758011430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.267+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.271+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.275+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217b2810 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875801a940 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x55d5217ac7a0 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5210 con 0x7f875403b070 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b12b0 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b1b50 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b0ef0 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 zone default found 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 4 Realm: () 2024-09-12T17:11:29.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 zonegroup default 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b5690 con 0x7f875801a940 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b7530 con 0x55d5217b2810 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b78d0 con 0x55d5217b2810 2024-09-12T17:11:29.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 started sync module instance, tier type = 2024-09-12T17:11:29.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:29.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.279+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b6970 con 0x7f875403b070 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373878132112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b8120 con 0x7f875403b070 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b8970 con 0x55d5217ac7a0 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373878132112] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373878135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b8970 con 0x55d5217ac7a0 2024-09-12T17:11:29.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.283+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b93f0 con 0x55d5217b2810 2024-09-12T17:11:29.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373878135920] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373878138048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b88e0 con 0x55d5217b2810 2024-09-12T17:11:29.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217ba140 con 0x7f875403b070 2024-09-12T17:11:29.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373878144416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217ba890 con 0x7f875403b070 2024-09-12T17:11:29.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.287+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bb3b0 con 0x55d5217ac7a0 2024-09-12T17:11:29.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373878138048] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373878144416] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373878148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bb370 con 0x55d5217ac7a0 2024-09-12T17:11:29.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bbc50 con 0x7f875801a940 2024-09-12T17:11:29.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373878150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bbc40 con 0x7f875801a940 2024-09-12T17:11:29.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bc680 con 0x7f875801a940 2024-09-12T17:11:29.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.291+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373878148736] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.295+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373878150000] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.295+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.295+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373878153552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bb790 con 0x7f875801a940 2024-09-12T17:11:29.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.295+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bcd10 con 0x7f875801a940 2024-09-12T17:11:29.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373878153552] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373878142944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bcd10 con 0x7f875801a940 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=0 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=1 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=2 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=3 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=4 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=5 2024-09-12T17:11:29.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=6 2024-09-12T17:11:29.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373878142944] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 20 add_watcher() i=7 2024-09-12T17:11:29.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:29.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bfea0 con 0x55d5217ac7a0 2024-09-12T17:11:29.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.299+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373878155360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217bd130 con 0x55d5217ac7a0 2024-09-12T17:11:29.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373878155360] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f860f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:29.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:29.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 5 note: GC not initialized 2024-09-12T17:11:29.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f860e7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 Filter name: none 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f857ffff640 20 reqs_thread_entry: start 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e2cc0 con 0x55d5217ac7a0 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:29.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e4240 con 0x7f875403b070 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e4210 con 0x55d5217b2810 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 4.3f 4:fd0a111d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e5e10 con 0x7f875403b070 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 4.16 4:69bce75d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e8aa0 con 0x55d5217b2810 2024-09-12T17:11:29.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 4.1d 4:b875d38d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217eb400 con 0x55d5217b2810 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 4.10 4:0a81f2b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217edfd0 con 0x55d5217b2810 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 4.7 4:e0a76df3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217f0c60 con 0x7f875801a940 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 4.2c 4:37088d08:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217f3990 con 0x55d5217ac7a0 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217f6710 con 0x55d5217ac7a0 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 4.1c 4:386218bb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217f9000 con 0x7f875801a940 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 4.38 4:1f0a6c2d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217fb930 con 0x55d5217ac7a0 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 4.36 4:6d69afdc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217fe220 con 0x55d5217ac7a0 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 4.15 4:a8462aa2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217fb930 con 0x55d5217b2810 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.303+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(70 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(73 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(71 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(74 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(75 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(68 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e1d60 con 0x7f875403b070 2024-09-12T17:11:29.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.307+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e1d60 con 0x7f875403b070 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f87604319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e1d60 con 0x55d5217ac7a0 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f87604319c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:29.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e1d60 con 0x7f875403b070 2024-09-12T17:11:29.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f860f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.311+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373878155360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217e1d60 con 0x55d5217ac7a0 2024-09-12T17:11:29.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94373878155360] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373878132112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217edf50 con 0x7f875403b070 2024-09-12T17:11:29.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94373878132112] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 20 remove_watcher() i=0 2024-09-12T17:11:29.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 2 removed watcher, disabling cache 2024-09-12T17:11:29.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373878135920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b6d90 con 0x55d5217ac7a0 2024-09-12T17:11:29.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94373878135920] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 20 remove_watcher() i=1 2024-09-12T17:11:29.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.315+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373878138048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b7c70 con 0x55d5217b2810 2024-09-12T17:11:29.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f875d736640 1 -- 172.21.15.193:0/4162084658 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94373878138048] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f875400f070 con 0x55d5217b2810 2024-09-12T17:11:29.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f87604319c0 20 remove_watcher() i=2 2024-09-12T17:11:29.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373878144416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b84c0 con 0x7f875403b070 2024-09-12T17:11:29.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f875e738640 1 -- 172.21.15.193:0/4162084658 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94373878144416] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8758030040 con 0x7f875403b070 2024-09-12T17:11:29.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f87604319c0 20 remove_watcher() i=3 2024-09-12T17:11:29.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.319+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373878148736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b84c0 con 0x55d5217ac7a0 2024-09-12T17:11:29.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94373878148736] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x55d5217ac7a0 2024-09-12T17:11:29.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f87604319c0 20 remove_watcher() i=4 2024-09-12T17:11:29.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373878150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b84c0 con 0x7f875801a940 2024-09-12T17:11:29.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94373878150000] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f87604319c0 20 remove_watcher() i=5 2024-09-12T17:11:29.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.323+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373878153552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b84c0 con 0x7f875801a940 2024-09-12T17:11:29.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.327+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94373878153552] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.327+0000 7f87604319c0 20 remove_watcher() i=6 2024-09-12T17:11:29.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.327+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373878142944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d5217b84c0 con 0x7f875801a940 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94373878142944] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f87500bc580 con 0x7f875801a940 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 20 remove_watcher() i=7 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f875801a940 msgr2=0x7f8758011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f875801a940 0x7f8758011430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d5217ac7a0 msgr2=0x55d5217aec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d5217ac7a0 0x55d5217aec30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f875403b070 msgr2=0x7f8754033020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f875403b070 0x7f8754033020 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d5217b2810 msgr2=0x55d5217b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d5217b2810 0x55d5217b4c00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8628039a70 msgr2=0x7f862803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8628039a70 0x7f862803bf30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f875800f010 tx=0x7f875801c070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 msgr2=0x55d5217a1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f875401da40 tx=0x7f8754050180 comp rx=0 tx=0).stop 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f875df37640 1 -- 172.21.15.193:0/4162084658 reap_dead start 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 shutdown_connections 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/4162084658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52179afd0 0x55d5217a1550 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 >> 172.21.15.193:0/4162084658 conn(0x55d521791f40 msgr2=0x55d521790150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 shutdown_connections 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/4162084658 wait complete. 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 msgr2=0x7f863803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 0x7f863803bf30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55d52177a470 tx=0x7f8758003070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 msgr2=0x55d521789590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8754004f90 tx=0x7f8754015820 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 shutdown_connections 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8638039a70 0x7f863803bf30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/3076050518 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d521789170 0x55d521789590 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 >> 172.21.15.193:0/3076050518 conn(0x55d52177eb20 msgr2=0x55d52177ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 shutdown_connections 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/3076050518 wait complete. 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 msgr2=0x55d521778b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 0x55d521778b80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 msgr2=0x7f864403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 0x7f864403bf30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f87540016b0 tx=0x7f87540066c0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 msgr2=0x55d521771a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8750018f70 tx=0x7f87500180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 shutdown_connections 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d521682fd0 0x55d521778b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8644039a70 0x7f864403bf30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 --2- 172.21.15.193:0/2516980819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d52167fdf0 0x55d521771a10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 >> 172.21.15.193:0/2516980819 conn(0x55d52167b910 msgr2=0x55d521764b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 shutdown_connections 2024-09-12T17:11:29.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.331+0000 7f87604319c0 1 -- 172.21.15.193:0/2516980819 wait complete. 2024-09-12T17:11:29.346 INFO:teuthology.orchestra.run.smithi193.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-12T17:11:29.313827Z","last_stats_update":"2024-09-12T17:11:29.311380Z"} 2024-09-12T17:11:29.346 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-12T17:11:29.313827Z', 'last_stats_update': '2024-09-12T17:11:29.311380Z'} 2024-09-12T17:11:29.356 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:29.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T17:11:29.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-12T17:11:29.356 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-12T17:11:29.423 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.424 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.419+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.419+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.419+0000 7f075b5789c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5611ea6f4700 0x5611ea6f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.419+0000 7f075b5789c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611ea5a69c0 con 0x5611ea6f7030 2024-09-12T17:11:29.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.419+0000 7f075b5789c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5611ea5f66d0 con 0x5611ea6f4700 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5611ea6f4700 0x5611ea6f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5611ea6f4700 0x5611ea6f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52396/0 (socket says 172.21.15.193:52396) 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 -- 172.21.15.193:0/2739816746 learned_addr learned my addr 172.21.15.193:0/2739816746 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075887d640 1 --1- 172.21.15.193:0/2739816746 >> v1:172.21.15.62:6789/0 conn(0x5611ea6f7030 0x5611ea6f9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36664/0 (socket says 172.21.15.193:36664) 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 -- 172.21.15.193:0/2739816746 >> v1:172.21.15.62:6789/0 conn(0x5611ea6f7030 legacy=0x5611ea6f9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 -- 172.21.15.193:0/2739816746 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea59aca0 con 0x5611ea6f4700 2024-09-12T17:11:29.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075907e640 1 --2- 172.21.15.193:0/2739816746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea6f6af0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f075400a5c0 tx=0x7f075401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1727c7c28cb89f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f0753fff640 1 -- 172.21.15.193:0/2739816746 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540a6070 con 0x5611ea6f4700 2024-09-12T17:11:29.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f0753fff640 1 -- 172.21.15.193:0/2739816746 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540af070 con 0x5611ea6f4700 2024-09-12T17:11:29.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f0753fff640 1 -- 172.21.15.193:0/2739816746 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540aa5c0 con 0x5611ea6f4700 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.423+0000 7f075b5789c0 1 -- 172.21.15.193:0/2739816746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 msgr2=0x5611ea6f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2739816746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea6f6af0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f075400a5c0 tx=0x7f075401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 -- 172.21.15.193:0/2739816746 shutdown_connections 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2739816746 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea6f6af0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 -- 172.21.15.193:0/2739816746 >> 172.21.15.193:0/2739816746 conn(0x5611ea667a90 msgr2=0x5611ea667ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 -- 172.21.15.193:0/2739816746 shutdown_connections 2024-09-12T17:11:29.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.427+0000 7f075b5789c0 1 -- 172.21.15.193:0/2739816746 wait complete. 2024-09-12T17:11:29.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.439+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.439+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5611ea5fa680 con 0x5611ea6f4700 2024-09-12T17:11:29.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52406/0 (socket says 172.21.15.193:52406) 2024-09-12T17:11:29.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 -- 172.21.15.193:0/1728765075 learned_addr learned my addr 172.21.15.193:0/1728765075 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 -- 172.21.15.193:0/1728765075 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea575da0 con 0x5611ea6f4700 2024-09-12T17:11:29.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 --2- 172.21.15.193:0/1728765075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0754018f70 tx=0x7f0754003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a537a80f3ebbfe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f0647606640 1 -- 172.21.15.193:0/1728765075 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540aa9e0 con 0x5611ea6f4700 2024-09-12T17:11:29.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f0647606640 1 -- 172.21.15.193:0/1728765075 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540aab80 con 0x5611ea6f4700 2024-09-12T17:11:29.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f0647606640 1 -- 172.21.15.193:0/1728765075 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540aae60 con 0x5611ea6f4700 2024-09-12T17:11:29.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- 172.21.15.193:0/1728765075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 msgr2=0x5611ea7df840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 --2- 172.21.15.193:0/1728765075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0754018f70 tx=0x7f0754003030 comp rx=0 tx=0).stop 2024-09-12T17:11:29.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- 172.21.15.193:0/1728765075 shutdown_connections 2024-09-12T17:11:29.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 --2- 172.21.15.193:0/1728765075 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7df840 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- 172.21.15.193:0/1728765075 >> 172.21.15.193:0/1728765075 conn(0x5611ea667a90 msgr2=0x5611ea7db4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- 172.21.15.193:0/1728765075 shutdown_connections 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- 172.21.15.193:0/1728765075 wait complete. 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075b5789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5611ea59ca50 con 0x5611ea6f4700 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52412/0 (socket says 172.21.15.193:52412) 2024-09-12T17:11:29.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.443+0000 7f075907e640 1 -- 172.21.15.193:0/2312532927 learned_addr learned my addr 172.21.15.193:0/2312532927 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075907e640 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea7e7300 con 0x5611ea6f4700 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075907e640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0754000c10 tx=0x7f07540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 -- 172.21.15.193:0/2312532927 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540c6750 con 0x5611ea6f4700 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611ea7e7590 con 0x5611ea6f4700 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ea7e7f40 con 0x5611ea6f4700 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 -- 172.21.15.193:0/2312532927 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07540c68f0 con 0x5611ea6f4700 2024-09-12T17:11:29.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 -- 172.21.15.193:0/2312532927 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07540c6bd0 con 0x5611ea6f4700 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 -- 172.21.15.193:0/2312532927 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f07540ce030 con 0x5611ea6f4700 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 0x7f064003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f0645e03640 1 -- 172.21.15.193:0/2312532927 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f07540cc020 con 0x5611ea6f4700 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075887d640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 0x7f064003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 0x5611ea7edf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea7ee450 con 0x5611ea6f7030 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075987f640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 0x5611ea7edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075887d640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 0x7f064003bf80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0744001e90 tx=0x7f07440013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075987f640 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 0x5611ea7edf10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075987f640 1 -- 172.21.15.193:0/2312532927 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f074c00a4d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.447+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea7ee8a0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075987f640 1 -- 172.21.15.193:0/2312532927 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f074c00a4d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea7f01a0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075987f640 1 -- 172.21.15.193:0/2312532927 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f074c00a4d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea7ef3d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075987f640 1 -- 172.21.15.193:0/2312532927 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f074c00a4d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea7ef820 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075987f640 1 -- 172.21.15.193:0/2312532927 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f074c00a4d0 con 0x5611ea6f7030 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5611ea607450 con 0x5611ea7fe4b0 2024-09-12T17:11:29.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52414/0 (socket says 172.21.15.193:52414) 2024-09-12T17:11:29.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075887d640 1 -- 172.21.15.193:0/3186277906 learned_addr learned my addr 172.21.15.193:0/3186277906 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075887d640 1 -- 172.21.15.193:0/3186277906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea7fef10 con 0x5611ea7fe4b0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075887d640 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f074400e670 tx=0x7f074400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f063effd640 1 -- 172.21.15.193:0/3186277906 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744022070 con 0x5611ea7fe4b0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f063effd640 1 -- 172.21.15.193:0/3186277906 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074400d660 con 0x5611ea7fe4b0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611ea7ff770 con 0x5611ea7fe4b0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f063effd640 1 -- 172.21.15.193:0/3186277906 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744006070 con 0x5611ea7fe4b0 2024-09-12T17:11:29.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.451+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ea7ffce0 con 0x5611ea7fe4b0 2024-09-12T17:11:29.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063effd640 1 -- 172.21.15.193:0/3186277906 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0744025070 con 0x5611ea7fe4b0 2024-09-12T17:11:29.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063effd640 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 0x7f063003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063effd640 1 -- 172.21.15.193:0/3186277906 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0744051c70 con 0x5611ea7fe4b0 2024-09-12T17:11:29.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075987f640 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 0x7f063003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075b5789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075b5789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5611ea7dffd0 con 0x5611ea80add0 2024-09-12T17:11:29.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075987f640 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 0x7f063003bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5611ea7eeef0 tx=0x7f074c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52418/0 (socket says 172.21.15.193:52418) 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075887d640 1 -- 172.21.15.193:0/2646588620 learned_addr learned my addr 172.21.15.193:0/2646588620 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075887d640 1 -- 172.21.15.193:0/2646588620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea80b780 con 0x5611ea80add0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f075887d640 1 --2- 172.21.15.193:0/2646588620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f074404fff0 tx=0x7f074400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c5788881d7bf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063cff9640 1 -- 172.21.15.193:0/2646588620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074403f050 con 0x5611ea80add0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063cff9640 1 -- 172.21.15.193:0/2646588620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074401a320 con 0x5611ea80add0 2024-09-12T17:11:29.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.455+0000 7f063cff9640 1 -- 172.21.15.193:0/2646588620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f074401bda0 con 0x5611ea80add0 2024-09-12T17:11:29.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/2646588620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 msgr2=0x5611ea80b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2646588620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f074404fff0 tx=0x7f074400df30 comp rx=0 tx=0).stop 2024-09-12T17:11:29.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/2646588620 shutdown_connections 2024-09-12T17:11:29.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2646588620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea80b1b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/2646588620 >> 172.21.15.193:0/2646588620 conn(0x5611ea807200 msgr2=0x5611ea805440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/2646588620 shutdown_connections 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/2646588620 wait complete. 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 Processor -- start 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- start start 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5611ea80bde0 con 0x5611ea80add0 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075887d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52426/0 (socket says 172.21.15.193:52426) 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 learned_addr learned my addr 172.21.15.193:0/857224850 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611ea812820 con 0x5611ea80add0 2024-09-12T17:11:29.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075887d640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f074400df70 tx=0x7f074404ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 -- 172.21.15.193:0/857224850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744026a50 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611ea812ab0 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 -- 172.21.15.193:0/857224850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07440263b0 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611ea812ab0 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 -- 172.21.15.193:0/857224850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744026560 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 -- 172.21.15.193:0/857224850 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0744051470 con 0x5611ea80add0 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f06240399d0 0x7f062403be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.459+0000 7f062effd640 1 -- 172.21.15.193:0/857224850 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0744032c50 con 0x5611ea80add0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075987f640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f06240399d0 0x7f062403be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea81d3b0 0x5611ea81f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea81ffc0 con 0x5611ea81d3b0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea81d3b0 0x5611ea81f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075987f640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f06240399d0 0x7f062403be90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5611ea7e8f00 tx=0x7f074c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea81d3b0 0x5611ea81f870 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 realm 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8203d0 con 0x5611ea81d3b0 2024-09-12T17:11:29.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea820ca0 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea821040 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea821890 con 0x5611ea81d3b0 2024-09-12T17:11:29.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 20 searching for the correct realm 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5611ea823600 0x5611ea8259f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075887d640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5611ea823600 0x5611ea8259f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075887d640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5611ea823600 0x5611ea8259f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075887d640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0744031030 0x7f0744050830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f0744031030 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075987f640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0744031030 0x7f0744050830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.463+0000 7f075987f640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0744031030 0x7f0744050830 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075987f640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f074c031040 0x7f074c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f074c031040 0x7f074c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f074c031040 0x7f074c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f0744031030 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.467+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f0744031030 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea823600 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.471+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x5611ea81d3b0 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5611ea825f30 con 0x7f074c031040 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x5611ea823600 2024-09-12T17:11:29.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f0744031030 2024-09-12T17:11:29.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x5611ea81d3b0 2024-09-12T17:11:29.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f074c031040 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x5611ea823600 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f074c031040 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f0744031030 2024-09-12T17:11:29.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x5611ea823600 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.475+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f074c031040 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x5611ea81d3b0 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f07540fd040 con 0x7f0744031030 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f074c01f070 con 0x7f0744031030 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:29.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea822210 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea822ab0 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea822ab0 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 zone default found 2024-09-12T17:11:29.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 4 Realm: () 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 zonegroup default 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8262d0 con 0x7f074c031040 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea827dc0 con 0x5611ea823600 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea828260 con 0x5611ea823600 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 started sync module instance, tier type = 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:29.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.479+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea827160 con 0x7f0744031030 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94634948851072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea826dc0 con 0x7f0744031030 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea829190 con 0x5611ea81d3b0 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94634948851072] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94634948855488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea829190 con 0x5611ea81d3b0 2024-09-12T17:11:29.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.483+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea829b50 con 0x5611ea823600 2024-09-12T17:11:29.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94634948859552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82a3a0 con 0x5611ea823600 2024-09-12T17:11:29.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82ada0 con 0x7f0744031030 2024-09-12T17:11:29.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94634948855488] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94634948857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82b190 con 0x7f0744031030 2024-09-12T17:11:29.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82bb50 con 0x5611ea81d3b0 2024-09-12T17:11:29.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94634948859552] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.487+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94634948857056] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94634948864176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82b6a0 con 0x5611ea81d3b0 2024-09-12T17:11:29.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82bef0 con 0x7f074c031040 2024-09-12T17:11:29.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94634948864176] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94634948867744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82c2e0 con 0x7f074c031040 2024-09-12T17:11:29.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.491+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82cb30 con 0x7f074c031040 2024-09-12T17:11:29.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94634948867744] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94634948868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82c790 con 0x7f074c031040 2024-09-12T17:11:29.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82d210 con 0x7f074c031040 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94634948873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82d1d0 con 0x7f074c031040 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=0 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=1 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=2 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=3 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=4 2024-09-12T17:11:29.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.495+0000 7f075b5789c0 20 add_watcher() i=5 2024-09-12T17:11:29.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94634948868800] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 add_watcher() i=6 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94634948873472] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 add_watcher() i=7 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82c2e0 con 0x5611ea81d3b0 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94634948870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82dbd0 con 0x5611ea81d3b0 2024-09-12T17:11:29.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94634948870880] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f060f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:29.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:29.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 5 note: GC not initialized 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f060e7e4640 20 reqs_thread_entry: start 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 Filter name: none 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f057ffff640 20 reqs_thread_entry: start 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.499+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8538a0 con 0x5611ea81d3b0 2024-09-12T17:11:29.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea855990 con 0x7f0744031030 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:29.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea857240 con 0x5611ea823600 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:29.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea85a980 con 0x7f0744031030 2024-09-12T17:11:29.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T17:11:29.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.503+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea859a20 con 0x7f0744031030 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:29.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea85e490 con 0x7f0744031030 2024-09-12T17:11:29.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:11:29.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:29.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:29.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94634949058400 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5611ea85baa0 con 0x7f074c031040 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== watch-notify(notify (1) cookie 94634948868800 notify 137438953473 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5611ea7e7f40 con 0x7f074c031040 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f063cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94634948868800 notifier 4482 bl.length()=338 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f063cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f063cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f063cff9640 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f061c003eb0 con 0x7f074c031040 2024-09-12T17:11:29.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.507+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(68 notify.6 [notify cookie 94634949058400 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify_complete (2) cookie 94634949058400 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5611ea7e7590 con 0x7f074c031040 2024-09-12T17:11:29.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f060f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94634948870880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea851680 con 0x5611ea81d3b0 2024-09-12T17:11:29.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94634948870880] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.511+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94634948851072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea851680 con 0x7f0744031030 2024-09-12T17:11:29.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94634948851072] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075b5789c0 20 remove_watcher() i=0 2024-09-12T17:11:29.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075b5789c0 2 removed watcher, disabling cache 2024-09-12T17:11:29.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94634948855488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea851680 con 0x5611ea81d3b0 2024-09-12T17:11:29.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94634948855488] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075b5789c0 20 remove_watcher() i=1 2024-09-12T17:11:29.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.515+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94634948859552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea851680 con 0x5611ea823600 2024-09-12T17:11:29.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075887d640 1 -- 172.21.15.193:0/857224850 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94634948859552] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0744037020 con 0x5611ea823600 2024-09-12T17:11:29.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075b5789c0 20 remove_watcher() i=2 2024-09-12T17:11:29.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94634948857056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8296a0 con 0x7f0744031030 2024-09-12T17:11:29.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075987f640 1 -- 172.21.15.193:0/857224850 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94634948857056] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f074c040040 con 0x7f0744031030 2024-09-12T17:11:29.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075b5789c0 20 remove_watcher() i=3 2024-09-12T17:11:29.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.519+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94634948864176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8296a0 con 0x5611ea81d3b0 2024-09-12T17:11:29.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94634948864176] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x5611ea81d3b0 2024-09-12T17:11:29.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075b5789c0 20 remove_watcher() i=4 2024-09-12T17:11:29.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94634948867744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea82a8b0 con 0x7f074c031040 2024-09-12T17:11:29.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94634948867744] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075b5789c0 20 remove_watcher() i=5 2024-09-12T17:11:29.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.523+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94634948868800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8296a0 con 0x7f074c031040 2024-09-12T17:11:29.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94634948868800] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 20 remove_watcher() i=6 2024-09-12T17:11:29.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94634948873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5611ea8296a0 con 0x7f074c031040 2024-09-12T17:11:29.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94634948873472] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07540b33f0 con 0x7f074c031040 2024-09-12T17:11:29.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 20 remove_watcher() i=7 2024-09-12T17:11:29.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f074c031040 msgr2=0x7f074c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f074c031040 0x7f074c032940 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea81d3b0 msgr2=0x5611ea81f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea81d3b0 0x5611ea81f870 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0744031030 msgr2=0x7f0744050830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0744031030 0x7f0744050830 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5611ea823600 msgr2=0x5611ea8259f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5611ea823600 0x5611ea8259f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f06240399d0 msgr2=0x7f062403be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f06240399d0 0x7f062403be90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5611ea7e8f00 tx=0x7f074c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 msgr2=0x5611ea8122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075907e640 1 -- 172.21.15.193:0/857224850 reap_dead start 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f074400df70 tx=0x7f074404ff50 comp rx=0 tx=0).stop 2024-09-12T17:11:29.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 shutdown_connections 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 --2- 172.21.15.193:0/857224850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea80add0 0x5611ea8122c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 >> 172.21.15.193:0/857224850 conn(0x5611ea807200 msgr2=0x5611ea805410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 shutdown_connections 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.527+0000 7f075b5789c0 1 -- 172.21.15.193:0/857224850 wait complete. 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 msgr2=0x7f063003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 0x7f063003bf80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x5611ea7eeef0 tx=0x7f074c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 msgr2=0x5611ea7fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f074400e670 tx=0x7f074400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 shutdown_connections 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0630039ac0 0x7f063003bf80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/3186277906 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea7fe4b0 0x5611ea7fe8d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 >> 172.21.15.193:0/3186277906 conn(0x5611ea7f3e60 msgr2=0x5611ea7f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 shutdown_connections 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/3186277906 wait complete. 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 msgr2=0x5611ea7edf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 0x5611ea7edf10 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 msgr2=0x7f064003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 0x7f064003bf80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0744001e90 tx=0x7f07440013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 msgr2=0x5611ea7e6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0754000c10 tx=0x7f07540180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 shutdown_connections 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5611ea6f7030 0x5611ea7edf10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0640039ac0 0x7f064003bf80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 --2- 172.21.15.193:0/2312532927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5611ea6f4700 0x5611ea7e6da0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 >> 172.21.15.193:0/2312532927 conn(0x5611ea667a90 msgr2=0x5611ea7d9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 shutdown_connections 2024-09-12T17:11:29.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.531+0000 7f075b5789c0 1 -- 172.21.15.193:0/2312532927 wait complete. 2024-09-12T17:11:29.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:11:29.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:11:29.546 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T17:11:29.636 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.636 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.631+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.631+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a9a709c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a2704ae010 0x55a2704b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a9a709c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a27035f9c0 con 0x55a2704a9e20 2024-09-12T17:11:29.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a9a709c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55a2703af6d0 con 0x55a2704ae010 2024-09-12T17:11:29.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a2704ae010 0x55a2704b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a2704ae010 0x55a2704b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52438/0 (socket says 172.21.15.193:52438) 2024-09-12T17:11:29.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1759395659 learned_addr learned my addr 172.21.15.193:0/1759395659 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a7576640 1 --1- 172.21.15.193:0/1759395659 >> v1:172.21.15.62:6789/0 conn(0x55a2704a9e20 0x55a2704aa200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36672/0 (socket says 172.21.15.193:36672) 2024-09-12T17:11:29.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1759395659 >> v1:172.21.15.62:6789/0 conn(0x55a2704a9e20 legacy=0x55a2704aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1759395659 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a270353ca0 con 0x55a2704ae010 2024-09-12T17:11:29.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/1759395659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704ae010 0x55a2704b0400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a4e0 tx=0x7fe69001d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f91f1d16f08326 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6574640 1 -- 172.21.15.193:0/1759395659 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900ae430 con 0x55a2704ae010 2024-09-12T17:11:29.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.635+0000 7fe6a6574640 1 -- 172.21.15.193:0/1759395659 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900ae5d0 con 0x55a2704ae010 2024-09-12T17:11:29.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a6574640 1 -- 172.21.15.193:0/1759395659 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900ae930 con 0x55a2704ae010 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1759395659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704ae010 msgr2=0x55a2704b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1759395659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704ae010 0x55a2704b0400 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a4e0 tx=0x7fe69001d330 comp rx=0 tx=0).stop 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1759395659 shutdown_connections 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1759395659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704ae010 0x55a2704b0400 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1759395659 >> 172.21.15.193:0/1759395659 conn(0x55a2704a5940 msgr2=0x55a2704a7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1759395659 shutdown_connections 2024-09-12T17:11:29.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.639+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1759395659 wait complete. 2024-09-12T17:11:29.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.651+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.651+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.651+0000 7fe6a9a709c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.651+0000 7fe6a9a709c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2703b3680 con 0x55a2704a9e20 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52446/0 (socket says 172.21.15.193:52446) 2024-09-12T17:11:29.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 -- 172.21.15.193:0/4218449506 learned_addr learned my addr 172.21.15.193:0/4218449506 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 -- 172.21.15.193:0/4218449506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27032eda0 con 0x55a2704a9e20 2024-09-12T17:11:29.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 --2- 172.21.15.193:0/4218449506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe698001ec0 tx=0x7fe69800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b84ccc1e92ad3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe59560a640 1 -- 172.21.15.193:0/4218449506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800e5d0 con 0x55a2704a9e20 2024-09-12T17:11:29.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe59560a640 1 -- 172.21.15.193:0/4218449506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69800e770 con 0x55a2704a9e20 2024-09-12T17:11:29.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe59560a640 1 -- 172.21.15.193:0/4218449506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800ea70 con 0x55a2704a9e20 2024-09-12T17:11:29.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/4218449506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 msgr2=0x55a2705945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/4218449506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe698001ec0 tx=0x7fe69800b6d0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/4218449506 shutdown_connections 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/4218449506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a2705945c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/4218449506 >> 172.21.15.193:0/4218449506 conn(0x55a2704a5940 msgr2=0x55a270590200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/4218449506 shutdown_connections 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/4218449506 wait complete. 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a9a709c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a270355a50 con 0x55a2704a9e20 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52450/0 (socket says 172.21.15.193:52450) 2024-09-12T17:11:29.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 -- 172.21.15.193:0/166096892 learned_addr learned my addr 172.21.15.193:0/166096892 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.655+0000 7fe6a7576640 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a27059c1c0 con 0x55a2704a9e20 2024-09-12T17:11:29.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a7576640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55a270595550 tx=0x7fe698000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 -- 172.21.15.193:0/166096892 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800f8e0 con 0x55a2704a9e20 2024-09-12T17:11:29.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 -- 172.21.15.193:0/166096892 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69800fa80 con 0x55a2704a9e20 2024-09-12T17:11:29.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 -- 172.21.15.193:0/166096892 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe69800fda0 con 0x55a2704a9e20 2024-09-12T17:11:29.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a27059c450 con 0x55a2704a9e20 2024-09-12T17:11:29.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a27059ce00 con 0x55a2704a9e20 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 -- 172.21.15.193:0/166096892 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe698017070 con 0x55a2704a9e20 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 0x7fe58c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe593e07640 1 -- 172.21.15.193:0/166096892 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe698015020 con 0x55a2704a9e20 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 0x7fe58c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 0x55a2705a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705a3310 con 0x55a2704ae010 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 0x55a2705a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 0x7fe58c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ae000 tx=0x7fe6900a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 0x55a2705a2dd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a7d77640 1 -- 172.21.15.193:0/166096892 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6a00083f0 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705a3760 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a7d77640 1 -- 172.21.15.193:0/166096892 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6a00083f0 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.659+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705a5060 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a7d77640 1 -- 172.21.15.193:0/166096892 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6a00083f0 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705a4290 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a7d77640 1 -- 172.21.15.193:0/166096892 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6a00083f0 con 0x55a2704ae010 2024-09-12T17:11:29.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705a46b0 con 0x55a2704ae010 2024-09-12T17:11:29.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a7d77640 1 -- 172.21.15.193:0/166096892 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6a00083f0 con 0x55a2704ae010 2024-09-12T17:11:29.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2703c0450 con 0x55a2705b33c0 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52466/0 (socket says 172.21.15.193:52466) 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a6d75640 1 -- 172.21.15.193:0/789443652 learned_addr learned my addr 172.21.15.193:0/789443652 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a6d75640 1 -- 172.21.15.193:0/789443652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2705b3e20 con 0x55a2705b33c0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe69001af60 tx=0x7fe69001a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe591602640 1 -- 172.21.15.193:0/789443652 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900cb070 con 0x55a2705b33c0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2705b4680 con 0x55a2705b33c0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe591602640 1 -- 172.21.15.193:0/789443652 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900b4040 con 0x55a2705b33c0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe591602640 1 -- 172.21.15.193:0/789443652 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900b3050 con 0x55a2705b33c0 2024-09-12T17:11:29.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.663+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2705b4b90 con 0x55a2705b33c0 2024-09-12T17:11:29.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe591602640 1 -- 172.21.15.193:0/789443652 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe6900ce070 con 0x55a2705b33c0 2024-09-12T17:11:29.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe591602640 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 0x7fe58003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe591602640 1 -- 172.21.15.193:0/789443652 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe6900eec00 con 0x55a2705b33c0 2024-09-12T17:11:29.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 0x7fe58003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 0x7fe58003bf20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55a2705a4630 tx=0x7fe6a0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a270594e10 con 0x55a2705c0bf0 2024-09-12T17:11:29.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52468/0 (socket says 172.21.15.193:52468) 2024-09-12T17:11:29.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a6d75640 1 -- 172.21.15.193:0/3949744782 learned_addr learned my addr 172.21.15.193:0/3949744782 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a6d75640 1 -- 172.21.15.193:0/3949744782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2705c15e0 con 0x55a2705c0bf0 2024-09-12T17:11:29.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/3949744782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ed010 tx=0x7fe6900bab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870bd82019072f51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe58affd640 1 -- 172.21.15.193:0/3949744782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900e2070 con 0x55a2705c0bf0 2024-09-12T17:11:29.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe58affd640 1 -- 172.21.15.193:0/3949744782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900bada0 con 0x55a2705c0bf0 2024-09-12T17:11:29.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe58affd640 1 -- 172.21.15.193:0/3949744782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900ce490 con 0x55a2705c0bf0 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/3949744782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 msgr2=0x55a2705c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/3949744782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ed010 tx=0x7fe6900bab80 comp rx=0 tx=0).stop 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/3949744782 shutdown_connections 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/3949744782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c0ff0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/3949744782 >> 172.21.15.193:0/3949744782 conn(0x55a2705bc010 msgr2=0x55a2705ba250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/3949744782 shutdown_connections 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/3949744782 wait complete. 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 Processor -- start 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.667+0000 7fe6a9a709c0 1 -- start start 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a2705bfb40 con 0x55a2705c0bf0 2024-09-12T17:11:29.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a6d75640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52474/0 (socket says 172.21.15.193:52474) 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 learned_addr learned my addr 172.21.15.193:0/1173425232 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2705c76e0 con 0x55a2705c0bf0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c7180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe6900b9ee0 tx=0x7fe6900ecfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 -- 172.21.15.193:0/1173425232 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900eb070 con 0x55a2705c0bf0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a2705c7970 con 0x55a2705c0bf0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 -- 172.21.15.193:0/1173425232 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900b93e0 con 0x55a2705c0bf0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 -- 172.21.15.193:0/1173425232 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6900e2040 con 0x55a2705c0bf0 2024-09-12T17:11:29.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2705c8320 con 0x55a2705c0bf0 2024-09-12T17:11:29.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 -- 172.21.15.193:0/1173425232 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe6900f5060 con 0x55a2705c0bf0 2024-09-12T17:11:29.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe570039a70 0x7fe57003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe5897fa640 1 -- 172.21.15.193:0/1173425232 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe6900a6050 con 0x55a2705c0bf0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe570039a70 0x7fe57003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2705d2290 0x55a2705d4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d4e70 con 0x55a2705d2290 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.671+0000 7fe6a7576640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2705d2290 0x55a2705d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe570039a70 0x7fe57003bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000f010 tx=0x7fe6a001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2705d2290 0x55a2705d4720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 realm 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d5280 con 0x55a2705d2290 2024-09-12T17:11:29.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d5b50 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d5ef0 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d6740 con 0x55a2705d2290 2024-09-12T17:11:29.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 20 searching for the correct realm 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2705d84b0 0x55a2705da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2705d84b0 0x55a2705da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2705d84b0 0x55a2705da8a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a6d75640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe6900f7070 0x7fe6900c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6900f7070 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe6900f7070 0x7fe6900c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe6900f7070 0x7fe6900c6a50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe6a0019040 0x7fe6a0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6a0019040 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.675+0000 7fe6a7576640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe6a0019040 0x7fe6a0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe6a0019040 0x7fe6a0019930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d2290 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d2290 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6a0019040 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6a0019040 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6900f7070 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d2290 2024-09-12T17:11:29.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6a0019040 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.679+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d2290 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6900f7070 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x7fe6a0019040 2024-09-12T17:11:29.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d84b0 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dade0 con 0x55a2705d2290 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d2290 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6a0019040 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d84b0 2024-09-12T17:11:29.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.683+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6900f7070 2024-09-12T17:11:29.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d2290 2024-09-12T17:11:29.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6a0019040 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d84b0 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6a0019040 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6900f7070 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d84b0 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6a0019040 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x55a2705d2290 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe698058040 con 0x7fe6900f7070 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:29.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.687+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d7090 con 0x55a2705d2290 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d7930 con 0x55a2705d2290 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705d7930 con 0x55a2705d2290 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 zone default found 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 4 Realm: () 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 zonegroup default 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705db180 con 0x7fe6a0019040 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dcc70 con 0x55a2705d84b0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dd0d0 con 0x55a2705d84b0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 started sync module instance, tier type = 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:29.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dc010 con 0x7fe6900f7070 2024-09-12T17:11:29.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94156158256128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dbc70 con 0x7fe6900f7070 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.691+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705de000 con 0x55a2705d2290 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.695+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94156158256128] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.695+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.695+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94156158260528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705de000 con 0x55a2705d2290 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.695+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705de9c0 con 0x55a2705d84b0 2024-09-12T17:11:29.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94156158260528] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94156158262096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705ddf70 con 0x55a2705d84b0 2024-09-12T17:11:29.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705df700 con 0x7fe6900f7070 2024-09-12T17:11:29.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94156158267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dffa0 con 0x7fe6900f7070 2024-09-12T17:11:29.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e09c0 con 0x55a2705d2290 2024-09-12T17:11:29.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94156158262096] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.699+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94156158267920] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.703+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.703+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94156158272688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dfaf0 con 0x55a2705d2290 2024-09-12T17:11:29.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.703+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e1260 con 0x7fe6a0019040 2024-09-12T17:11:29.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.703+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94156158272688] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.707+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.707+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94156158266720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dfaf0 con 0x7fe6a0019040 2024-09-12T17:11:29.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.707+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e1690 con 0x7fe6a0019040 2024-09-12T17:11:29.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.711+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94156158266720] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.711+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.711+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94156158274496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e1690 con 0x7fe6a0019040 2024-09-12T17:11:29.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.711+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e2050 con 0x7fe6a0019040 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94156158278560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e2470 con 0x7fe6a0019040 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=0 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=1 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=2 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=3 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=4 2024-09-12T17:11:29.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.715+0000 7fe6a9a709c0 20 add_watcher() i=5 2024-09-12T17:11:29.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94156158274496] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 add_watcher() i=6 2024-09-12T17:11:29.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94156158278560] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 add_watcher() i=7 2024-09-12T17:11:29.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:29.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e11e0 con 0x55a2705d2290 2024-09-12T17:11:29.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94156158276064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705e29f0 con 0x55a2705d2290 2024-09-12T17:11:29.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94156158276064] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:29.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:29.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 5 note: GC not initialized 2024-09-12T17:11:29.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe55cfe1640 20 reqs_thread_entry: start 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 Filter name: none 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe4d67fc640 20 reqs_thread_entry: start 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.719+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a2706087f0 con 0x7fe6a0019040 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:11:29.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a270606e90 con 0x7fe6a0019040 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:11:29.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:11:29.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270607760 con 0x7fe6a0019040 2024-09-12T17:11:29.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:11:29.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:29.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:11:29.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.723+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94156158431920 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a27060bde0 con 0x7fe6a0019040 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify (1) cookie 94156158266720 notify 137438953474 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55a270608140 con 0x7fe6a0019040 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94156158266720 notifier 4489 bl.length()=556 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58affd640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe56c003eb0 con 0x7fe6a0019040 2024-09-12T17:11:29.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(65 notify.5 [notify cookie 94156158431920 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== watch-notify(notify_complete (2) cookie 94156158431920 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a27059ce00 con 0x7fe6a0019040 2024-09-12T17:11:29.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270607260 con 0x7fe6a0019040 2024-09-12T17:11:29.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a9a709c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:29.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a9a709c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a9a709c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94156158431840 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a27060c1f0 con 0x55a2705d84b0 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 94156158262096 notify 137438953474 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55a2705c76e0 con 0x55a2705d84b0 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94156158262096 notifier 4489 bl.length()=177 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.727+0000 7fe58a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe58a7fc640 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe4dc003410 con 0x55a2705d84b0 2024-09-12T17:11:29.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 notify.2 [notify cookie 94156158431840 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== watch-notify(notify_complete (2) cookie 94156158431840 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a2705c15e0 con 0x55a2705d84b0 2024-09-12T17:11:29.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.735 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:11:29.727864Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:29.727834Z","tags":[],"group_ids":[]} 2024-09-12T17:11:29.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe55dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94156158276064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x55a2705d2290 2024-09-12T17:11:29.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94156158276064] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.731+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94156158256128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x7fe6900f7070 2024-09-12T17:11:29.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94156158256128] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a9a709c0 20 remove_watcher() i=0 2024-09-12T17:11:29.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a9a709c0 2 removed watcher, disabling cache 2024-09-12T17:11:29.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94156158260528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x55a2705d2290 2024-09-12T17:11:29.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94156158260528] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a9a709c0 20 remove_watcher() i=1 2024-09-12T17:11:29.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.735+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94156158262096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705dd530 con 0x55a2705d84b0 2024-09-12T17:11:29.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a6d75640 1 -- 172.21.15.193:0/1173425232 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94156158262096] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6900e5040 con 0x55a2705d84b0 2024-09-12T17:11:29.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a9a709c0 20 remove_watcher() i=2 2024-09-12T17:11:29.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94156158267920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x7fe6900f7070 2024-09-12T17:11:29.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a7d77640 1 -- 172.21.15.193:0/1173425232 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94156158267920] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6a002f040 con 0x7fe6900f7070 2024-09-12T17:11:29.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a9a709c0 20 remove_watcher() i=3 2024-09-12T17:11:29.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.739+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94156158272688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705ddb50 con 0x55a2705d2290 2024-09-12T17:11:29.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94156158272688] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x55a2705d2290 2024-09-12T17:11:29.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a9a709c0 20 remove_watcher() i=4 2024-09-12T17:11:29.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94156158266720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x7fe6a0019040 2024-09-12T17:11:29.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94156158266720] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a9a709c0 20 remove_watcher() i=5 2024-09-12T17:11:29.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.743+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94156158274496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a2705ddb50 con 0x7fe6a0019040 2024-09-12T17:11:29.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94156158274496] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 20 remove_watcher() i=6 2024-09-12T17:11:29.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94156158278560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a270606540 con 0x7fe6a0019040 2024-09-12T17:11:29.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94156158278560] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe69802e070 con 0x7fe6a0019040 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 20 remove_watcher() i=7 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe6a0019040 msgr2=0x7fe6a0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe6a0019040 0x7fe6a0019930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2705d2290 msgr2=0x55a2705d4720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2705d2290 0x55a2705d4720 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe6900f7070 msgr2=0x7fe6900c6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe6900f7070 0x7fe6900c6a50 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2705d84b0 msgr2=0x55a2705da8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a2705d84b0 0x55a2705da8a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe570039a70 msgr2=0x7fe57003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe570039a70 0x7fe57003bf30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000f010 tx=0x7fe6a001b070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 msgr2=0x55a2705c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/1173425232 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705c0bf0 0x55a2705c7180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe6900b9ee0 tx=0x7fe6900ecfa0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 reap_dead start 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a7576640 1 -- 172.21.15.193:0/1173425232 reap_dead start 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 shutdown_connections 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 >> 172.21.15.193:0/1173425232 conn(0x55a2705bc010 msgr2=0x55a2705ba220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 shutdown_connections 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.747+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/1173425232 wait complete. 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 msgr2=0x7fe58003bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 0x7fe58003bf20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x55a2705a4630 tx=0x7fe6a0003070 comp rx=0 tx=0).stop 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 msgr2=0x55a2705b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe69001af60 tx=0x7fe69001a0d0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 shutdown_connections 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe580039a60 0x7fe58003bf20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/789443652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2705b33c0 0x55a2705b37e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 >> 172.21.15.193:0/789443652 conn(0x55a2705a8d70 msgr2=0x55a2705a9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 shutdown_connections 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/789443652 wait complete. 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 msgr2=0x55a2705a2dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 0x55a2705a2dd0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 msgr2=0x7fe58c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 0x7fe58c03bf30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6900ae000 tx=0x7fe6900a8000 comp rx=0 tx=0).stop 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 msgr2=0x55a27059bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55a270595550 tx=0x7fe698000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 shutdown_connections 2024-09-12T17:11:29.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a2704ae010 0x55a2705a2dd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe58c039a70 0x7fe58c03bf30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 --2- 172.21.15.193:0/166096892 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2704a9e20 0x55a27059bc60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 >> 172.21.15.193:0/166096892 conn(0x55a2704a5940 msgr2=0x55a27058ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 shutdown_connections 2024-09-12T17:11:29.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.751+0000 7fe6a9a709c0 1 -- 172.21.15.193:0/166096892 wait complete. 2024-09-12T17:11:29.765 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:11:29.727864Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:29.727834Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:29.771 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:11:29.776 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:29.776 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-12T17:11:29.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-12T17:11:29.777 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-12T17:11:29.806 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.806 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68ae8029c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56182b702ff0 0x56182b7053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68ae8029c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56182b5b49c0 con 0x56182b6fee00 2024-09-12T17:11:29.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68ae8029c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56182b6046d0 con 0x56182b702ff0 2024-09-12T17:11:29.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68abb07640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56182b702ff0 0x56182b7053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68abb07640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56182b702ff0 0x56182b7053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52478/0 (socket says 172.21.15.193:52478) 2024-09-12T17:11:29.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68abb07640 1 -- 172.21.15.193:0/136515977 learned_addr learned my addr 172.21.15.193:0/136515977 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68abb07640 1 -- 172.21.15.193:0/136515977 >> v1:172.21.15.62:6789/0 conn(0x56182b6fee00 legacy=0x56182b6ff1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.803+0000 7f68abb07640 1 -- 172.21.15.193:0/136515977 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b5a8ca0 con 0x56182b702ff0 2024-09-12T17:11:29.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68abb07640 1 --2- 172.21.15.193:0/136515977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b702ff0 0x56182b7053e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f68a000a750 tx=0x7f68a001d290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b009106c0608c4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ab306640 1 -- 172.21.15.193:0/136515977 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a000a200 con 0x56182b702ff0 2024-09-12T17:11:29.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ab306640 1 -- 172.21.15.193:0/136515977 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a000a3a0 con 0x56182b702ff0 2024-09-12T17:11:29.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ab306640 1 -- 172.21.15.193:0/136515977 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00086f0 con 0x56182b702ff0 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 -- 172.21.15.193:0/136515977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b702ff0 msgr2=0x56182b7053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/136515977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b702ff0 0x56182b7053e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f68a000a750 tx=0x7f68a001d290 comp rx=0 tx=0).stop 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 -- 172.21.15.193:0/136515977 shutdown_connections 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/136515977 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b702ff0 0x56182b7053e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 -- 172.21.15.193:0/136515977 >> 172.21.15.193:0/136515977 conn(0x56182b6fa920 msgr2=0x56182b6fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 -- 172.21.15.193:0/136515977 shutdown_connections 2024-09-12T17:11:29.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.807+0000 7f68ae8029c0 1 -- 172.21.15.193:0/136515977 wait complete. 2024-09-12T17:11:29.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56182b608680 con 0x56182b6fee00 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ac308640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ac308640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52490/0 (socket says 172.21.15.193:52490) 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ac308640 1 -- 172.21.15.193:0/493495024 learned_addr learned my addr 172.21.15.193:0/493495024 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ac308640 1 -- 172.21.15.193:0/493495024 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b583da0 con 0x56182b6fee00 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ac308640 1 --2- 172.21.15.193:0/493495024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f689c00b2d0 tx=0x7f689c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d238d04057009c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f679a60c640 1 -- 172.21.15.193:0/493495024 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c00a040 con 0x56182b6fee00 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f679a60c640 1 -- 172.21.15.193:0/493495024 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c00f750 con 0x56182b6fee00 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f679a60c640 1 -- 172.21.15.193:0/493495024 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c00fa70 con 0x56182b6fee00 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- 172.21.15.193:0/493495024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 msgr2=0x56182b7e94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/493495024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f689c00b2d0 tx=0x7f689c00b790 comp rx=0 tx=0).stop 2024-09-12T17:11:29.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- 172.21.15.193:0/493495024 shutdown_connections 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/493495024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7e94c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- 172.21.15.193:0/493495024 >> 172.21.15.193:0/493495024 conn(0x56182b6fa920 msgr2=0x56182b7e5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- 172.21.15.193:0/493495024 shutdown_connections 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.823+0000 7f68ae8029c0 1 -- 172.21.15.193:0/493495024 wait complete. 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56182b5aaa50 con 0x56182b6fee00 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ac308640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ac308640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52506/0 (socket says 172.21.15.193:52506) 2024-09-12T17:11:29.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ac308640 1 -- 172.21.15.193:0/2265836707 learned_addr learned my addr 172.21.15.193:0/2265836707 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ac308640 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b7f10a0 con 0x56182b6fee00 2024-09-12T17:11:29.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ac308640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c10 tx=0x7f689c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 -- 172.21.15.193:0/2265836707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c01c9f0 con 0x56182b6fee00 2024-09-12T17:11:29.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56182b7f1330 con 0x56182b6fee00 2024-09-12T17:11:29.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182b7f1ce0 con 0x56182b6fee00 2024-09-12T17:11:29.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 -- 172.21.15.193:0/2265836707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c01cb90 con 0x56182b6fee00 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 -- 172.21.15.193:0/2265836707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f689c02c060 con 0x56182b6fee00 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 -- 172.21.15.193:0/2265836707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f689c017050 con 0x56182b6fee00 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 0x7f679403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f6798e09640 1 -- 172.21.15.193:0/2265836707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f689c015020 con 0x56182b6fee00 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68abb07640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 0x7f679403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 0x56182b7f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b7f81f0 con 0x56182b702ff0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.827+0000 7f68acb09640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 0x56182b7f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 0x7f679403bf80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f68a00ad000 tx=0x7f68a00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 0x56182b7f7cb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 -- 172.21.15.193:0/2265836707 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68a400a4d0 con 0x56182b702ff0 2024-09-12T17:11:29.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b7f8600 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 -- 172.21.15.193:0/2265836707 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68a400a4d0 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b7f9f00 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 -- 172.21.15.193:0/2265836707 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68a400a4d0 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b7f9130 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 -- 172.21.15.193:0/2265836707 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68a400a4d0 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b7f9580 con 0x56182b702ff0 2024-09-12T17:11:29.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68acb09640 1 -- 172.21.15.193:0/2265836707 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68a400a4d0 con 0x56182b702ff0 2024-09-12T17:11:29.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68ae8029c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56182b615450 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52522/0 (socket says 172.21.15.193:52522) 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 -- 172.21.15.193:0/2050926551 learned_addr learned my addr 172.21.15.193:0/2050926551 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 -- 172.21.15.193:0/2050926551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b80d070 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.831+0000 7f68abb07640 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68a000a590 tx=0x7f68a001a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 -- 172.21.15.193:0/2050926551 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00b79c0 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56182b80d8d0 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 -- 172.21.15.193:0/2050926551 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a00b7b60 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 -- 172.21.15.193:0/2050926551 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00b7e40 con 0x56182b80c610 2024-09-12T17:11:29.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182b80dde0 con 0x56182b80c610 2024-09-12T17:11:29.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 -- 172.21.15.193:0/2050926551 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f68a00b5040 con 0x56182b80c610 2024-09-12T17:11:29.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 0x7f678403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f6791ffb640 1 -- 172.21.15.193:0/2050926551 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f68a00b2040 con 0x56182b80c610 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68acb09640 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 0x7f678403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68acb09640 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 0x7f678403bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56182b7f8c50 tx=0x7f68a4005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68ae8029c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56182b7e9d10 con 0x56182b818ed0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52526/0 (socket says 172.21.15.193:52526) 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68abb07640 1 -- 172.21.15.193:0/214506312 learned_addr learned my addr 172.21.15.193:0/214506312 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68abb07640 1 -- 172.21.15.193:0/214506312 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b819880 con 0x56182b818ed0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f68abb07640 1 --2- 172.21.15.193:0/214506312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f68a00eb320 tx=0x7f68a00c34d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e48668f6d69c6c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.835+0000 7f678b7fe640 1 -- 172.21.15.193:0/214506312 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00e8030 con 0x56182b818ed0 2024-09-12T17:11:29.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f678b7fe640 1 -- 172.21.15.193:0/214506312 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a0007540 con 0x56182b818ed0 2024-09-12T17:11:29.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f678b7fe640 1 -- 172.21.15.193:0/214506312 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00064c0 con 0x56182b818ed0 2024-09-12T17:11:29.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/214506312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 msgr2=0x56182b8192b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/214506312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f68a00eb320 tx=0x7f68a00c34d0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/214506312 shutdown_connections 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/214506312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8192b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/214506312 >> 172.21.15.193:0/214506312 conn(0x56182b815300 msgr2=0x56182b813540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/214506312 shutdown_connections 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/214506312 wait complete. 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 Processor -- start 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- start start 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56182b819ee0 con 0x56182b818ed0 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68abb07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52538/0 (socket says 172.21.15.193:52538) 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 learned_addr learned my addr 172.21.15.193:0/362407481 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:29.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182b820a00 con 0x56182b818ed0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68abb07640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68a00c3ff0 tx=0x7f68a00eb2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f6789ffb640 1 -- 172.21.15.193:0/362407481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00db020 con 0x56182b818ed0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56182b820c90 con 0x56182b818ed0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f6789ffb640 1 -- 172.21.15.193:0/362407481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a00b6e20 con 0x56182b818ed0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f6789ffb640 1 -- 172.21.15.193:0/362407481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68a00e8030 con 0x56182b818ed0 2024-09-12T17:11:29.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182b821640 con 0x56182b818ed0 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.839+0000 7f6789ffb640 1 -- 172.21.15.193:0/362407481 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f68a00de020 con 0x56182b818ed0 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f6789ffb640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f677c039a70 0x7f677c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f6789ffb640 1 -- 172.21.15.193:0/362407481 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f68a00d3050 con 0x56182b818ed0 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68acb09640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f677c039a70 0x7f677c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b82b520 0x56182b82d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82e100 con 0x56182b82b520 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b82b520 0x56182b82d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68acb09640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f677c039a70 0x7f677c03bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x56182b7f2ca0 tx=0x7f68a401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b82b520 0x56182b82d9b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 realm 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82e560 con 0x56182b82b520 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:29.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82ee30 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82f1d0 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82f670 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:29.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 20 searching for the correct realm 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56182b8315e0 0x56182b8339d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68abb07640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56182b8315e0 0x56182b8339d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68abb07640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56182b8315e0 0x56182b8339d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68abb07640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68a00f7bb0 0x7f68a00f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68acb09640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68a00f7bb0 0x7f68a00f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.843+0000 7f68acb09640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68a00f7bb0 0x7f68a00f4a40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68acb09640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f68a4031040 0x7f68a4032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f68a4031040 0x7f68a4032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:29.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f68a4031040 0x7f68a4032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x7f68a4031040 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.847+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x7f68a4031040 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x7f68a4031040 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c02e070 con 0x56182b82b520 2024-09-12T17:11:29.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.851+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b8315e0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.855+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a4031040 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x56182b82b520 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56182b834050 con 0x7f68a00f7bb0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68a401f070 con 0x7f68a00f7bb0 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:29.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b830050 con 0x56182b82b520 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b8308f0 con 0x56182b82b520 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:29.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b82fc90 con 0x56182b82b520 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 zone default found 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 4 Realm: () 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 zonegroup default 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b8308f0 con 0x7f68a4031040 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b835ea0 con 0x56182b8315e0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b836240 con 0x56182b8315e0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 started sync module instance, tier type = 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:29.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.859+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b835340 con 0x7f68a00f7bb0 2024-09-12T17:11:29.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94661809231712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b836a90 con 0x7f68a00f7bb0 2024-09-12T17:11:29.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b8372e0 con 0x56182b82b520 2024-09-12T17:11:29.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94661809231712] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94661809235424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b836eb0 con 0x56182b82b520 2024-09-12T17:11:29.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.863+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b8379d0 con 0x56182b8315e0 2024-09-12T17:11:29.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94661809239200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b838270 con 0x56182b8315e0 2024-09-12T17:11:29.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b838c70 con 0x7f68a00f7bb0 2024-09-12T17:11:29.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94661809235424] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94661809236480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b839060 con 0x7f68a00f7bb0 2024-09-12T17:11:29.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.867+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b839a20 con 0x56182b82b520 2024-09-12T17:11:29.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94661809236480] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94661809239200] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94661809241536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b839570 con 0x56182b82b520 2024-09-12T17:11:29.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83a2c0 con 0x7f68a4031040 2024-09-12T17:11:29.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94661809249072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83a400 con 0x7f68a4031040 2024-09-12T17:11:29.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83adc0 con 0x7f68a4031040 2024-09-12T17:11:29.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.871+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94661809241536] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.875+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94661809249072] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.875+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.875+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94661809250128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83a370 con 0x7f68a4031040 2024-09-12T17:11:29.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.875+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83b270 con 0x7f68a4031040 2024-09-12T17:11:29.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94661809250128] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94661809252624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83b1e0 con 0x7f68a4031040 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=0 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=1 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=2 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=3 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=4 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=5 2024-09-12T17:11:29.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=6 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94661809252624] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 20 add_watcher() i=7 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b83e5e0 con 0x56182b82b520 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.879+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94661809254144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83bb00 con 0x56182b82b520 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94661809254144] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f67627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 5 note: GC not initialized 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f67617e2640 20 reqs_thread_entry: start 2024-09-12T17:11:29.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 Filter name: none 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f66d2ffd640 20 reqs_thread_entry: start 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56182b8612f0 con 0x7f68a00f7bb0 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:29.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f67627e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:29.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.883+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94661809254144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b825b70 con 0x56182b82b520 2024-09-12T17:11:29.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94661809254144] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94661809231712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b83aed0 con 0x7f68a00f7bb0 2024-09-12T17:11:29.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94661809231712] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68ae8029c0 20 remove_watcher() i=0 2024-09-12T17:11:29.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68ae8029c0 2 removed watcher, disabling cache 2024-09-12T17:11:29.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.887+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94661809235424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b835760 con 0x56182b82b520 2024-09-12T17:11:29.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94661809235424] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68ae8029c0 20 remove_watcher() i=1 2024-09-12T17:11:29.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94661809239200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b8365e0 con 0x56182b8315e0 2024-09-12T17:11:29.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68abb07640 1 -- 172.21.15.193:0/362407481 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94661809239200] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a00fe040 con 0x56182b8315e0 2024-09-12T17:11:29.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68ae8029c0 20 remove_watcher() i=2 2024-09-12T17:11:29.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.891+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94661809236480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b8374a0 con 0x7f68a00f7bb0 2024-09-12T17:11:29.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68acb09640 1 -- 172.21.15.193:0/362407481 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94661809236480] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68a4040040 con 0x7f68a00f7bb0 2024-09-12T17:11:29.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68ae8029c0 20 remove_watcher() i=3 2024-09-12T17:11:29.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94661809241536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b8374a0 con 0x56182b82b520 2024-09-12T17:11:29.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94661809241536] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x56182b82b520 2024-09-12T17:11:29.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68ae8029c0 20 remove_watcher() i=4 2024-09-12T17:11:29.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.895+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94661809249072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b837dc0 con 0x7f68a4031040 2024-09-12T17:11:29.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.899+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94661809249072] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.899+0000 7f68ae8029c0 20 remove_watcher() i=5 2024-09-12T17:11:29.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.899+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94661809250128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b839b30 con 0x7f68a4031040 2024-09-12T17:11:29.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.899+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94661809250128] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 20 remove_watcher() i=6 2024-09-12T17:11:29.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94661809252624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56182b837dc0 con 0x7f68a4031040 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94661809252624] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f689c058060 con 0x7f68a4031040 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 20 remove_watcher() i=7 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f68a4031040 msgr2=0x7f68a4032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f68a4031040 0x7f68a4032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b82b520 msgr2=0x56182b82d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b82b520 0x56182b82d9b0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68a00f7bb0 msgr2=0x7f68a00f4a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f68a00f7bb0 0x7f68a00f4a40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56182b8315e0 msgr2=0x56182b8339d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56182b8315e0 0x56182b8339d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f677c039a70 msgr2=0x7f677c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f677c039a70 0x7f677c03bf30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x56182b7f2ca0 tx=0x7f68a401f000 comp rx=0 tx=0).stop 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 msgr2=0x56182b8204a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ac308640 1 -- 172.21.15.193:0/362407481 reap_dead start 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f68a00c3ff0 tx=0x7f68a00eb2b0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 shutdown_connections 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/362407481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b818ed0 0x56182b8204a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 >> 172.21.15.193:0/362407481 conn(0x56182b815300 msgr2=0x56182b813510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 shutdown_connections 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/362407481 wait complete. 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 msgr2=0x7f678403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 0x7f678403bf30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x56182b7f8c50 tx=0x7f68a4005850 comp rx=0 tx=0).stop 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 msgr2=0x56182b80ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68a000a590 tx=0x7f68a001a030 comp rx=0 tx=0).stop 2024-09-12T17:11:29.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 shutdown_connections 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6784039a70 0x7f678403bf30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2050926551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b80c610 0x56182b80ca30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 >> 172.21.15.193:0/2050926551 conn(0x56182b7fdbb0 msgr2=0x56182b7fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 shutdown_connections 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2050926551 wait complete. 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 msgr2=0x56182b7f7cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 0x56182b7f7cb0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 msgr2=0x7f679403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 0x7f679403bf80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f68a00ad000 tx=0x7f68a00a7000 comp rx=0 tx=0).stop 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 msgr2=0x56182b7f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c10 tx=0x7f689c000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 shutdown_connections 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56182b702ff0 0x56182b7f7cb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6794039ac0 0x7f679403bf80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 --2- 172.21.15.193:0/2265836707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56182b6fee00 0x56182b7f0b40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 >> 172.21.15.193:0/2265836707 conn(0x56182b6fa920 msgr2=0x56182b7e3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 shutdown_connections 2024-09-12T17:11:29.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.903+0000 7f68ae8029c0 1 -- 172.21.15.193:0/2265836707 wait complete. 2024-09-12T17:11:29.920 INFO:teuthology.orchestra.run.smithi193.stdout:{"key":"bucket:myfoo","ver":{"tag":"_ijUratKlxlXKExA70cesDNn","ver":2},"mtime":"2024-09-12T17:11:29.510977Z","data":{"bucket":{"name":"myfoo","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","bucket_id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-12T17:11:27.903968Z","linked":false,"has_bucket_info":false}} 2024-09-12T17:11:29.921 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_ijUratKlxlXKExA70cesDNn', 'ver': 2}, 'mtime': '2024-09-12T17:11:29.510977Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'bucket_id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-12T17:11:27.903968Z', 'linked': False, 'has_bucket_info': False}} 2024-09-12T17:11:29.921 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1'] 2024-09-12T17:11:29.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1'] 2024-09-12T17:11:29.921 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:29.998 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:29.998 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:29.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:29.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:29.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02caeb09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ab85260d80 0x55ab85261160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:29.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02caeb09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ab851169c0 con 0x55ab85263f60 2024-09-12T17:11:29.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02caeb09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ab851666d0 con 0x55ab85260d80 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c89b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ab85260d80 0x55ab85261160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c89b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ab85260d80 0x55ab85261160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52554/0 (socket says 172.21.15.193:52554) 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c81b5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ab85263f60 0x55ab85266350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36690/0 (socket says 172.21.15.193:36690) 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c89b6640 1 -- 172.21.15.193:0/2735034371 learned_addr learned my addr 172.21.15.193:0/2735034371 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c89b6640 1 -- 172.21.15.193:0/2735034371 >> v1:172.21.15.62:6789/0 conn(0x55ab85263f60 legacy=0x55ab85266350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.995+0000 7f02c89b6640 1 -- 172.21.15.193:0/2735034371 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8510aca0 con 0x55ab85260d80 2024-09-12T17:11:30.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02c89b6640 1 --2- 172.21.15.193:0/2735034371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85261160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02b800a4e0 tx=0x7f02b801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee35f9c47aa2ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02c79b4640 1 -- 172.21.15.193:0/2735034371 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aa540 con 0x55ab85260d80 2024-09-12T17:11:30.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02c79b4640 1 -- 172.21.15.193:0/2735034371 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b80aa6e0 con 0x55ab85260d80 2024-09-12T17:11:30.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02c79b4640 1 -- 172.21.15.193:0/2735034371 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aaa40 con 0x55ab85260d80 2024-09-12T17:11:30.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2735034371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 msgr2=0x55ab85261160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2735034371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85261160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f02b800a4e0 tx=0x7f02b801b090 comp rx=0 tx=0).stop 2024-09-12T17:11:30.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2735034371 shutdown_connections 2024-09-12T17:11:30.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2735034371 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85261160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2735034371 >> 172.21.15.193:0/2735034371 conn(0x55ab8525c8a0 msgr2=0x55ab8525ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2735034371 shutdown_connections 2024-09-12T17:11:30.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:29.999+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2735034371 wait complete. 2024-09-12T17:11:30.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02caeb09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02caeb09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ab8516a680 con 0x55ab85260d80 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02c89b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02c89b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52566/0 (socket says 172.21.15.193:52566) 2024-09-12T17:11:30.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02c89b6640 1 -- 172.21.15.193:0/2247730718 learned_addr learned my addr 172.21.15.193:0/2247730718 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02c89b6640 1 -- 172.21.15.193:0/2247730718 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab850e5da0 con 0x55ab85260d80 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f02c89b6640 1 --2- 172.21.15.193:0/2247730718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f02b80ac040 tx=0x7f02b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bca829c6982f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f01b6e0d640 1 -- 172.21.15.193:0/2247730718 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80b9030 con 0x55ab85260d80 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f01b6e0d640 1 -- 172.21.15.193:0/2247730718 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b80aaa40 con 0x55ab85260d80 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.015+0000 7f01b6e0d640 1 -- 172.21.15.193:0/2247730718 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80aad20 con 0x55ab85260d80 2024-09-12T17:11:30.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2247730718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 msgr2=0x55ab8526a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2247730718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f02b80ac040 tx=0x7f02b80033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2247730718 shutdown_connections 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2247730718 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab8526a200 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2247730718 >> 172.21.15.193:0/2247730718 conn(0x55ab8525c8a0 msgr2=0x55ab85349400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2247730718 shutdown_connections 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2247730718 wait complete. 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ab8510ca50 con 0x55ab85260d80 2024-09-12T17:11:30.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02c89b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02c89b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52578/0 (socket says 172.21.15.193:52578) 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02c89b6640 1 -- 172.21.15.193:0/3921326948 learned_addr learned my addr 172.21.15.193:0/3921326948 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02c89b6640 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab85357490 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02c89b6640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f02b8003430 tx=0x7f02b8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f01b560a640 1 -- 172.21.15.193:0/3921326948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80b9070 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab85357720 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f01b560a640 1 -- 172.21.15.193:0/3921326948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b80c2070 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f01b560a640 1 -- 172.21.15.193:0/3921326948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b80b5ca0 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab853580d0 con 0x55ab85260d80 2024-09-12T17:11:30.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f01b560a640 1 -- 172.21.15.193:0/3921326948 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f02b80b3040 con 0x55ab85260d80 2024-09-12T17:11:30.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.019+0000 7f01b560a640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 0x7f01b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f01b560a640 1 -- 172.21.15.193:0/3921326948 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f02b80ba070 con 0x55ab85260d80 2024-09-12T17:11:30.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 0x7f01b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 0x55ab8535e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab8535e5e0 con 0x55ab85263f60 2024-09-12T17:11:30.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 0x55ab8535e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 0x7f01b003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02b0001e40 tx=0x7f02b00013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 0x55ab8535e0a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 -- 172.21.15.193:0/3921326948 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02c00083f0 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab8535ea50 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 -- 172.21.15.193:0/3921326948 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02c00083f0 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85360350 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 -- 172.21.15.193:0/3921326948 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02c00083f0 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab8535f580 con 0x55ab85263f60 2024-09-12T17:11:30.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 -- 172.21.15.193:0/3921326948 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02c00083f0 con 0x55ab85263f60 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab8535f9d0 con 0x55ab85263f60 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c91b7640 1 -- 172.21.15.193:0/3921326948 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f02c00083f0 con 0x55ab85263f60 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02caeb09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ab85177450 con 0x55ab8536e650 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52584/0 (socket says 172.21.15.193:52584) 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.023+0000 7f02c81b5640 1 -- 172.21.15.193:0/1950650537 learned_addr learned my addr 172.21.15.193:0/1950650537 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c81b5640 1 -- 172.21.15.193:0/1950650537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8536f0b0 con 0x55ab8536e650 2024-09-12T17:11:30.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c81b5640 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e670 tx=0x7f02b000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 -- 172.21.15.193:0/1950650537 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b0022070 con 0x55ab8536e650 2024-09-12T17:11:30.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab8536f910 con 0x55ab8536e650 2024-09-12T17:11:30.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 -- 172.21.15.193:0/1950650537 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b000d660 con 0x55ab8536e650 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 -- 172.21.15.193:0/1950650537 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b0006070 con 0x55ab8536e650 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8536fe80 con 0x55ab8536e650 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 -- 172.21.15.193:0/1950650537 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f02b0025070 con 0x55ab8536e650 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 0x7f01a003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f01ae7fc640 1 -- 172.21.15.193:0/1950650537 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f02b0051a30 con 0x55ab8536e650 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c91b7640 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 0x7f01a003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c91b7640 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 0x7f01a003bf20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f02c000e3f0 tx=0x7f02c0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02caeb09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ab8526a990 con 0x55ab8537c020 2024-09-12T17:11:30.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52600/0 (socket says 172.21.15.193:52600) 2024-09-12T17:11:30.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.027+0000 7f02c81b5640 1 -- 172.21.15.193:0/2647812168 learned_addr learned my addr 172.21.15.193:0/2647812168 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 -- 172.21.15.193:0/2647812168 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8537c9f0 con 0x55ab8537c020 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 --2- 172.21.15.193:0/2647812168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f02b004fe70 tx=0x7f02b0024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea31a9271c26cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019ffff640 1 -- 172.21.15.193:0/2647812168 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b00263b0 con 0x55ab8537c020 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019ffff640 1 -- 172.21.15.193:0/2647812168 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b004d020 con 0x55ab8537c020 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019ffff640 1 -- 172.21.15.193:0/2647812168 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b000dcc0 con 0x55ab8537c020 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2647812168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 msgr2=0x55ab8537c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2647812168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f02b004fe70 tx=0x7f02b0024c90 comp rx=0 tx=0).stop 2024-09-12T17:11:30.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2647812168 shutdown_connections 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/2647812168 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab8537c400 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2647812168 >> 172.21.15.193:0/2647812168 conn(0x55ab853773e0 msgr2=0x55ab85375620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2647812168 shutdown_connections 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/2647812168 wait complete. 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 Processor -- start 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- start start 2024-09-12T17:11:30.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ab8537af10 con 0x55ab8537c020 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52604/0 (socket says 172.21.15.193:52604) 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 learned_addr learned my addr 172.21.15.193:0/3726088012 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab85382ae0 con 0x55ab8537c020 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f02b0024d20 tx=0x7f02b004fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019e7fc640 1 -- 172.21.15.193:0/3726088012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b001a320 con 0x55ab8537c020 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ab85382d70 con 0x55ab8537c020 2024-09-12T17:11:30.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019e7fc640 1 -- 172.21.15.193:0/3726088012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b001a4e0 con 0x55ab8537c020 2024-09-12T17:11:30.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f019e7fc640 1 -- 172.21.15.193:0/3726088012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02b001a800 con 0x55ab8537c020 2024-09-12T17:11:30.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.031+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab85382d70 con 0x55ab8537c020 2024-09-12T17:11:30.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f019e7fc640 1 -- 172.21.15.193:0/3726088012 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f02b001b8c0 con 0x55ab8537c020 2024-09-12T17:11:30.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f019e7fc640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0194039ac0 0x7f019403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f019e7fc640 1 -- 172.21.15.193:0/3726088012 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f02b0047040 con 0x55ab8537c020 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab8538d6f0 0x55ab8538fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0194039ac0 0x7f019403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853902b0 con 0x55ab8538d6f0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab8538d6f0 0x55ab8538fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab8538d6f0 0x55ab8538fb60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0194039ac0 0x7f019403bf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f02c000f010 tx=0x7f02c001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 realm 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853906c0 con 0x55ab8538d6f0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85390f90 con 0x55ab8538d6f0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85391330 con 0x55ab8538d6f0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85391b80 con 0x55ab8538d6f0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 20 searching for the correct realm 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ab853938f0 0x55ab85395ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.035+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ab853938f0 0x55ab85395ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ab853938f0 0x55ab85395ce0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c81b5640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f02b0027060 0x7f02b001d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f02b0027060 0x7f02b001d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f02b0027060 0x7f02b001d960 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c91b7640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f02c0019040 0x7f02c0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f02c0019040 0x7f02c0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f02c0019040 0x7f02c0019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.039+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.043+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.047+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab853938f0 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02c0019040 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x55ab8538d6f0 2024-09-12T17:11:30.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ab85396220 con 0x7f02b0027060 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85392560 con 0x55ab8538d6f0 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85392e00 con 0x55ab8538d6f0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85392e00 con 0x55ab8538d6f0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 zone default found 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 4 Realm: () 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:30.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 zonegroup default 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853965c0 con 0x7f02c0019040 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.051+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab85398110 con 0x55ab853938f0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853985c0 con 0x55ab853938f0 2024-09-12T17:11:30.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 20 started sync module instance, tier type = 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85397450 con 0x7f02b0027060 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94195162904640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853970b0 con 0x7f02b0027060 2024-09-12T17:11:30.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853994f0 con 0x55ab8538d6f0 2024-09-12T17:11:30.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94195162904640] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.055+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94195162909216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853994f0 con 0x55ab8538d6f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85399eb0 con 0x55ab853938f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94195162909216] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94195162910784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85399460 con 0x55ab853938f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.059+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539abf0 con 0x7f02b0027060 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94195162916608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539b490 con 0x7f02b0027060 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539beb0 con 0x55ab8538d6f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94195162910784] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94195162916608] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94195162921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539afe0 con 0x55ab8538d6f0 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.063+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539c750 con 0x7f02c0019040 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94195162921376] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94195162915408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539afe0 con 0x7f02c0019040 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539cb80 con 0x7f02c0019040 2024-09-12T17:11:30.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94195162915408] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94195162923184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539cb80 con 0x7f02c0019040 2024-09-12T17:11:30.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.067+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539d540 con 0x7f02c0019040 2024-09-12T17:11:30.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94195162923184] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94195162927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539cb80 con 0x7f02c0019040 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=0 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=1 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=2 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=3 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=4 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=5 2024-09-12T17:11:30.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.071+0000 7f02caeb09c0 20 add_watcher() i=6 2024-09-12T17:11:30.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94195162927728] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 add_watcher() i=7 2024-09-12T17:11:30.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:30.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853a0990 con 0x55ab8538d6f0 2024-09-12T17:11:30.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94195162925216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539de90 con 0x55ab8538d6f0 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94195162925216] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f017f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 5 note: GC not initialized 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f017e7e4640 20 reqs_thread_entry: start 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:30.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 Filter name: none 2024-09-12T17:11:30.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f01777fe640 20 reqs_thread_entry: start 2024-09-12T17:11:30.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:30.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853c3b90 con 0x7f02c0019040 2024-09-12T17:11:30.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.075+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853c5c80 con 0x7f02b0027060 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853c7790 con 0x55ab853938f0 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:30.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cbdd0 con 0x7f02b0027060 2024-09-12T17:11:30.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.079+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853d1c20 con 0x55ab853938f0 2024-09-12T17:11:30.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94195163102800 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cc6b0 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94195162909216 notify 137438953490 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f02b80d7040 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f019ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94195162909216 notifier 4503 bl.length()=760 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f019ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(67 notify.1 [notify cookie 94195163102800 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f019ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f019ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f019ffff640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f018c003eb0 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify_complete (2) cookie 94195163102800 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab853580d0 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:30.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:30.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:30.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:30.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.083+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853d0ae0 con 0x7f02c0019040 2024-09-12T17:11:30.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cc690 con 0x7f02b0027060 2024-09-12T17:11:30.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02caeb09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:30.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02caeb09c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02caeb09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:30.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.087+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94195163120096 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cc600 con 0x7f02c0019040 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== watch-notify(notify (1) cookie 94195162923184 notify 137438953475 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55ab85357720 con 0x7f02c0019040 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f019ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94195162923184 notifier 4503 bl.length()=314 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f019ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f019ffff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f019ffff640 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f018c003eb0 con 0x7f02c0019040 2024-09-12T17:11:30.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(71 notify.6 [notify cookie 94195163120096 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== watch-notify(notify_complete (2) cookie 94195163120096 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ab85357490 con 0x7f02c0019040 2024-09-12T17:11:30.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f017f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94195162925216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cc690 con 0x55ab8538d6f0 2024-09-12T17:11:30.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94195162925216] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.091+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94195162904640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853cc690 con 0x7f02b0027060 2024-09-12T17:11:30.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94195162904640] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02caeb09c0 20 remove_watcher() i=0 2024-09-12T17:11:30.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02caeb09c0 2 removed watcher, disabling cache 2024-09-12T17:11:30.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94195162909216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853c19a0 con 0x55ab8538d6f0 2024-09-12T17:11:30.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94195162909216] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02caeb09c0 20 remove_watcher() i=1 2024-09-12T17:11:30.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.095+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94195162910784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab853c19a0 con 0x55ab853938f0 2024-09-12T17:11:30.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02c81b5640 1 -- 172.21.15.193:0/3726088012 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94195162910784] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b0031020 con 0x55ab853938f0 2024-09-12T17:11:30.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02caeb09c0 20 remove_watcher() i=2 2024-09-12T17:11:30.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94195162916608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85399040 con 0x7f02b0027060 2024-09-12T17:11:30.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02c91b7640 1 -- 172.21.15.193:0/3726088012 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94195162916608] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02c002f040 con 0x7f02b0027060 2024-09-12T17:11:30.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02caeb09c0 20 remove_watcher() i=3 2024-09-12T17:11:30.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.099+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94195162921376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85399040 con 0x55ab8538d6f0 2024-09-12T17:11:30.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94195162921376] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x55ab8538d6f0 2024-09-12T17:11:30.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02caeb09c0 20 remove_watcher() i=4 2024-09-12T17:11:30.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94195162915408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539b9a0 con 0x7f02c0019040 2024-09-12T17:11:30.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94195162915408] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02caeb09c0 20 remove_watcher() i=5 2024-09-12T17:11:30.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.103+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94195162923184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab85399040 con 0x7f02c0019040 2024-09-12T17:11:30.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.107+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94195162923184] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.107+0000 7f02caeb09c0 20 remove_watcher() i=6 2024-09-12T17:11:30.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.107+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94195162927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ab8539c0b0 con 0x7f02c0019040 2024-09-12T17:11:30.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94195162927728] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b80beca0 con 0x7f02c0019040 2024-09-12T17:11:30.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 20 remove_watcher() i=7 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f02c0019040 msgr2=0x7f02c0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f02c0019040 0x7f02c0019930 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab8538d6f0 msgr2=0x55ab8538fb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab8538d6f0 0x55ab8538fb60 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f02b0027060 msgr2=0x7f02b001d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f02b0027060 0x7f02b001d960 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ab853938f0 msgr2=0x55ab85395ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ab853938f0 0x55ab85395ce0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0194039ac0 msgr2=0x7f019403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0194039ac0 0x7f019403bf80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f02c000f010 tx=0x7f02c001b070 comp rx=0 tx=0).stop 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02c89b6640 1 -- 172.21.15.193:0/3726088012 reap_dead start 2024-09-12T17:11:30.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 msgr2=0x55ab85382580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f02b0024d20 tx=0x7f02b004fdd0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 shutdown_connections 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3726088012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8537c020 0x55ab85382580 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 >> 172.21.15.193:0/3726088012 conn(0x55ab853773e0 msgr2=0x55ab853755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 shutdown_connections 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3726088012 wait complete. 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 msgr2=0x7f01a003bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 0x7f01a003bf20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f02c000e3f0 tx=0x7f02c0003070 comp rx=0 tx=0).stop 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 msgr2=0x55ab8536ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f02b000e670 tx=0x7f02b000ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 shutdown_connections 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01a0039a60 0x7f01a003bf20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/1950650537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab8536e650 0x55ab8536ea70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 >> 172.21.15.193:0/1950650537 conn(0x55ab85364000 msgr2=0x55ab853643e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 shutdown_connections 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/1950650537 wait complete. 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 msgr2=0x55ab8535e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 0x55ab8535e0a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 msgr2=0x7f01b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 0x7f01b003bf30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f02b0001e40 tx=0x7f02b00013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 msgr2=0x55ab85356f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f02b8003430 tx=0x7f02b8017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 shutdown_connections 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ab85263f60 0x55ab8535e0a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f01b0039a70 0x7f01b003bf30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 --2- 172.21.15.193:0/3921326948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ab85260d80 0x55ab85356f30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 >> 172.21.15.193:0/3921326948 conn(0x55ab8525c8a0 msgr2=0x55ab85268e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 shutdown_connections 2024-09-12T17:11:30.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.111+0000 7f02caeb09c0 1 -- 172.21.15.193:0/3921326948 wait complete. 2024-09-12T17:11:30.127 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:30.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:30.127 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:11:30.205 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:30.206 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:30.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca688bc9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c877981240 0x55c877a0fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca688bc9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8778c19c0 con 0x55c877a10130 2024-09-12T17:11:30.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca688bc9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c8779116d0 con 0x55c877981240 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca663c2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c877981240 0x55c877a0fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca663c2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c877981240 0x55c877a0fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52614/0 (socket says 172.21.15.193:52614) 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca663c2640 1 -- 172.21.15.193:0/2641039284 learned_addr learned my addr 172.21.15.193:0/2641039284 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca65bc1640 1 --1- 172.21.15.193:0/2641039284 >> v1:172.21.15.62:6789/0 conn(0x55c877a10130 0x55c877a12520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36692/0 (socket says 172.21.15.193:36692) 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca663c2640 1 -- 172.21.15.193:0/2641039284 >> v1:172.21.15.62:6789/0 conn(0x55c877a10130 legacy=0x55c877a12520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.203+0000 7fca663c2640 1 -- 172.21.15.193:0/2641039284 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8778b5ca0 con 0x55c877981240 2024-09-12T17:11:30.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca663c2640 1 --2- 172.21.15.193:0/2641039284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877981240 0x55c877a0fbf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca5800a5c0 tx=0x7fca5801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290e854fcc6ae4e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca653c0640 1 -- 172.21.15.193:0/2641039284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580b1070 con 0x55c877981240 2024-09-12T17:11:30.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca653c0640 1 -- 172.21.15.193:0/2641039284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca580a8070 con 0x55c877981240 2024-09-12T17:11:30.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca653c0640 1 -- 172.21.15.193:0/2641039284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580ac5b0 con 0x55c877981240 2024-09-12T17:11:30.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2641039284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877981240 msgr2=0x55c877a0fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2641039284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877981240 0x55c877a0fbf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca5800a5c0 tx=0x7fca5801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2641039284 shutdown_connections 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2641039284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877981240 0x55c877a0fbf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2641039284 >> 172.21.15.193:0/2641039284 conn(0x55c877a07920 msgr2=0x55c877a09d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2641039284 shutdown_connections 2024-09-12T17:11:30.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.207+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2641039284 wait complete. 2024-09-12T17:11:30.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca688bc9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca688bc9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c877915680 con 0x55c877a10130 2024-09-12T17:11:30.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca663c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca663c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52624/0 (socket says 172.21.15.193:52624) 2024-09-12T17:11:30.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca663c2640 1 -- 172.21.15.193:0/1728512429 learned_addr learned my addr 172.21.15.193:0/1728512429 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.223+0000 7fca663c2640 1 -- 172.21.15.193:0/1728512429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c877890da0 con 0x55c877a10130 2024-09-12T17:11:30.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 --2- 172.21.15.193:0/1728512429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f9d3191b408f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc954608640 1 -- 172.21.15.193:0/1728512429 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580b1040 con 0x55c877a10130 2024-09-12T17:11:30.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc954608640 1 -- 172.21.15.193:0/1728512429 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca580ac6f0 con 0x55c877a10130 2024-09-12T17:11:30.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc954608640 1 -- 172.21.15.193:0/1728512429 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580ac9d0 con 0x55c877a10130 2024-09-12T17:11:30.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1728512429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 msgr2=0x55c877af88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1728512429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58003030 comp rx=0 tx=0).stop 2024-09-12T17:11:30.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1728512429 shutdown_connections 2024-09-12T17:11:30.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1728512429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877af88e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1728512429 >> 172.21.15.193:0/1728512429 conn(0x55c877a07920 msgr2=0x55c877af4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1728512429 shutdown_connections 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1728512429 wait complete. 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c8778b7a50 con 0x55c877a10130 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52626/0 (socket says 172.21.15.193:52626) 2024-09-12T17:11:30.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 -- 172.21.15.193:0/2798720782 learned_addr learned my addr 172.21.15.193:0/2798720782 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c877a0d7e0 con 0x55c877a10130 2024-09-12T17:11:30.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca663c2640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58019b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc952e05640 1 -- 172.21.15.193:0/2798720782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580cd070 con 0x55c877a10130 2024-09-12T17:11:30.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c877a0bc10 con 0x55c877a10130 2024-09-12T17:11:30.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc952e05640 1 -- 172.21.15.193:0/2798720782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca580b7840 con 0x55c877a10130 2024-09-12T17:11:30.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fc952e05640 1 -- 172.21.15.193:0/2798720782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580b1070 con 0x55c877a10130 2024-09-12T17:11:30.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.227+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c877a0c1a0 con 0x55c877a10130 2024-09-12T17:11:30.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fc952e05640 1 -- 172.21.15.193:0/2798720782 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fca580d0070 con 0x55c877a10130 2024-09-12T17:11:30.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fc952e05640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 0x7fc94c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fc952e05640 1 -- 172.21.15.193:0/2798720782 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fca580eaf40 con 0x55c877a10130 2024-09-12T17:11:30.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca65bc1640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 0x7fc94c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 0x55c877b09640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b09b80 con 0x55c877b07250 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 0x55c877b09640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca65bc1640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 0x7fc94c03bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001e90 tx=0x7fca5c0013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 0x55c877b09640 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 -- 172.21.15.193:0/2798720782 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x55c877b07250 2024-09-12T17:11:30.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b09f20 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 -- 172.21.15.193:0/2798720782 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b0b780 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 -- 172.21.15.193:0/2798720782 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca6000a4d0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b0a9b0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 -- 172.21.15.193:0/2798720782 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b0add0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca66bc3640 1 -- 172.21.15.193:0/2798720782 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca6000a4d0 con 0x55c877b07250 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.231+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca688bc9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca688bc9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c877922450 con 0x55c877b19ae0 2024-09-12T17:11:30.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52630/0 (socket says 172.21.15.193:52630) 2024-09-12T17:11:30.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca65bc1640 1 -- 172.21.15.193:0/1992452721 learned_addr learned my addr 172.21.15.193:0/1992452721 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca65bc1640 1 -- 172.21.15.193:0/1992452721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c877b1a540 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca65bc1640 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e670 tx=0x7fca5c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 -- 172.21.15.193:0/1992452721 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c022070 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 -- 172.21.15.193:0/1992452721 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c00d660 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c877b1ada0 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 -- 172.21.15.193:0/1992452721 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c006070 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c877b1b310 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 -- 172.21.15.193:0/1992452721 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fca5c025070 con 0x55c877b19ae0 2024-09-12T17:11:30.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 0x7fc94003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fc94bfff640 1 -- 172.21.15.193:0/1992452721 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fca5c051cb0 con 0x55c877b19ae0 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca66bc3640 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 0x7fc94003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.235+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca66bc3640 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 0x7fc94003bf20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55c877b0ad50 tx=0x7fca60005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c877af90d0 con 0x55c877b27450 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52638/0 (socket says 172.21.15.193:52638) 2024-09-12T17:11:30.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 -- 172.21.15.193:0/1403428725 learned_addr learned my addr 172.21.15.193:0/1403428725 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 -- 172.21.15.193:0/1403428725 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c877b27e40 con 0x55c877b27450 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 --2- 172.21.15.193:0/1403428725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca5c050030 tx=0x7fca5c00df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dfa22ba0a2c67b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fc949ffb640 1 -- 172.21.15.193:0/1403428725 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c04e030 con 0x55c877b27450 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fc949ffb640 1 -- 172.21.15.193:0/1403428725 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c01a320 con 0x55c877b27450 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fc949ffb640 1 -- 172.21.15.193:0/1403428725 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c01bda0 con 0x55c877b27450 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1403428725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 msgr2=0x55c877b27850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1403428725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca5c050030 tx=0x7fca5c00df30 comp rx=0 tx=0).stop 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1403428725 shutdown_connections 2024-09-12T17:11:30.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1403428725 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b27850 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1403428725 >> 172.21.15.193:0/1403428725 conn(0x55c877b22870 msgr2=0x55c877b20ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1403428725 shutdown_connections 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1403428725 wait complete. 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 Processor -- start 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- start start 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca688bc9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c877b263a0 con 0x55c877b27450 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52650/0 (socket says 172.21.15.193:52650) 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.239+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 learned_addr learned my addr 172.21.15.193:0/854178266 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c877b2df20 con 0x55c877b27450 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca65bc1640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00df70 tx=0x7fca5c04ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 -- 172.21.15.193:0/854178266 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c036070 con 0x55c877b27450 2024-09-12T17:11:30.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 -- 172.21.15.193:0/854178266 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5c0263b0 con 0x55c877b27450 2024-09-12T17:11:30.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 -- 172.21.15.193:0/854178266 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5c01a540 con 0x55c877b27450 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c877b2df20 con 0x55c877b27450 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c877b2df20 con 0x55c877b27450 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 -- 172.21.15.193:0/854178266 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fca5c01a6e0 con 0x55c877b27450 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc930039a70 0x7fc93003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fc937fff640 1 -- 172.21.15.193:0/854178266 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fca5c03bc30 con 0x55c877b27450 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca66bc3640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc930039a70 0x7fc93003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b38920 0x55c877b3adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3b500 con 0x55c877b38920 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca663c2640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b38920 0x55c877b3adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca66bc3640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc930039a70 0x7fc93003bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55c877b0a4d0 tx=0x7fca6001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca663c2640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b38920 0x55c877b3adb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 20 realm 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.243+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3b960 con 0x55c877b38920 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3c230 con 0x55c877b38920 2024-09-12T17:11:30.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3c5d0 con 0x55c877b38920 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3ce20 con 0x55c877b38920 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 20 searching for the correct realm 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c877b3eb90 0x55c877b40f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca65bc1640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c877b3eb90 0x55c877b40f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca65bc1640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c877b3eb90 0x55c877b40f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c024030 con 0x55c877b3eb90 2024-09-12T17:11:30.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca65bc1640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fca5c027060 0x7fca5c01c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca66bc3640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fca5c027060 0x7fca5c01c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca66bc3640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fca5c027060 0x7fca5c01c5e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca66bc3640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fca60031040 0x7fca60032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fca60031040 0x7fca60032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.247+0000 7fca663c2640 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fca60031040 0x7fca60032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.251+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.255+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b3eb90 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca60031040 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x55c877b38920 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c877b414c0 con 0x7fca5c027060 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.259+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3d730 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3dfd0 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b418f0 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 zone default found 2024-09-12T17:11:30.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 4 Realm: () 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 zonegroup default 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b41910 con 0x7fca60031040 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b43740 con 0x55c877b3eb90 2024-09-12T17:11:30.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b43b90 con 0x55c877b3eb90 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 started sync module instance, tier type = 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b3dbe0 con 0x7fca5c027060 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94319490116752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b43ff0 con 0x7fca5c027060 2024-09-12T17:11:30.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.263+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b44ad0 con 0x55c877b38920 2024-09-12T17:11:30.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.267+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94319490116752] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.267+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.267+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94319490123232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b44ad0 con 0x55c877b38920 2024-09-12T17:11:30.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.267+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b454e0 con 0x55c877b3eb90 2024-09-12T17:11:30.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.271+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94319490123232] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.271+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.271+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94319490125872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b458d0 con 0x55c877b3eb90 2024-09-12T17:11:30.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.271+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b46290 con 0x7fca5c027060 2024-09-12T17:11:30.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.275+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.275+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94319490129648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b46980 con 0x7fca5c027060 2024-09-12T17:11:30.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.275+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b474a0 con 0x55c877b38920 2024-09-12T17:11:30.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.275+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94319490129648] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.275+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94319490125872] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.279+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.279+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94319490117968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b47460 con 0x55c877b38920 2024-09-12T17:11:30.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.279+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b47d40 con 0x7fca60031040 2024-09-12T17:11:30.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.279+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94319490117968] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.283+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.283+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94319490133872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b47910 con 0x7fca60031040 2024-09-12T17:11:30.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.283+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b481a0 con 0x7fca60031040 2024-09-12T17:11:30.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.287+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94319490133872] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.287+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.287+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94319490135136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48380 con 0x7fca60031040 2024-09-12T17:11:30.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.287+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48bd0 con 0x7fca60031040 2024-09-12T17:11:30.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94319490135136] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94319490139008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48c50 con 0x7fca60031040 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=0 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=1 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=2 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=3 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=4 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=5 2024-09-12T17:11:30.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.291+0000 7fca688bc9c0 20 add_watcher() i=6 2024-09-12T17:11:30.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94319490139008] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 20 add_watcher() i=7 2024-09-12T17:11:30.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:30.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b4bf40 con 0x55c877b38920 2024-09-12T17:11:30.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94319490140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b491e0 con 0x55c877b38920 2024-09-12T17:11:30.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94319490140432] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fc91cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:30.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:30.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.295+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b54770 con 0x55c877b38920 2024-09-12T17:11:30.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.299+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.299+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b54e20 con 0x7fca60031040 2024-09-12T17:11:30.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.299+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.299+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b54e20 con 0x55c877b3eb90 2024-09-12T17:11:30.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b551c0 con 0x55c877b38920 2024-09-12T17:11:30.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b55200 con 0x7fca5c027060 2024-09-12T17:11:30.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'33 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.303+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b55920 con 0x55c877b3eb90 2024-09-12T17:11:30.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.307+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.307+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b55cc0 con 0x55c877b38920 2024-09-12T17:11:30.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.307+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.307+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b55cc0 con 0x7fca60031040 2024-09-12T17:11:30.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.311+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.311+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b55cc0 con 0x7fca5c027060 2024-09-12T17:11:30.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.311+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.311+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b562b0 con 0x55c877b3eb90 2024-09-12T17:11:30.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.315+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.315+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56290 con 0x7fca5c027060 2024-09-12T17:11:30.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.315+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'34 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.315+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56800 con 0x7fca60031040 2024-09-12T17:11:30.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.319+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.319+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56800 con 0x7fca5c027060 2024-09-12T17:11:30.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.319+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.319+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca60031040 2024-09-12T17:11:30.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b38920 2024-09-12T17:11:30.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.323+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca5c027060 2024-09-12T17:11:30.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.327+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.327+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.327+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.327+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b38920 2024-09-12T17:11:30.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.331+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.331+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b38920 2024-09-12T17:11:30.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.331+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.331+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca5c027060 2024-09-12T17:11:30.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.335+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.339+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca60031040 2024-09-12T17:11:30.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.343+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.343+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.343+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.343+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca60031040 2024-09-12T17:11:30.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.347+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.347+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x55c877b3eb90 2024-09-12T17:11:30.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.351+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.351+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cb0 con 0x7fca60031040 2024-09-12T17:11:30.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.351+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.351+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b56cf0 con 0x7fca5c027060 2024-09-12T17:11:30.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fc8977fe640 20 reqs_thread_entry: start 2024-09-12T17:11:30.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca688bc9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:30.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca688bc9c0 20 Filter name: none 2024-09-12T17:11:30.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fc8957fa640 20 reqs_thread_entry: start 2024-09-12T17:11:30.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca688bc9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:30.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca688bc9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.355+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b527c0 con 0x7fca60031040 2024-09-12T17:11:30.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:11:30.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:11:30.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:30.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c877b74890 con 0x7fca60031040 2024-09-12T17:11:30.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.363 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:11:30.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fc91cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.359+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94319490140432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b32cd0 con 0x55c877b38920 2024-09-12T17:11:30.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94319490140432] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94319490116752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48910 con 0x7fca5c027060 2024-09-12T17:11:30.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94319490116752] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca688bc9c0 20 remove_watcher() i=0 2024-09-12T17:11:30.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca688bc9c0 2 removed watcher, disabling cache 2024-09-12T17:11:30.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.363+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94319490123232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48910 con 0x55c877b38920 2024-09-12T17:11:30.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94319490123232] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca688bc9c0 20 remove_watcher() i=1 2024-09-12T17:11:30.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94319490125872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b445e0 con 0x55c877b3eb90 2024-09-12T17:11:30.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca65bc1640 1 -- 172.21.15.193:0/854178266 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94319490125872] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca5c05c040 con 0x55c877b3eb90 2024-09-12T17:11:30.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca688bc9c0 20 remove_watcher() i=2 2024-09-12T17:11:30.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.367+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94319490129648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48910 con 0x7fca5c027060 2024-09-12T17:11:30.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca66bc3640 1 -- 172.21.15.193:0/854178266 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94319490129648] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6001f070 con 0x7fca5c027060 2024-09-12T17:11:30.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca688bc9c0 20 remove_watcher() i=3 2024-09-12T17:11:30.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94319490117968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b445e0 con 0x55c877b38920 2024-09-12T17:11:30.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94319490117968] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x55c877b38920 2024-09-12T17:11:30.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca688bc9c0 20 remove_watcher() i=4 2024-09-12T17:11:30.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.371+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94319490133872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b45ef0 con 0x7fca60031040 2024-09-12T17:11:30.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94319490133872] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca688bc9c0 20 remove_watcher() i=5 2024-09-12T17:11:30.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94319490135136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b48910 con 0x7fca60031040 2024-09-12T17:11:30.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94319490135136] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca688bc9c0 20 remove_watcher() i=6 2024-09-12T17:11:30.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.375+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94319490139008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c877b445e0 con 0x7fca60031040 2024-09-12T17:11:30.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94319490139008] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca580cf030 con 0x7fca60031040 2024-09-12T17:11:30.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 20 remove_watcher() i=7 2024-09-12T17:11:30.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fca60031040 msgr2=0x7fca60032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fca60031040 0x7fca60032940 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b38920 msgr2=0x55c877b3adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b38920 0x55c877b3adb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fca5c027060 msgr2=0x7fca5c01c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fca5c027060 0x7fca5c01c5e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c877b3eb90 msgr2=0x55c877b40f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c877b3eb90 0x55c877b40f80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc930039a70 msgr2=0x7fc93003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc930039a70 0x7fc93003bf30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55c877b0a4d0 tx=0x7fca6001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca663c2640 1 -- 172.21.15.193:0/854178266 reap_dead start 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 msgr2=0x55c877b2d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00df70 tx=0x7fca5c04ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 shutdown_connections 2024-09-12T17:11:30.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/854178266 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b27450 0x55c877b2d9c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 >> 172.21.15.193:0/854178266 conn(0x55c877b22870 msgr2=0x55c877b20a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 shutdown_connections 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/854178266 wait complete. 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 msgr2=0x7fc94003bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 0x7fc94003bf20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55c877b0ad50 tx=0x7fca60005850 comp rx=0 tx=0).stop 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 msgr2=0x55c877b19f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00e670 tx=0x7fca5c00ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 shutdown_connections 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc940039a60 0x7fc94003bf20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/1992452721 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877b19ae0 0x55c877b19f00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.379+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 >> 172.21.15.193:0/1992452721 conn(0x55c877b0f490 msgr2=0x55c877b0f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 shutdown_connections 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/1992452721 wait complete. 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 msgr2=0x55c877b09640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 0x55c877b09640 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 msgr2=0x7fc94c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 0x7fc94c03bf30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fca5c001e90 tx=0x7fca5c0013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 msgr2=0x55c877a0d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca580af040 tx=0x7fca58019b80 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 shutdown_connections 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c877b07250 0x55c877b09640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc94c039a70 0x7fc94c03bf30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 --2- 172.21.15.193:0/2798720782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c877a10130 0x55c877a0d280 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 >> 172.21.15.193:0/2798720782 conn(0x55c877a07920 msgr2=0x55c877af2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 shutdown_connections 2024-09-12T17:11:30.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.383+0000 7fca688bc9c0 1 -- 172.21.15.193:0/2798720782 wait complete. 2024-09-12T17:11:30.398 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:11:30.398 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T17:11:30.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-12T17:11:30.399 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-12T17:11:30.484 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4e3779c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5600253d1f70 0x5600253d2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4e3779c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5600252869c0 con 0x5600253d50b0 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4e3779c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5600252d66d0 con 0x5600253d1f70 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4be7d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5600253d1f70 0x5600253d2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4be7d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5600253d1f70 0x5600253d2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52654/0 (socket says 172.21.15.193:52654) 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4b67c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5600253d50b0 0x5600253d74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36702/0 (socket says 172.21.15.193:36702) 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4be7d640 1 -- 172.21.15.193:0/2225797691 learned_addr learned my addr 172.21.15.193:0/2225797691 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4be7d640 1 -- 172.21.15.193:0/2225797691 >> v1:172.21.15.62:6789/0 conn(0x5600253d50b0 legacy=0x5600253d74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.479+0000 7f6d4be7d640 1 -- 172.21.15.193:0/2225797691 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002527aca0 con 0x5600253d1f70 2024-09-12T17:11:30.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/2225797691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600253d2350 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00a5c0 tx=0x7f6d3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4060f43a3cfc23 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4ae7b640 1 -- 172.21.15.193:0/2225797691 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0a6070 con 0x5600253d1f70 2024-09-12T17:11:30.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4ae7b640 1 -- 172.21.15.193:0/2225797691 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0af070 con 0x5600253d1f70 2024-09-12T17:11:30.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4ae7b640 1 -- 172.21.15.193:0/2225797691 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0aa5c0 con 0x5600253d1f70 2024-09-12T17:11:30.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2225797691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 msgr2=0x5600253d2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2225797691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600253d2350 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00a5c0 tx=0x7f6d3c01b340 comp rx=0 tx=0).stop 2024-09-12T17:11:30.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2225797691 shutdown_connections 2024-09-12T17:11:30.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2225797691 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600253d2350 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2225797691 >> 172.21.15.193:0/2225797691 conn(0x5600253cda90 msgr2=0x5600253cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2225797691 shutdown_connections 2024-09-12T17:11:30.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.483+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2225797691 wait complete. 2024-09-12T17:11:30.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4e3779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4e3779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5600252da680 con 0x5600253d1f70 2024-09-12T17:11:30.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4be7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4be7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52656/0 (socket says 172.21.15.193:52656) 2024-09-12T17:11:30.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4be7d640 1 -- 172.21.15.193:0/2538755265 learned_addr learned my addr 172.21.15.193:0/2538755265 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.499+0000 7f6d4be7d640 1 -- 172.21.15.193:0/2538755265 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560025255da0 con 0x5600253d1f70 2024-09-12T17:11:30.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/2538755265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c018f70 tx=0x7f6d3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae33004a73e6f4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c39e0b640 1 -- 172.21.15.193:0/2538755265 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0aa8b0 con 0x5600253d1f70 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c39e0b640 1 -- 172.21.15.193:0/2538755265 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0aaa50 con 0x5600253d1f70 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c39e0b640 1 -- 172.21.15.193:0/2538755265 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0aad30 con 0x5600253d1f70 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2538755265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 msgr2=0x5600254bd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2538755265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c018f70 tx=0x7f6d3c003030 comp rx=0 tx=0).stop 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2538755265 shutdown_connections 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2538755265 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254bd6a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2538755265 >> 172.21.15.193:0/2538755265 conn(0x5600253cda90 msgr2=0x5600254b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2538755265 shutdown_connections 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2538755265 wait complete. 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56002527ca50 con 0x5600253d1f70 2024-09-12T17:11:30.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52662/0 (socket says 172.21.15.193:52662) 2024-09-12T17:11:30.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 -- 172.21.15.193:0/3640896849 learned_addr learned my addr 172.21.15.193:0/3640896849 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600254c5170 con 0x5600253d1f70 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c018f70 tx=0x7f6d3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c33fff640 1 -- 172.21.15.193:0/3640896849 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0c6690 con 0x5600253d1f70 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600254c5400 con 0x5600253d1f70 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c33fff640 1 -- 172.21.15.193:0/3640896849 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0c6830 con 0x5600253d1f70 2024-09-12T17:11:30.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.503+0000 7f6c33fff640 1 -- 172.21.15.193:0/3640896849 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3c0c6b30 con 0x5600253d1f70 2024-09-12T17:11:30.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600254c5db0 con 0x5600253d1f70 2024-09-12T17:11:30.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6c33fff640 1 -- 172.21.15.193:0/3640896849 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d3c0ce030 con 0x5600253d1f70 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6c33fff640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 0x7f6c3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6c33fff640 1 -- 172.21.15.193:0/3640896849 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d3c0cc020 con 0x5600253d1f70 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 0x7f6c3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 0x5600254cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254cc2c0 con 0x5600253d50b0 2024-09-12T17:11:30.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 0x5600254cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 0x7f6c3403bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6d340016b0 tx=0x7f6d340066c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 0x5600254cbd80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 -- 172.21.15.193:0/3640896849 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d440083f0 con 0x5600253d50b0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254cc710 con 0x5600253d50b0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 -- 172.21.15.193:0/3640896849 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d440083f0 con 0x5600253d50b0 2024-09-12T17:11:30.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254ce010 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 -- 172.21.15.193:0/3640896849 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d440083f0 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254cd240 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 -- 172.21.15.193:0/3640896849 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d440083f0 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254cd690 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.507+0000 7f6d4c67e640 1 -- 172.21.15.193:0/3640896849 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d440083f0 con 0x5600253d50b0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5600252e7450 con 0x5600254dc320 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52664/0 (socket says 172.21.15.193:52664) 2024-09-12T17:11:30.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4b67c640 1 -- 172.21.15.193:0/3388387931 learned_addr learned my addr 172.21.15.193:0/3388387931 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4b67c640 1 -- 172.21.15.193:0/3388387931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600254dcd80 con 0x5600254dc320 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d34004f90 tx=0x7f6d34015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6c317fa640 1 -- 172.21.15.193:0/3388387931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34011440 con 0x5600254dc320 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6c317fa640 1 -- 172.21.15.193:0/3388387931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d340115e0 con 0x5600254dc320 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600254dd5e0 con 0x5600254dc320 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6c317fa640 1 -- 172.21.15.193:0/3388387931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d340118c0 con 0x5600254dc320 2024-09-12T17:11:30.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600254ddb50 con 0x5600254dc320 2024-09-12T17:11:30.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.511+0000 7f6c317fa640 1 -- 172.21.15.193:0/3388387931 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d34011a60 con 0x5600254dc320 2024-09-12T17:11:30.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6c317fa640 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 0x7f6c2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6c317fa640 1 -- 172.21.15.193:0/3388387931 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d3401b030 con 0x5600254dc320 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 0x7f6c2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 0x7f6c2403bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5600254ccd60 tx=0x7f6d44003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5600254bde30 con 0x5600254e9cf0 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52666/0 (socket says 172.21.15.193:52666) 2024-09-12T17:11:30.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 -- 172.21.15.193:0/2272469453 learned_addr learned my addr 172.21.15.193:0/2272469453 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 -- 172.21.15.193:0/2272469453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600254ea6c0 con 0x5600254e9cf0 2024-09-12T17:11:30.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/2272469453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6d34050230 tx=0x7f6d3401d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1591971dc06ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6c2affd640 1 -- 172.21.15.193:0/2272469453 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3401dd30 con 0x5600254e9cf0 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6c2affd640 1 -- 172.21.15.193:0/2272469453 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34013cd0 con 0x5600254e9cf0 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6c2affd640 1 -- 172.21.15.193:0/2272469453 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3401f390 con 0x5600254e9cf0 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2272469453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 msgr2=0x5600254ea0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2272469453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6d34050230 tx=0x7f6d3401d8a0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2272469453 shutdown_connections 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/2272469453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254ea0d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2272469453 >> 172.21.15.193:0/2272469453 conn(0x5600254e50b0 msgr2=0x5600254e32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2272469453 shutdown_connections 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/2272469453 wait complete. 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 Processor -- start 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- start start 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4e3779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5600254e8be0 con 0x5600254e9cf0 2024-09-12T17:11:30.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52678/0 (socket says 172.21.15.193:52678) 2024-09-12T17:11:30.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.515+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 learned_addr learned my addr 172.21.15.193:0/4280494374 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600254f0730 con 0x5600254e9cf0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6d34010540 tx=0x7f6d34050190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 -- 172.21.15.193:0/4280494374 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3401eb40 con 0x5600254e9cf0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600254f09c0 con 0x5600254e9cf0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 -- 172.21.15.193:0/4280494374 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3404a040 con 0x5600254e9cf0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 -- 172.21.15.193:0/4280494374 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3401ee10 con 0x5600254e9cf0 2024-09-12T17:11:30.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600254f09c0 con 0x5600254e9cf0 2024-09-12T17:11:30.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 -- 172.21.15.193:0/4280494374 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d3403a060 con 0x5600254e9cf0 2024-09-12T17:11:30.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c14039a20 0x7f6c1403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6c297fa640 1 -- 172.21.15.193:0/4280494374 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f6d34034c70 con 0x5600254e9cf0 2024-09-12T17:11:30.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c14039a20 0x7f6c1403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600254fb330 0x5600254fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254fdf10 con 0x5600254fb330 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.519+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600254fb330 0x5600254fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c14039a20 0x7f6c1403bee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400f010 tx=0x7f6d4401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600254fb330 0x5600254fd7c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 realm 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254fe320 con 0x5600254fb330 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254febf0 con 0x5600254fb330 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254fef90 con 0x5600254fb330 2024-09-12T17:11:30.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600254ff7e0 con 0x5600254fb330 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 20 searching for the correct realm 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560025501550 0x560025503940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560025501550 0x560025503940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560025501550 0x560025503940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4b67c640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d3403c070 0x7f6d3400f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d3403c070 0x7f6d3400f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d3403c070 0x7f6d3400f300 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d44019040 0x7f6d44019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.523+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d44019040 0x7f6d44019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d44019040 0x7f6d44019930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.527+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.531+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x560025501550 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d44019040 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x5600254fb330 2024-09-12T17:11:30.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.535+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560025503e80 con 0x7f6d3403c070 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600255001c0 con 0x5600254fb330 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025500a60 con 0x5600254fb330 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025504220 con 0x5600254fb330 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 zone default found 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 4 Realm: () 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:30.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 zonegroup default 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600255006b0 con 0x7f6d44019040 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025506610 con 0x560025501550 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5600255069b0 con 0x560025501550 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 started sync module instance, tier type = 2024-09-12T17:11:30.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:30.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025505aa0 con 0x7f6d3403c070 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94558626012816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025505700 con 0x7f6d3403c070 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.539+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025507890 con 0x5600254fb330 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.543+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94558626012816] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.543+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.543+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94558626016704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025507890 con 0x5600254fb330 2024-09-12T17:11:30.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.543+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025508250 con 0x560025501550 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94558626016704] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94558626018272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025507800 con 0x560025501550 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025508f50 con 0x7f6d3403c070 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94558626024368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025509820 con 0x7f6d3403c070 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550a220 con 0x5600254fb330 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94558626018272] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94558626024368] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94558626022896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025509370 con 0x5600254fb330 2024-09-12T17:11:30.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.547+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550aac0 con 0x7f6d44019040 2024-09-12T17:11:30.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.551+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94558626022896] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.551+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.551+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94558626028848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025509370 con 0x7f6d44019040 2024-09-12T17:11:30.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.551+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550af50 con 0x7f6d44019040 2024-09-12T17:11:30.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94558626028848] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94558626032224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550b370 con 0x7f6d44019040 2024-09-12T17:11:30.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550a480 con 0x7f6d44019040 2024-09-12T17:11:30.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94558626032224] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94558626033280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550b2a0 con 0x7f6d44019040 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=0 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=1 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=2 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=3 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=4 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=5 2024-09-12T17:11:30.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.555+0000 7f6d4e3779c0 20 add_watcher() i=6 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94558626033280] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 20 add_watcher() i=7 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56002550ee10 con 0x5600254fb330 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94558626036016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002550c270 con 0x5600254fb330 2024-09-12T17:11:30.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94558626036016] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6c027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:30.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:30.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 5 note: GC not initialized 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6c017e2640 20 reqs_thread_entry: start 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6d4e3779c0 20 Filter name: none 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.559+0000 7f6bfa7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025531ea0 con 0x7f6d44019040 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:30.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025533f90 con 0x7f6d3403c070 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025535a30 con 0x560025501550 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:30.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:30.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.563+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025539170 con 0x7f6d44019040 2024-09-12T17:11:30.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-12T17:11:30.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025538180 con 0x7f6d3403c070 2024-09-12T17:11:30.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:30.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-12T17:11:30.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.567+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002553ce60 con 0x7f6d3403c070 2024-09-12T17:11:30.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4e3779c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:11:30.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4e3779c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4e3779c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94558626236848 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560025539b80 con 0x7f6d44019040 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== watch-notify(notify (1) cookie 94558626032224 notify 137438953476 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5600254c5db0 con 0x7f6d44019040 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6c2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94558626032224 notifier 4517 bl.length()=338 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6c2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6c2affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6c2affd640 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6c10003eb0 con 0x7f6d44019040 2024-09-12T17:11:30.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(68 notify.6 [notify cookie 94558626236848 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== watch-notify(notify_complete (2) cookie 94558626236848 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5600254c5400 con 0x7f6d44019040 2024-09-12T17:11:30.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6c027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.571+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94558626036016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002553ce60 con 0x5600254fb330 2024-09-12T17:11:30.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94558626036016] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94558626012816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002553ce60 con 0x7f6d3403c070 2024-09-12T17:11:30.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94558626012816] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4e3779c0 20 remove_watcher() i=0 2024-09-12T17:11:30.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4e3779c0 2 removed watcher, disabling cache 2024-09-12T17:11:30.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.575+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94558626016704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002552fcb0 con 0x5600254fb330 2024-09-12T17:11:30.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94558626016704] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4e3779c0 20 remove_watcher() i=1 2024-09-12T17:11:30.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94558626018272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56002552fcb0 con 0x560025501550 2024-09-12T17:11:30.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4b67c640 1 -- 172.21.15.193:0/4280494374 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94558626018272] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3400f070 con 0x560025501550 2024-09-12T17:11:30.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4e3779c0 20 remove_watcher() i=2 2024-09-12T17:11:30.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.579+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94558626024368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025505e90 con 0x7f6d3403c070 2024-09-12T17:11:30.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4c67e640 1 -- 172.21.15.193:0/4280494374 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94558626024368] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d4402f040 con 0x7f6d3403c070 2024-09-12T17:11:30.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4e3779c0 20 remove_watcher() i=3 2024-09-12T17:11:30.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94558626022896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025506dc0 con 0x5600254fb330 2024-09-12T17:11:30.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94558626022896] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x5600254fb330 2024-09-12T17:11:30.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4e3779c0 20 remove_watcher() i=4 2024-09-12T17:11:30.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.583+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94558626028848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5600255073e0 con 0x7f6d44019040 2024-09-12T17:11:30.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94558626028848] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4e3779c0 20 remove_watcher() i=5 2024-09-12T17:11:30.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94558626032224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025505e90 con 0x7f6d44019040 2024-09-12T17:11:30.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94558626032224] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4e3779c0 20 remove_watcher() i=6 2024-09-12T17:11:30.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.587+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94558626033280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560025505e90 con 0x7f6d44019040 2024-09-12T17:11:30.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94558626033280] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3c0ae260 con 0x7f6d44019040 2024-09-12T17:11:30.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 20 remove_watcher() i=7 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d44019040 msgr2=0x7f6d44019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d44019040 0x7f6d44019930 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600254fb330 msgr2=0x5600254fd7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600254fb330 0x5600254fd7c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d3403c070 msgr2=0x7f6d3400f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d3403c070 0x7f6d3400f300 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560025501550 msgr2=0x560025503940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560025501550 0x560025503940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c14039a20 msgr2=0x7f6c1403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c14039a20 0x7f6c1403bee0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400f010 tx=0x7f6d4401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 msgr2=0x5600254f01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4be7d640 1 -- 172.21.15.193:0/4280494374 reap_dead start 2024-09-12T17:11:30.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6d34010540 tx=0x7f6d34050190 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 shutdown_connections 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/4280494374 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254e9cf0 0x5600254f01d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 >> 172.21.15.193:0/4280494374 conn(0x5600254e50b0 msgr2=0x5600254e32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 shutdown_connections 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/4280494374 wait complete. 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 msgr2=0x7f6c2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 0x7f6c2403bf30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x5600254ccd60 tx=0x7f6d44003070 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 msgr2=0x5600254dc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6d34004f90 tx=0x7f6d34015820 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 shutdown_connections 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c24039a70 0x7f6c2403bf30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3388387931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600254dc320 0x5600254dc740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 >> 172.21.15.193:0/3388387931 conn(0x5600254d1cd0 msgr2=0x5600254d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 shutdown_connections 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3388387931 wait complete. 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 msgr2=0x5600254cbd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 0x5600254cbd80 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 msgr2=0x7f6c3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 0x7f6c3403bf30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6d340016b0 tx=0x7f6d340066c0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 msgr2=0x5600254c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c018f70 tx=0x7f6d3c0180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 shutdown_connections 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5600253d50b0 0x5600254cbd80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c34039a70 0x7f6c3403bf30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 --2- 172.21.15.193:0/3640896849 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5600253d1f70 0x5600254c4c10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 >> 172.21.15.193:0/3640896849 conn(0x5600253cda90 msgr2=0x5600254b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 shutdown_connections 2024-09-12T17:11:30.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.591+0000 7f6d4e3779c0 1 -- 172.21.15.193:0/3640896849 wait complete. 2024-09-12T17:11:30.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1'] 2024-09-12T17:11:30.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1'] 2024-09-12T17:11:30.608 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:30.692 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:30.692 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:30.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.687+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.687+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.687+0000 7f265ed6b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ea8423f180 0x55ea8423f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265ed6b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea840f19c0 con 0x55ea842422c0 2024-09-12T17:11:30.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265ed6b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ea841416d0 con 0x55ea8423f180 2024-09-12T17:11:30.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ea8423f180 0x55ea8423f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ea8423f180 0x55ea8423f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52686/0 (socket says 172.21.15.193:52686) 2024-09-12T17:11:30.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 -- 172.21.15.193:0/3814951162 learned_addr learned my addr 172.21.15.193:0/3814951162 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 -- 172.21.15.193:0/3814951162 >> v1:172.21.15.62:6789/0 conn(0x55ea842422c0 legacy=0x55ea842446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 -- 172.21.15.193:0/3814951162 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea840e5ca0 con 0x55ea8423f180 2024-09-12T17:11:30.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.691+0000 7f265c871640 1 --2- 172.21.15.193:0/3814951162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8423f560 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f264c00a5c0 tx=0x7f264c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed969256ba7591b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f2657fff640 1 -- 172.21.15.193:0/3814951162 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0a6070 con 0x55ea8423f180 2024-09-12T17:11:30.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f2657fff640 1 -- 172.21.15.193:0/3814951162 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0af070 con 0x55ea8423f180 2024-09-12T17:11:30.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f2657fff640 1 -- 172.21.15.193:0/3814951162 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0aa5c0 con 0x55ea8423f180 2024-09-12T17:11:30.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3814951162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 msgr2=0x55ea8423f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/3814951162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8423f560 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f264c00a5c0 tx=0x7f264c01b340 comp rx=0 tx=0).stop 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3814951162 shutdown_connections 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/3814951162 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8423f560 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3814951162 >> 172.21.15.193:0/3814951162 conn(0x55ea841b2a90 msgr2=0x55ea841b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3814951162 shutdown_connections 2024-09-12T17:11:30.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.695+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3814951162 wait complete. 2024-09-12T17:11:30.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265ed6b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265ed6b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea84145680 con 0x55ea8423f180 2024-09-12T17:11:30.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265c871640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265c871640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52700/0 (socket says 172.21.15.193:52700) 2024-09-12T17:11:30.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265c871640 1 -- 172.21.15.193:0/3504884762 learned_addr learned my addr 172.21.15.193:0/3504884762 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265c871640 1 -- 172.21.15.193:0/3504884762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea840c0da0 con 0x55ea8423f180 2024-09-12T17:11:30.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f265c871640 1 --2- 172.21.15.193:0/3504884762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f264c0ac040 tx=0x7f264c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780edbae4eb78f56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f254ae0d640 1 -- 172.21.15.193:0/3504884762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0aa970 con 0x55ea8423f180 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f254ae0d640 1 -- 172.21.15.193:0/3504884762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0aab10 con 0x55ea8423f180 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.711+0000 7f254ae0d640 1 -- 172.21.15.193:0/3504884762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0aae30 con 0x55ea8423f180 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3504884762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 msgr2=0x55ea8432a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/3504884762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f264c0ac040 tx=0x7f264c003030 comp rx=0 tx=0).stop 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3504884762 shutdown_connections 2024-09-12T17:11:30.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/3504884762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea8432a940 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3504884762 >> 172.21.15.193:0/3504884762 conn(0x55ea841b2a90 msgr2=0x55ea843265e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3504884762 shutdown_connections 2024-09-12T17:11:30.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/3504884762 wait complete. 2024-09-12T17:11:30.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265ed6b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea840e7a50 con 0x55ea8423f180 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265c871640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265c871640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52712/0 (socket says 172.21.15.193:52712) 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265c871640 1 -- 172.21.15.193:0/1675484973 learned_addr learned my addr 172.21.15.193:0/1675484973 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265c871640 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea843323b0 con 0x55ea8423f180 2024-09-12T17:11:30.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.715+0000 7f265c871640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f264c01b170 tx=0x7f264c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 -- 172.21.15.193:0/1675484973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0c6690 con 0x55ea8423f180 2024-09-12T17:11:30.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 -- 172.21.15.193:0/1675484973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264c0cc070 con 0x55ea8423f180 2024-09-12T17:11:30.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 -- 172.21.15.193:0/1675484973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264c0c6960 con 0x55ea8423f180 2024-09-12T17:11:30.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea84332640 con 0x55ea8423f180 2024-09-12T17:11:30.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea84332ff0 con 0x55ea8423f180 2024-09-12T17:11:30.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 -- 172.21.15.193:0/1675484973 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f264c0c6b00 con 0x55ea8423f180 2024-09-12T17:11:30.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 0x7f254403bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f254960a640 1 -- 172.21.15.193:0/1675484973 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f264c0ebb60 con 0x55ea8423f180 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.719+0000 7f2654070640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 0x7f254403bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 0x55ea84338fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea84339500 con 0x55ea842422c0 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 0x55ea84338fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f2654070640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 0x7f254403bfd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2644001ec0 tx=0x7f2644001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 0x55ea84338fc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 -- 172.21.15.193:0/1675484973 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f265800a4d0 con 0x55ea842422c0 2024-09-12T17:11:30.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843398e0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 -- 172.21.15.193:0/1675484973 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f265800a4d0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8433b1b0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 -- 172.21.15.193:0/1675484973 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f265800a4d0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8433a3e0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 -- 172.21.15.193:0/1675484973 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f265800a4d0 con 0x55ea842422c0 2024-09-12T17:11:30.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8433a780 con 0x55ea842422c0 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265d072640 1 -- 172.21.15.193:0/1675484973 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f265800a4d0 con 0x55ea842422c0 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f265ed6b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea84152450 con 0x55ea843494e0 2024-09-12T17:11:30.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52722/0 (socket says 172.21.15.193:52722) 2024-09-12T17:11:30.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.723+0000 7f2654070640 1 -- 172.21.15.193:0/998233835 learned_addr learned my addr 172.21.15.193:0/998233835 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f2654070640 1 -- 172.21.15.193:0/998233835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea84349f40 con 0x55ea843494e0 2024-09-12T17:11:30.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f2654070640 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2644010fd0 tx=0x7f264400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 -- 172.21.15.193:0/998233835 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264400a040 con 0x55ea843494e0 2024-09-12T17:11:30.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea8434a7a0 con 0x55ea843494e0 2024-09-12T17:11:30.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8434ad10 con 0x55ea843494e0 2024-09-12T17:11:30.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 -- 172.21.15.193:0/998233835 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2644017050 con 0x55ea843494e0 2024-09-12T17:11:30.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 -- 172.21.15.193:0/998233835 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264400e580 con 0x55ea843494e0 2024-09-12T17:11:30.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 -- 172.21.15.193:0/998233835 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f264400e720 con 0x55ea843494e0 2024-09-12T17:11:30.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 0x7f253403bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f25427fc640 1 -- 172.21.15.193:0/998233835 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f26440520a0 con 0x55ea843494e0 2024-09-12T17:11:30.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265d072640 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 0x7f253403bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265d072640 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 0x7f253403bff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55ea84339f00 tx=0x7f2658005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f265ed6b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea8432b0d0 con 0x55ea84356ea0 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52738/0 (socket says 172.21.15.193:52738) 2024-09-12T17:11:30.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.727+0000 7f2654070640 1 -- 172.21.15.193:0/2120697453 learned_addr learned my addr 172.21.15.193:0/2120697453 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 -- 172.21.15.193:0/2120697453 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea84357890 con 0x55ea84356ea0 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 --2- 172.21.15.193:0/2120697453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2644023fd0 tx=0x7f2644025f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea179247baaea16c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2533fff640 1 -- 172.21.15.193:0/2120697453 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264401c930 con 0x55ea84356ea0 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2533fff640 1 -- 172.21.15.193:0/2120697453 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2644023300 con 0x55ea84356ea0 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2533fff640 1 -- 172.21.15.193:0/2120697453 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f264401cad0 con 0x55ea84356ea0 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/2120697453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 msgr2=0x55ea843572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/2120697453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2644023fd0 tx=0x7f2644025f00 comp rx=0 tx=0).stop 2024-09-12T17:11:30.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/2120697453 shutdown_connections 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/2120697453 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea843572a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/2120697453 >> 172.21.15.193:0/2120697453 conn(0x55ea843522c0 msgr2=0x55ea84350500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/2120697453 shutdown_connections 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/2120697453 wait complete. 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 Processor -- start 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- start start 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea84355df0 con 0x55ea84356ea0 2024-09-12T17:11:30.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52752/0 (socket says 172.21.15.193:52752) 2024-09-12T17:11:30.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 learned_addr learned my addr 172.21.15.193:0/4215540649 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea8435d940 con 0x55ea84356ea0 2024-09-12T17:11:30.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f2654070640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f264404f270 tx=0x7f2644050380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f25327fc640 1 -- 172.21.15.193:0/4215540649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2644032030 con 0x55ea84356ea0 2024-09-12T17:11:30.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea8435dbd0 con 0x55ea84356ea0 2024-09-12T17:11:30.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f25327fc640 1 -- 172.21.15.193:0/4215540649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f264401a310 con 0x55ea84356ea0 2024-09-12T17:11:30.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea8435e580 con 0x55ea84356ea0 2024-09-12T17:11:30.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.731+0000 7f25327fc640 1 -- 172.21.15.193:0/4215540649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2644050950 con 0x55ea84356ea0 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f25327fc640 1 -- 172.21.15.193:0/4215540649 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2644035070 con 0x55ea84356ea0 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f25327fc640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2528039a70 0x7f252803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f25327fc640 1 -- 172.21.15.193:0/4215540649 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f2644033070 con 0x55ea84356ea0 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265d072640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2528039a70 0x7f252803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea84368760 0x55ea8436abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436b340 con 0x55ea84368760 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea84368760 0x55ea8436abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265d072640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2528039a70 0x7f252803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55ea84333f50 tx=0x7f265801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea84368760 0x55ea8436abf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 realm 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436b750 con 0x55ea84368760 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:30.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436c020 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436c3c0 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 20 searching for the correct realm 2024-09-12T17:11:30.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea8436e980 0x55ea84370d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea843712b0 con 0x55ea8436e980 2024-09-12T17:11:30.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f2654070640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea8436e980 0x55ea84370d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.735+0000 7f2654070640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea8436e980 0x55ea84370d70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f2654070640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2644037030 0x7f264401ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea843712b0 con 0x7f2644037030 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265d072640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2644037030 0x7f264401ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265d072640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2644037030 0x7f264401ba50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265d072640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2658031040 0x7f2658032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea843712b0 con 0x7f2658031040 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2658031040 0x7f2658032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2658031040 0x7f2658032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0cf370 con 0x7f2658031040 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.739+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0cf370 con 0x7f2658031040 2024-09-12T17:11:30.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0cf370 con 0x7f2658031040 2024-09-12T17:11:30.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2644037030 2024-09-12T17:11:30.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f264c0cf370 con 0x55ea84368760 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2644037030 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.743+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2644037030 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.747+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2644037030 2024-09-12T17:11:30.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea8436e980 2024-09-12T17:11:30.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2658031040 2024-09-12T17:11:30.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x55ea84368760 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436cc10 con 0x7f2644037030 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f265801f070 con 0x7f2644037030 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436d590 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436de30 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8436de30 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 zone default found 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 4 Realm: () 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 zonegroup default 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.751+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843712b0 con 0x7f2658031040 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea84372dd0 con 0x55ea8436e980 2024-09-12T17:11:30.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843732a0 con 0x55ea8436e980 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 started sync module instance, tier type = 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:30.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84372140 con 0x7f2644037030 2024-09-12T17:11:30.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94465728914736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84371da0 con 0x7f2644037030 2024-09-12T17:11:30.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843741d0 con 0x55ea84368760 2024-09-12T17:11:30.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.755+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94465728914736] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.759+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.759+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94465728919296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843741d0 con 0x55ea84368760 2024-09-12T17:11:30.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.759+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84374b90 con 0x55ea8436e980 2024-09-12T17:11:30.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.759+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94465728919296] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94465728920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84374140 con 0x55ea8436e980 2024-09-12T17:11:30.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84375890 con 0x7f2644037030 2024-09-12T17:11:30.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94465728926960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84376130 con 0x7f2644037030 2024-09-12T17:11:30.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84376b30 con 0x55ea84368760 2024-09-12T17:11:30.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94465728920864] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94465728926960] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94465728925488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84375c80 con 0x55ea84368760 2024-09-12T17:11:30.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.763+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843773d0 con 0x7f2658031040 2024-09-12T17:11:30.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.767+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94465728925488] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.767+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.767+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94465728931392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843770f0 con 0x7f2658031040 2024-09-12T17:11:30.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.767+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84377940 con 0x7f2658031040 2024-09-12T17:11:30.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.767+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94465728931392] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94465728933200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84377740 con 0x7f2658031040 2024-09-12T17:11:30.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84378260 con 0x7f2658031040 2024-09-12T17:11:30.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94465728933200] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94465728937264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84378220 con 0x7f2658031040 2024-09-12T17:11:30.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=0 2024-09-12T17:11:30.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=1 2024-09-12T17:11:30.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=2 2024-09-12T17:11:30.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=3 2024-09-12T17:11:30.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=4 2024-09-12T17:11:30.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=5 2024-09-12T17:11:30.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.771+0000 7f265ed6b9c0 20 add_watcher() i=6 2024-09-12T17:11:30.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94465728937264] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 add_watcher() i=7 2024-09-12T17:11:30.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:30.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8437b6b0 con 0x55ea84368760 2024-09-12T17:11:30.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94465728934320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea84378bd0 con 0x55ea84368760 2024-09-12T17:11:30.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94465728934320] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f2512fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:30.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:30.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 5 note: GC not initialized 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f2511fe3640 20 reqs_thread_entry: start 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 Filter name: none 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f24837fe640 20 reqs_thread_entry: start 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:30.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.775+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439e8f0 con 0x55ea84368760 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843a09e0 con 0x7f2644037030 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:30.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:30.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:30.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843a22f0 con 0x55ea8436e980 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:30.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:30.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843a69a0 con 0x7f2658031040 2024-09-12T17:11:30.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.779+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843ac720 con 0x55ea8436e980 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94465729112496 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843a6dd0 con 0x55ea84368760 2024-09-12T17:11:30.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== watch-notify(notify (1) cookie 94465728919296 notify 137438953491 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f264c0f1080 con 0x55ea84368760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2533fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94465728919296 notifier 4524 bl.length()=760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2533fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2533fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2533fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(67 notify.1 [notify cookie 94465729112496 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f2533fff640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2520003eb0 con 0x55ea84368760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify_complete (2) cookie 94465729112496 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea84332ff0 con 0x55ea84368760 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:30.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.783+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843ab0c0 con 0x7f2644037030 2024-09-12T17:11:30.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea843a2990 con 0x7f2644037030 2024-09-12T17:11:30.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265ed6b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:30.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265ed6b9c0 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265ed6b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:30.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94465729112464 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ea843ab570 con 0x7f2658031040 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== watch-notify(notify (1) cookie 94465728933200 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55ea84332640 con 0x7f2658031040 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.787+0000 7f2533fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94465728933200 notifier 4524 bl.length()=314 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f2533fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f2533fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f2533fff640 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2520003eb0 con 0x7f2658031040 2024-09-12T17:11:30.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [notify cookie 94465729112464 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== watch-notify(notify_complete (2) cookie 94465729112464 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ea843323b0 con 0x7f2658031040 2024-09-12T17:11:30.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f2512fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94465728934320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x55ea84368760 2024-09-12T17:11:30.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94465728934320] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.791+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94465728914736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x7f2644037030 2024-09-12T17:11:30.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94465728914736] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265ed6b9c0 20 remove_watcher() i=0 2024-09-12T17:11:30.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265ed6b9c0 2 removed watcher, disabling cache 2024-09-12T17:11:30.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94465728919296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x55ea84368760 2024-09-12T17:11:30.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94465728919296] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265ed6b9c0 20 remove_watcher() i=1 2024-09-12T17:11:30.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.795+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94465728920864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x55ea8436e980 2024-09-12T17:11:30.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f2654070640 1 -- 172.21.15.193:0/4215540649 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94465728920864] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264400d040 con 0x55ea8436e980 2024-09-12T17:11:30.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 20 remove_watcher() i=2 2024-09-12T17:11:30.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94465728926960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x7f2644037030 2024-09-12T17:11:30.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265d072640 1 -- 172.21.15.193:0/4215540649 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94465728926960] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2658040040 con 0x7f2644037030 2024-09-12T17:11:30.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 20 remove_watcher() i=3 2024-09-12T17:11:30.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94465728925488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x55ea84368760 2024-09-12T17:11:30.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94465728925488] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x55ea84368760 2024-09-12T17:11:30.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 20 remove_watcher() i=4 2024-09-12T17:11:30.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.799+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94465728931392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x7f2658031040 2024-09-12T17:11:30.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94465728931392] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265ed6b9c0 20 remove_watcher() i=5 2024-09-12T17:11:30.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94465728933200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x7f2658031040 2024-09-12T17:11:30.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94465728933200] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265ed6b9c0 20 remove_watcher() i=6 2024-09-12T17:11:30.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.803+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94465728937264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ea8439c730 con 0x7f2658031040 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94465728937264] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f264c0f3040 con 0x7f2658031040 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 20 remove_watcher() i=7 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2658031040 msgr2=0x7f2658032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2658031040 0x7f2658032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea84368760 msgr2=0x55ea8436abf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea84368760 0x55ea8436abf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2644037030 msgr2=0x7f264401ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2644037030 0x7f264401ba50 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea8436e980 msgr2=0x55ea84370d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea8436e980 0x55ea84370d70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2528039a70 msgr2=0x7f252803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2528039a70 0x7f252803bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55ea84333f50 tx=0x7f265801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 msgr2=0x55ea8435d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f264404f270 tx=0x7f2644050380 comp rx=0 tx=0).stop 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265c871640 1 -- 172.21.15.193:0/4215540649 reap_dead start 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 shutdown_connections 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/4215540649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea84356ea0 0x55ea8435d3e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 >> 172.21.15.193:0/4215540649 conn(0x55ea843522c0 msgr2=0x55ea843504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 shutdown_connections 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/4215540649 wait complete. 2024-09-12T17:11:30.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 msgr2=0x7f253403bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 0x7f253403bff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55ea84339f00 tx=0x7f2658005850 comp rx=0 tx=0).stop 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 msgr2=0x55ea84349900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2644010fd0 tx=0x7f264400f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 shutdown_connections 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2534039b30 0x7f253403bff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/998233835 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea843494e0 0x55ea84349900 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 >> 172.21.15.193:0/998233835 conn(0x55ea8433ee90 msgr2=0x55ea8433f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 shutdown_connections 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/998233835 wait complete. 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 msgr2=0x55ea84338fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 0x55ea84338fc0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 msgr2=0x7f254403bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 0x7f254403bfd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2644001ec0 tx=0x7f2644001440 comp rx=0 tx=0).stop 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 msgr2=0x55ea84331e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f264c01b170 tx=0x7f264c0180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 shutdown_connections 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea842422c0 0x55ea84338fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2544039b10 0x7f254403bfd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 --2- 172.21.15.193:0/1675484973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea8423f180 0x55ea84331e50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 >> 172.21.15.193:0/1675484973 conn(0x55ea841b2a90 msgr2=0x55ea84325070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 shutdown_connections 2024-09-12T17:11:30.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.807+0000 7f265ed6b9c0 1 -- 172.21.15.193:0/1675484973 wait complete. 2024-09-12T17:11:30.824 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:30.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-12T17:11:30.824 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-12T17:11:30.901 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:30.902 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:30.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa72529c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a662b3bfa0 0x55a662b3c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa72529c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a662a799c0 con 0x55a662b3f0e0 2024-09-12T17:11:30.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa72529c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55a662ac96d0 con 0x55a662b3bfa0 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4d58640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a662b3bfa0 0x55a662b3c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4d58640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55a662b3bfa0 0x55a662b3c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52766/0 (socket says 172.21.15.193:52766) 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4557640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55a662b3f0e0 0x55a662b3f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36718/0 (socket says 172.21.15.193:36718) 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4d58640 1 -- 172.21.15.193:0/1358935671 learned_addr learned my addr 172.21.15.193:0/1358935671 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4d58640 1 -- 172.21.15.193:0/1358935671 >> v1:172.21.15.62:6789/0 conn(0x55a662b3f0e0 legacy=0x55a662b3f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa3d56640 1 -- 172.21.15.193:0/1358935671 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3230389008 0 0) 0x55a662a799c0 con 0x55a662b3f0e0 2024-09-12T17:11:30.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.899+0000 7f5fa4d58640 1 -- 172.21.15.193:0/1358935671 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662a6dca0 con 0x55a662b3bfa0 2024-09-12T17:11:30.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/1358935671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662b3c380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400a5c0 tx=0x7f5f9401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acb2d5cd6f26314 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa3d56640 1 -- 172.21.15.193:0/1358935671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940af070 con 0x55a662b3bfa0 2024-09-12T17:11:30.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa3d56640 1 -- 172.21.15.193:0/1358935671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f940aa530 con 0x55a662b3bfa0 2024-09-12T17:11:30.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa3d56640 1 -- 172.21.15.193:0/1358935671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940aa830 con 0x55a662b3bfa0 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 -- 172.21.15.193:0/1358935671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 msgr2=0x55a662b3c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/1358935671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662b3c380 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400a5c0 tx=0x7f5f9401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 -- 172.21.15.193:0/1358935671 shutdown_connections 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/1358935671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662b3c380 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 -- 172.21.15.193:0/1358935671 >> 172.21.15.193:0/1358935671 conn(0x55a662b3ab10 msgr2=0x55a662b3af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 -- 172.21.15.193:0/1358935671 shutdown_connections 2024-09-12T17:11:30.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.903+0000 7f5fa72529c0 1 -- 172.21.15.193:0/1358935671 wait complete. 2024-09-12T17:11:30.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa72529c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa72529c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a662acd680 con 0x55a662b3bfa0 2024-09-12T17:11:30.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa4d58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa4d58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52778/0 (socket says 172.21.15.193:52778) 2024-09-12T17:11:30.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.919+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2564522492 learned_addr learned my addr 172.21.15.193:0/2564522492 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2564522492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662a48da0 con 0x55a662b3bfa0 2024-09-12T17:11:30.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/2564522492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f94018f70 tx=0x7f5f94003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e052668e825048ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5e92e0d640 1 -- 172.21.15.193:0/2564522492 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940bb070 con 0x55a662b3bfa0 2024-09-12T17:11:30.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5e92e0d640 1 -- 172.21.15.193:0/2564522492 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f940aa920 con 0x55a662b3bfa0 2024-09-12T17:11:30.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5e92e0d640 1 -- 172.21.15.193:0/2564522492 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940af040 con 0x55a662b3bfa0 2024-09-12T17:11:30.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2564522492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 msgr2=0x55a662cb70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2564522492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f94018f70 tx=0x7f5f94003030 comp rx=0 tx=0).stop 2024-09-12T17:11:30.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2564522492 shutdown_connections 2024-09-12T17:11:30.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2564522492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cb70e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2564522492 >> 172.21.15.193:0/2564522492 conn(0x55a662b3ab10 msgr2=0x55a662cb2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2564522492 shutdown_connections 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2564522492 wait complete. 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa72529c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a662a6fa50 con 0x55a662b3bfa0 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52792/0 (socket says 172.21.15.193:52792) 2024-09-12T17:11:30.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 -- 172.21.15.193:0/3242678171 learned_addr learned my addr 172.21.15.193:0/3242678171 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662cbeb70 con 0x55a662b3bfa0 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.923+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5f9401bbe0 tx=0x7f5f940180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 -- 172.21.15.193:0/3242678171 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940bb040 con 0x55a662b3bfa0 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a662cbee00 con 0x55a662b3bfa0 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a662cbf830 con 0x55a662b3bfa0 2024-09-12T17:11:30.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 -- 172.21.15.193:0/3242678171 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f940b5660 con 0x55a662b3bfa0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 -- 172.21.15.193:0/3242678171 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f940af040 con 0x55a662b3bfa0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 -- 172.21.15.193:0/3242678171 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f940b5940 con 0x55a662b3bfa0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 0x7f5e8c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5e9160a640 1 -- 172.21.15.193:0/3242678171 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5f940ea7a0 con 0x55a662b3bfa0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa4557640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 0x7f5e8c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 0x55a662cc5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cc5cc0 con 0x55a662b3f0e0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa5559640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 0x55a662cc5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa4557640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 0x7f5e8c03bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f98000c10 tx=0x7f5f980013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa5559640 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 0x55a662cc5780 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa5559640 1 -- 172.21.15.193:0/3242678171 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f9c00a4d0 con 0x55a662b3f0e0 2024-09-12T17:11:30.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cbfba0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa5559640 1 -- 172.21.15.193:0/3242678171 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f9c00a4d0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cc7aa0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa5559640 1 -- 172.21.15.193:0/3242678171 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f9c00a4d0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.927+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cc6cd0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa5559640 1 -- 172.21.15.193:0/3242678171 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f9c00a4d0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cc7120 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa5559640 1 -- 172.21.15.193:0/3242678171 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f9c00a4d0 con 0x55a662b3f0e0 2024-09-12T17:11:30.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a662ada450 con 0x55a662cd5db0 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52798/0 (socket says 172.21.15.193:52798) 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa4557640 1 -- 172.21.15.193:0/4045899559 learned_addr learned my addr 172.21.15.193:0/4045899559 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa4557640 1 -- 172.21.15.193:0/4045899559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662cd6810 con 0x55a662cd5db0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa4557640 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800e620 tx=0x7f5f9800e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5e8a7fc640 1 -- 172.21.15.193:0/4045899559 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f98022070 con 0x55a662cd5db0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5e8a7fc640 1 -- 172.21.15.193:0/4045899559 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9801b380 con 0x55a662cd5db0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a662cd7070 con 0x55a662cd5db0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5e8a7fc640 1 -- 172.21.15.193:0/4045899559 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9801b660 con 0x55a662cd5db0 2024-09-12T17:11:30.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.931+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a662cd75e0 con 0x55a662cd5db0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e8a7fc640 1 -- 172.21.15.193:0/4045899559 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f98025070 con 0x55a662cd5db0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e8a7fc640 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 0x7f5e7c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e8a7fc640 1 -- 172.21.15.193:0/4045899559 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5f98051830 con 0x55a662cd5db0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa5559640 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 0x7f5e7c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa5559640 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 0x7f5e7c03bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55a662cc67f0 tx=0x7f5f9c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a662cb7870 con 0x55a662ce3720 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52810/0 (socket says 172.21.15.193:52810) 2024-09-12T17:11:30.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 -- 172.21.15.193:0/672819338 learned_addr learned my addr 172.21.15.193:0/672819338 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 -- 172.21.15.193:0/672819338 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662ce40f0 con 0x55a662ce3720 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 --2- 172.21.15.193:0/672819338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f9804fbb0 tx=0x7f5f9800df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3d991b2f2a854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e7bfff640 1 -- 172.21.15.193:0/672819338 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9800d300 con 0x55a662ce3720 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e7bfff640 1 -- 172.21.15.193:0/672819338 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f98024ca0 con 0x55a662ce3720 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5e7bfff640 1 -- 172.21.15.193:0/672819338 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9800d4a0 con 0x55a662ce3720 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- 172.21.15.193:0/672819338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 msgr2=0x55a662ce3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/672819338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5f9804fbb0 tx=0x7f5f9800df40 comp rx=0 tx=0).stop 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- 172.21.15.193:0/672819338 shutdown_connections 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/672819338 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce3b00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- 172.21.15.193:0/672819338 >> 172.21.15.193:0/672819338 conn(0x55a662cdeae0 msgr2=0x55a662cdcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- 172.21.15.193:0/672819338 shutdown_connections 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- 172.21.15.193:0/672819338 wait complete. 2024-09-12T17:11:30.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 Processor -- start 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- start start 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa72529c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55a662ce2610 con 0x55a662ce3720 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52824/0 (socket says 172.21.15.193:52824) 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.935+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 learned_addr learned my addr 172.21.15.193:0/2340895591 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a662cea180 con 0x55a662ce3720 2024-09-12T17:11:30.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4557640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5f98024a00 tx=0x7f5f9804fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 -- 172.21.15.193:0/2340895591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f98026740 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a662cea410 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 -- 172.21.15.193:0/2340895591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f9801ae50 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 -- 172.21.15.193:0/2340895591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f9804e430 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a662cea410 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 -- 172.21.15.193:0/2340895591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5f9804e690 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e70039a20 0x7f5e7003bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5e7a7fc640 1 -- 172.21.15.193:0/2340895591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f5f98047070 con 0x55a662ce3720 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa5559640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e70039a20 0x7f5e7003bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662cf4cf0 0x55a662cf7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf78d0 con 0x55a662cf4cf0 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662cf4cf0 0x55a662cf7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa5559640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e70039a20 0x7f5e7003bee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55a662cbfae0 tx=0x7f5f9c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662cf4cf0 0x55a662cf7180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 realm 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf7ce0 con 0x55a662cf4cf0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.939+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf85b0 con 0x55a662cf4cf0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf8950 con 0x55a662cf4cf0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf91a0 con 0x55a662cf4cf0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 20 searching for the correct realm 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a662cfaf10 0x55a662cfd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4557640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a662cfaf10 0x55a662cfd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4557640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a662cfaf10 0x55a662cfd300 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4557640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5f98027060 0x7f5f9801c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f98027060 2024-09-12T17:11:30.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa5559640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5f98027060 0x7f5f9801c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa5559640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5f98027060 0x7f5f9801c420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa5559640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5f9c031040 0x7f5f9c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5f9c031040 0x7f5f9c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.943+0000 7f5fa4d58640 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5f9c031040 0x7f5f9c032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f98027060 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.947+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f98027060 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.951+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f98027060 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cf4cf0 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f98027060 2024-09-12T17:11:30.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x55a662cfaf10 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfd840 con 0x7f5f9c031040 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5f940fc040 con 0x55a662cf4cf0 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.955+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5f940fc040 con 0x7f5f98027060 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:30.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf99f0 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf9de0 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cf9de0 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 zone default found 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 4 Realm: () 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 zonegroup default 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfa2b0 con 0x7f5f9c031040 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cff660 con 0x55a662cfaf10 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662cffa00 con 0x55a662cfaf10 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 started sync module instance, tier type = 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfeb00 con 0x7f5f98027060 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.959+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94173110726432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00250 con 0x7f5f98027060 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00aa0 con 0x55a662cf4cf0 2024-09-12T17:11:30.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94173110726432] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94173110730144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00670 con 0x55a662cf4cf0 2024-09-12T17:11:30.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.963+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d010b0 con 0x55a662cfaf10 2024-09-12T17:11:30.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94173110733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d01950 con 0x55a662cfaf10 2024-09-12T17:11:30.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d02350 con 0x7f5f98027060 2024-09-12T17:11:30.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94173110730144] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94173110731200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d02740 con 0x7f5f98027060 2024-09-12T17:11:30.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d03100 con 0x55a662cf4cf0 2024-09-12T17:11:30.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94173110733696] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94173110731200] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94173110738528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d02c50 con 0x55a662cf4cf0 2024-09-12T17:11:30.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.967+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d039a0 con 0x7f5f9c031040 2024-09-12T17:11:30.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.971+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94173110738528] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.971+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.971+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94173110736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d02c50 con 0x7f5f9c031040 2024-09-12T17:11:30.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.971+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d03e60 con 0x7f5f9c031040 2024-09-12T17:11:30.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94173110736032] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94173110745392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d03e20 con 0x7f5f9c031040 2024-09-12T17:11:30.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d04820 con 0x7f5f9c031040 2024-09-12T17:11:30.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94173110745392] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94173110743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d047e0 con 0x7f5f9c031040 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=0 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=1 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=2 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=3 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=4 2024-09-12T17:11:30.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=5 2024-09-12T17:11:30.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.975+0000 7f5fa72529c0 20 add_watcher() i=6 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94173110743744] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 20 add_watcher() i=7 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d07c70 con 0x55a662cf4cf0 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94173110748416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d05130 con 0x55a662cf4cf0 2024-09-12T17:11:30.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94173110748416] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5e5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:30.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:30.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:30.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.979+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d10470 con 0x55a662cf4cf0 2024-09-12T17:11:30.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.983+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.983+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d10ac0 con 0x7f5f9c031040 2024-09-12T17:11:30.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d109f0 con 0x55a662cfaf10 2024-09-12T17:11:30.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d112a0 con 0x55a662cf4cf0 2024-09-12T17:11:30.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.987+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0fc90 con 0x7f5f98027060 2024-09-12T17:11:30.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'36 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:30.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0fc90 con 0x55a662cfaf10 2024-09-12T17:11:30.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:30.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d118c0 con 0x55a662cf4cf0 2024-09-12T17:11:30.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:30.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.991+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d118c0 con 0x7f5f9c031040 2024-09-12T17:11:30.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.995+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:30.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.995+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d118c0 con 0x7f5f98027060 2024-09-12T17:11:31.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.995+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.999+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d11e30 con 0x55a662cfaf10 2024-09-12T17:11:31.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.999+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.999+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d121d0 con 0x7f5f98027060 2024-09-12T17:11:31.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.999+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'37 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:30.999+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12740 con 0x7f5f9c031040 2024-09-12T17:11:31.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.003+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.003+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12740 con 0x7f5f98027060 2024-09-12T17:11:31.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.003+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.003+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d127d0 con 0x7f5f9c031040 2024-09-12T17:11:31.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.007+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.007+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d127d0 con 0x55a662cf4cf0 2024-09-12T17:11:31.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.007+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.007+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d127d0 con 0x55a662cfaf10 2024-09-12T17:11:31.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.011+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.011+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12860 con 0x7f5f98027060 2024-09-12T17:11:31.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.011+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.011+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12860 con 0x55a662cfaf10 2024-09-12T17:11:31.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.015+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.015+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12860 con 0x55a662cf4cf0 2024-09-12T17:11:31.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.015+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.015+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12860 con 0x55a662cf4cf0 2024-09-12T17:11:31.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.019+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.019+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12860 con 0x55a662cfaf10 2024-09-12T17:11:31.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.019+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.019+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12900 con 0x7f5f98027060 2024-09-12T17:11:31.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x55a662cfaf10 2024-09-12T17:11:31.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x55a662cfaf10 2024-09-12T17:11:31.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.023+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x55a662cfaf10 2024-09-12T17:11:31.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.027+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.027+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x55a662cfaf10 2024-09-12T17:11:31.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.027+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.027+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x7f5f9c031040 2024-09-12T17:11:31.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.031+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.031+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x55a662cfaf10 2024-09-12T17:11:31.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.031+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.031+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12e70 con 0x7f5f9c031040 2024-09-12T17:11:31.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.035+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.035+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d129c0 con 0x55a662cfaf10 2024-09-12T17:11:31.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.035+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.035+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d129a0 con 0x7f5f9c031040 2024-09-12T17:11:31.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.039+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.039+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d12980 con 0x7f5f98027060 2024-09-12T17:11:31.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5e5a7e4640 20 reqs_thread_entry: start 2024-09-12T17:11:31.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:31.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 20 Filter name: none 2024-09-12T17:11:31.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5e537fe640 20 reqs_thread_entry: start 2024-09-12T17:11:31.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:11:31.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0f510 con 0x7f5f9c031040 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:31.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.043+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0f510 con 0x7f5f9c031040 2024-09-12T17:11:31.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa72529c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:11:31.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0f510 con 0x7f5f9c031040 2024-09-12T17:11:31.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa72529c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:31.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94173110923424 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d30a60 con 0x55a662cfaf10 2024-09-12T17:11:31.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== watch-notify(notify (1) cookie 94173110733696 notify 137438953475 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a662d11900 con 0x55a662cfaf10 2024-09-12T17:11:31.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5e7bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94173110733696 notifier 4531 bl.length()=170 2024-09-12T17:11:31.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5e7bfff640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5e68003d70 con 0x55a662cfaf10 2024-09-12T17:11:31.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(97 notify.2 [notify cookie 94173110923424 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.047+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== watch-notify(notify_complete (2) cookie 94173110923424 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5f98065040 con 0x55a662cfaf10 2024-09-12T17:11:31.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa72529c0 10 removing email index: 2024-09-12T17:11:31.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa72529c0 10 removing user buckets index 2024-09-12T17:11:31.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d2e540 con 0x7f5f9c031040 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa72529c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94173110923424 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d30a10 con 0x7f5f9c031040 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== watch-notify(notify (1) cookie 94173110745392 notify 137438953478 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a662d121d0 con 0x7f5f9c031040 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94173110745392 notifier 4531 bl.length()=160 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(100 notify.6 [notify cookie 94173110923424 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.051+0000 7f5e7b7fe640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5dcc0032d0 con 0x7f5f9c031040 2024-09-12T17:11:31.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== watch-notify(notify_complete (2) cookie 94173110923424 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5f940db040 con 0x7f5f9c031040 2024-09-12T17:11:31.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa72529c0 10 removing user index: fud 2024-09-12T17:11:31.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d32a30 con 0x7f5f9c031040 2024-09-12T17:11:31.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(102 fud [call,call,delete] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa72529c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T17:11:31.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa72529c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:11:31.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94173110919312 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a662d2f970 con 0x7f5f9c031040 2024-09-12T17:11:31.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== watch-notify(notify (1) cookie 94173110736032 notify 137438953479 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f5f940db040 con 0x7f5f9c031040 2024-09-12T17:11:31.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5e7bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94173110736032 notifier 4531 bl.length()=152 2024-09-12T17:11:31.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(103 notify.5 [notify cookie 94173110919312 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.055+0000 7f5e7bfff640 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5e68003d70 con 0x7f5f9c031040 2024-09-12T17:11:31.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== watch-notify(notify_complete (2) cookie 94173110919312 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a662cbf830 con 0x7f5f9c031040 2024-09-12T17:11:31.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5e5b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94173110748416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d0d730 con 0x55a662cf4cf0 2024-09-12T17:11:31.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94173110748416] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.059+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94173110726432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d044d0 con 0x7f5f98027060 2024-09-12T17:11:31.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94173110726432] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa72529c0 20 remove_watcher() i=0 2024-09-12T17:11:31.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa72529c0 2 removed watcher, disabling cache 2024-09-12T17:11:31.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94173110730144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfef20 con 0x55a662cf4cf0 2024-09-12T17:11:31.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94173110730144] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa72529c0 20 remove_watcher() i=1 2024-09-12T17:11:31.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.063+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94173110733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662cfef20 con 0x55a662cfaf10 2024-09-12T17:11:31.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa4557640 1 -- 172.21.15.193:0/2340895591 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94173110733696] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9805a040 con 0x55a662cfaf10 2024-09-12T17:11:31.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa72529c0 20 remove_watcher() i=2 2024-09-12T17:11:31.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94173110731200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00b80 con 0x7f5f98027060 2024-09-12T17:11:31.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa5559640 1 -- 172.21.15.193:0/2340895591 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94173110731200] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f9c01f070 con 0x7f5f98027060 2024-09-12T17:11:31.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa72529c0 20 remove_watcher() i=3 2024-09-12T17:11:31.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.067+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94173110738528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00b80 con 0x55a662cf4cf0 2024-09-12T17:11:31.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94173110738528] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x55a662cf4cf0 2024-09-12T17:11:31.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa72529c0 20 remove_watcher() i=4 2024-09-12T17:11:31.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94173110736032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00b80 con 0x7f5f9c031040 2024-09-12T17:11:31.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94173110736032] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa72529c0 20 remove_watcher() i=5 2024-09-12T17:11:31.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.071+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94173110745392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d014a0 con 0x7f5f9c031040 2024-09-12T17:11:31.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94173110745392] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa72529c0 20 remove_watcher() i=6 2024-09-12T17:11:31.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94173110743744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a662d00b80 con 0x7f5f9c031040 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94173110743744] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f940b2040 con 0x7f5f9c031040 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa72529c0 20 remove_watcher() i=7 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5f9c031040 msgr2=0x7f5f9c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.075+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5f9c031040 0x7f5f9c032940 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662cf4cf0 msgr2=0x55a662cf7180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662cf4cf0 0x55a662cf7180 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5f98027060 msgr2=0x7f5f9801c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f5f98027060 0x7f5f9801c420 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a662cfaf10 msgr2=0x55a662cfd300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55a662cfaf10 0x55a662cfd300 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e70039a20 msgr2=0x7f5e7003bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e70039a20 0x7f5e7003bee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55a662cbfae0 tx=0x7f5f9c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa4d58640 1 -- 172.21.15.193:0/2340895591 reap_dead start 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 msgr2=0x55a662ce9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5f98024a00 tx=0x7f5f9804fb10 comp rx=0 tx=0).stop 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 shutdown_connections 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/2340895591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662ce3720 0x55a662ce9c20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 >> 172.21.15.193:0/2340895591 conn(0x55a662cdeae0 msgr2=0x55a662cdccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 shutdown_connections 2024-09-12T17:11:31.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/2340895591 wait complete. 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 msgr2=0x7f5e7c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 0x7f5e7c03bf30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55a662cc67f0 tx=0x7f5f9c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 msgr2=0x55a662cd61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800e620 tx=0x7f5f9800e650 comp rx=0 tx=0).stop 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 shutdown_connections 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e7c039a70 0x7f5e7c03bf30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/4045899559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662cd5db0 0x55a662cd61d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 >> 172.21.15.193:0/4045899559 conn(0x55a662ccb760 msgr2=0x55a662ccbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 shutdown_connections 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/4045899559 wait complete. 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 msgr2=0x55a662cc5780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 0x55a662cc5780 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 msgr2=0x7f5e8c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 0x7f5e8c03bf30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f98000c10 tx=0x7f5f980013c0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 msgr2=0x55a662cbe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5f9401bbe0 tx=0x7f5f940180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 shutdown_connections 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55a662b3f0e0 0x55a662cc5780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5e8c039a70 0x7f5e8c03bf30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 --2- 172.21.15.193:0/3242678171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a662b3bfa0 0x55a662cbe610 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 >> 172.21.15.193:0/3242678171 conn(0x55a662b3ab10 msgr2=0x55a662cb17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 shutdown_connections 2024-09-12T17:11:31.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.079+0000 7f5fa72529c0 1 -- 172.21.15.193:0/3242678171 wait complete. 2024-09-12T17:11:31.095 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:11:31.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-12T17:11:31.096 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-12T17:11:31.189 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:31.189 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:31.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e72869c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ba7e2e560 0x556ba7ec26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e72869c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ba7d6e9c0 con 0x556ba7e2e180 2024-09-12T17:11:31.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e72869c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556ba7dbe6d0 con 0x556ba7e2e560 2024-09-12T17:11:31.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e458b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ba7e2e560 0x556ba7ec26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e458b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ba7e2e560 0x556ba7ec26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52836/0 (socket says 172.21.15.193:52836) 2024-09-12T17:11:31.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e4d8c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556ba7e2e180 0x556ba7ebefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36720/0 (socket says 172.21.15.193:36720) 2024-09-12T17:11:31.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e458b640 1 -- 172.21.15.193:0/4253949674 learned_addr learned my addr 172.21.15.193:0/4253949674 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e458b640 1 -- 172.21.15.193:0/4253949674 >> v1:172.21.15.62:6789/0 conn(0x556ba7e2e180 legacy=0x556ba7ebefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.187+0000 7f99e458b640 1 -- 172.21.15.193:0/4253949674 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7d62ca0 con 0x556ba7e2e560 2024-09-12T17:11:31.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e458b640 1 --2- 172.21.15.193:0/4253949674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e560 0x556ba7ec26e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99d800a5c0 tx=0x7f99d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30aac7fb75f2870 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e3d8a640 1 -- 172.21.15.193:0/4253949674 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80a6070 con 0x556ba7e2e560 2024-09-12T17:11:31.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e3d8a640 1 -- 172.21.15.193:0/4253949674 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80af070 con 0x556ba7e2e560 2024-09-12T17:11:31.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e3d8a640 1 -- 172.21.15.193:0/4253949674 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80aa5c0 con 0x556ba7e2e560 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 -- 172.21.15.193:0/4253949674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e560 msgr2=0x556ba7ec26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 --2- 172.21.15.193:0/4253949674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e560 0x556ba7ec26e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f99d800a5c0 tx=0x7f99d801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 -- 172.21.15.193:0/4253949674 shutdown_connections 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 --2- 172.21.15.193:0/4253949674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e560 0x556ba7ec26e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 -- 172.21.15.193:0/4253949674 >> 172.21.15.193:0/4253949674 conn(0x556ba7eb48a0 msgr2=0x556ba7eb6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 -- 172.21.15.193:0/4253949674 shutdown_connections 2024-09-12T17:11:31.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.191+0000 7f99e72869c0 1 -- 172.21.15.193:0/4253949674 wait complete. 2024-09-12T17:11:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ba7dc2680 con 0x556ba7e2e180 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e4d8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e4d8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52840/0 (socket says 172.21.15.193:52840) 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2006912398 learned_addr learned my addr 172.21.15.193:0/2006912398 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2006912398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7d3dda0 con 0x556ba7e2e180 2024-09-12T17:11:31.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/2006912398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f99dc001680 tx=0x7f99dc001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf599a964a05182f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f98d2e0d640 1 -- 172.21.15.193:0/2006912398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc013420 con 0x556ba7e2e180 2024-09-12T17:11:31.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f98d2e0d640 1 -- 172.21.15.193:0/2006912398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc0135c0 con 0x556ba7e2e180 2024-09-12T17:11:31.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f98d2e0d640 1 -- 172.21.15.193:0/2006912398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc0138e0 con 0x556ba7e2e180 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- 172.21.15.193:0/2006912398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 msgr2=0x556ba7fa7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2006912398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f99dc001680 tx=0x7f99dc001b40 comp rx=0 tx=0).stop 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- 172.21.15.193:0/2006912398 shutdown_connections 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2006912398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7fa7940 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- 172.21.15.193:0/2006912398 >> 172.21.15.193:0/2006912398 conn(0x556ba7eb48a0 msgr2=0x556ba7fa3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- 172.21.15.193:0/2006912398 shutdown_connections 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- 172.21.15.193:0/2006912398 wait complete. 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.207+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ba7d64a50 con 0x556ba7e2e180 2024-09-12T17:11:31.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e4d8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e4d8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52844/0 (socket says 172.21.15.193:52844) 2024-09-12T17:11:31.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e4d8c640 1 -- 172.21.15.193:0/1710123294 learned_addr learned my addr 172.21.15.193:0/1710123294 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e4d8c640 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7faf540 con 0x556ba7e2e180 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x556ba7fa88d0 tx=0x7f99dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 -- 172.21.15.193:0/1710123294 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc0037a0 con 0x556ba7e2e180 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba7faf7d0 con 0x556ba7e2e180 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 -- 172.21.15.193:0/1710123294 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99dc023070 con 0x556ba7e2e180 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 -- 172.21.15.193:0/1710123294 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99dc003ad0 con 0x556ba7e2e180 2024-09-12T17:11:31.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba7fb0180 con 0x556ba7e2e180 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 -- 172.21.15.193:0/1710123294 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99dc010070 con 0x556ba7e2e180 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 0x7f98cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f98d160a640 1 -- 172.21.15.193:0/1710123294 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f99dc050220 con 0x556ba7e2e180 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e458b640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 0x7f98cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 0x556ba7fb6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fb6690 con 0x556ba7e2e560 2024-09-12T17:11:31.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.211+0000 7f99e558d640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 0x556ba7fb6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 0x7f98cc03bf80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ae000 tx=0x7f99d80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 0x556ba7fb6150 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 -- 172.21.15.193:0/1710123294 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99d40083f0 con 0x556ba7e2e560 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fb6ae0 con 0x556ba7e2e560 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 -- 172.21.15.193:0/1710123294 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99d40083f0 con 0x556ba7e2e560 2024-09-12T17:11:31.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fb83e0 con 0x556ba7e2e560 2024-09-12T17:11:31.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 -- 172.21.15.193:0/1710123294 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99d40083f0 con 0x556ba7e2e560 2024-09-12T17:11:31.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fb7610 con 0x556ba7e2e560 2024-09-12T17:11:31.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 -- 172.21.15.193:0/1710123294 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99d40083f0 con 0x556ba7e2e560 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fb7a30 con 0x556ba7e2e560 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e558d640 1 -- 172.21.15.193:0/1710123294 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99d40083f0 con 0x556ba7e2e560 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e72869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ba7dcf450 con 0x556ba7fc6740 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52850/0 (socket says 172.21.15.193:52850) 2024-09-12T17:11:31.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 -- 172.21.15.193:0/2768719685 learned_addr learned my addr 172.21.15.193:0/2768719685 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 -- 172.21.15.193:0/2768719685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7fc71a0 con 0x556ba7fc6740 2024-09-12T17:11:31.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.215+0000 7f99e458b640 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c10 tx=0x7f99d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 -- 172.21.15.193:0/2768719685 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80b3b90 con 0x556ba7fc6740 2024-09-12T17:11:31.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 -- 172.21.15.193:0/2768719685 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80b3d30 con 0x556ba7fc6740 2024-09-12T17:11:31.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba7fc7a00 con 0x556ba7fc6740 2024-09-12T17:11:31.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 -- 172.21.15.193:0/2768719685 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80c8560 con 0x556ba7fc6740 2024-09-12T17:11:31.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba7fc7f10 con 0x556ba7fc6740 2024-09-12T17:11:31.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 -- 172.21.15.193:0/2768719685 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99d80d1440 con 0x556ba7fc6740 2024-09-12T17:11:31.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 0x7f98bc03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f98ca7fc640 1 -- 172.21.15.193:0/2768719685 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f99d80edb30 con 0x556ba7fc6740 2024-09-12T17:11:31.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e558d640 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 0x7f98bc03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e558d640 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 0x7f98bc03bf20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x556ba7fb79b0 tx=0x7f99d4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e72869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ba7fa8190 con 0x556ba7fd3f90 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52852/0 (socket says 172.21.15.193:52852) 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e458b640 1 -- 172.21.15.193:0/683063171 learned_addr learned my addr 172.21.15.193:0/683063171 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.219+0000 7f99e458b640 1 -- 172.21.15.193:0/683063171 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7fd4980 con 0x556ba7fd3f90 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 --2- 172.21.15.193:0/683063171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ebe80 tx=0x7f99d80bd960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52491559af0e535f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98bbfff640 1 -- 172.21.15.193:0/683063171 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80e9030 con 0x556ba7fd3f90 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98bbfff640 1 -- 172.21.15.193:0/683063171 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80be410 con 0x556ba7fd3f90 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98bbfff640 1 -- 172.21.15.193:0/683063171 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80bcca0 con 0x556ba7fd3f90 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/683063171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 msgr2=0x556ba7fd4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 --2- 172.21.15.193:0/683063171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ebe80 tx=0x7f99d80bd960 comp rx=0 tx=0).stop 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/683063171 shutdown_connections 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 --2- 172.21.15.193:0/683063171 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fd4390 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/683063171 >> 172.21.15.193:0/683063171 conn(0x556ba7fcf3b0 msgr2=0x556ba7fcd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/683063171 shutdown_connections 2024-09-12T17:11:31.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/683063171 wait complete. 2024-09-12T17:11:31.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 Processor -- start 2024-09-12T17:11:31.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- start start 2024-09-12T17:11:31.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fda520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ba7fd2ee0 con 0x556ba7fd3f90 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fda520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fda520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52866/0 (socket says 172.21.15.193:52866) 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 learned_addr learned my addr 172.21.15.193:0/2391821811 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba7fdaa80 con 0x556ba7fd3f90 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e458b640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fda520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f99d80bd9a0 tx=0x7f99d80ebe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98ba7fc640 1 -- 172.21.15.193:0/2391821811 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80f2070 con 0x556ba7fd3f90 2024-09-12T17:11:31.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ba7fdad10 con 0x556ba7fd3f90 2024-09-12T17:11:31.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba7fdb6c0 con 0x556ba7fd3f90 2024-09-12T17:11:31.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98ba7fc640 1 -- 172.21.15.193:0/2391821811 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d80ede50 con 0x556ba7fd3f90 2024-09-12T17:11:31.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.223+0000 7f98ba7fc640 1 -- 172.21.15.193:0/2391821811 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99d80fc060 con 0x556ba7fd3f90 2024-09-12T17:11:31.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f98ba7fc640 1 -- 172.21.15.193:0/2391821811 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f99d80f5070 con 0x556ba7fd3f90 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f98ba7fc640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98b0039a70 0x7f98b003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f98ba7fc640 1 -- 172.21.15.193:0/2391821811 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f99d80d7020 con 0x556ba7fd3f90 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e558d640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98b0039a70 0x7f98b003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7fe5830 0x556ba7fe7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fe83f0 con 0x556ba7fe5830 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7fe5830 0x556ba7fe7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e558d640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98b0039a70 0x7f98b003bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99d400f010 tx=0x7f99d401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7fe5830 0x556ba7fe7ca0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 realm 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fe8800 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fe90d0 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fe9470 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fe9cc0 con 0x556ba7fe5830 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 20 searching for the correct realm 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ba7feba30 0x556ba7fede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e458b640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ba7feba30 0x556ba7fede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.227+0000 7f99e458b640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ba7feba30 0x556ba7fede20 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e458b640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f99d80f7060 0x7f99d80c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e558d640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f99d80f7060 0x7f99d80c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e558d640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f99d80f7060 0x7f99d80c8a30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e558d640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f99d4019040 0x7f99d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f99d4019040 0x7f99d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f99d4019040 0x7f99d4019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.231+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.235+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.239+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7feba30 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d4019040 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x556ba7fe5830 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fee360 con 0x7f99d80f7060 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fea610 con 0x556ba7fe5830 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7feaeb0 con 0x556ba7fe5830 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fea250 con 0x556ba7fe5830 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 zone default found 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 4 Realm: () 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:31.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 zonegroup default 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.243+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7feaeb0 con 0x7f99d4019040 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff01d0 con 0x556ba7feba30 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff0690 con 0x556ba7feba30 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 started sync module instance, tier type = 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fef670 con 0x7f99d80f7060 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93920868366944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7fef2d0 con 0x7f99d80f7060 2024-09-12T17:11:31.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff15c0 con 0x556ba7fe5830 2024-09-12T17:11:31.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.247+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93920868366944] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93920868371184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff15c0 con 0x556ba7fe5830 2024-09-12T17:11:31.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff1f80 con 0x556ba7feba30 2024-09-12T17:11:31.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93920868371184] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93920868372752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff1530 con 0x556ba7feba30 2024-09-12T17:11:31.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.251+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff2c80 con 0x7f99d80f7060 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93920868378848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff3520 con 0x7f99d80f7060 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff3f20 con 0x556ba7fe5830 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93920868372752] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93920868378848] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93920868377376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff3070 con 0x556ba7fe5830 2024-09-12T17:11:31.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.255+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff47c0 con 0x7f99d4019040 2024-09-12T17:11:31.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93920868377376] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93920868383280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff3070 con 0x7f99d4019040 2024-09-12T17:11:31.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff4c10 con 0x7f99d4019040 2024-09-12T17:11:31.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93920868386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff5070 con 0x7f99d4019040 2024-09-12T17:11:31.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff5b60 con 0x7f99d4019040 2024-09-12T17:11:31.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.259+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93920868383280] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93920868390448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff5b20 con 0x7f99d4019040 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=0 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=1 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=2 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=3 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=4 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=5 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93920868386656] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=6 2024-09-12T17:11:31.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93920868390448] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 20 add_watcher() i=7 2024-09-12T17:11:31.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:31.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff4b80 con 0x556ba7fe5830 2024-09-12T17:11:31.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.263+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93920868387712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba7ff5f80 con 0x556ba7fe5830 2024-09-12T17:11:31.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93920868387712] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f989afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 5 note: GC not initialized 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f9899fe3640 20 reqs_thread_entry: start 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 Filter name: none 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f980b7fe640 20 reqs_thread_entry: start 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba801be50 con 0x7f99d4019040 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba801a440 con 0x7f99d4019040 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:31.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:11:31.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:11:31.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.267+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba801acc0 con 0x7f99d4019040 2024-09-12T17:11:31.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e72869c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T17:11:31.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e72869c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:11:31.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e72869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T17:11:31.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93920868542480 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba801f8f0 con 0x7f99d80f7060 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== watch-notify(notify (1) cookie 93920868378848 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f99d4010040 con 0x7f99d80f7060 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f98bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93920868378848 notifier 4538 bl.length()=610 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f98bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f98bbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 notify.3 [notify cookie 93920868542480 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f98bbfff640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f98a8003eb0 con 0x7f99d80f7060 2024-09-12T17:11:31.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== watch-notify(notify_complete (2) cookie 93920868542480 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f99d40269d0 con 0x7f99d80f7060 2024-09-12T17:11:31.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.271+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba801d420 con 0x7f99d4019040 2024-09-12T17:11:31.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e72869c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:31.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e72869c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:31.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e72869c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:31.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93920868542400 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ba801f8f0 con 0x556ba7feba30 2024-09-12T17:11:31.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 93920868372752 notify 137438953476 ret 0) ==== 234+0+0 (crc 0 0 0) 0x556ba7fdad10 con 0x556ba7feba30 2024-09-12T17:11:31.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f98bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93920868372752 notifier 4538 bl.length()=192 2024-09-12T17:11:31.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f98bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:11:31.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f98bb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:11:31.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 notify.2 [notify cookie 93920868542400 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f98bb7fe640 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9818003410 con 0x556ba7feba30 2024-09-12T17:11:31.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== watch-notify(notify_complete (2) cookie 93920868542400 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ba7fdaa80 con 0x556ba7feba30 2024-09-12T17:11:31.280 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:11:31.273491Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:31.273475Z","tags":[],"group_ids":[]} 2024-09-12T17:11:31.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f989afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93920868387712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x556ba7fe5830 2024-09-12T17:11:31.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.275+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93920868387712] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93920868366944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x7f99d80f7060 2024-09-12T17:11:31.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93920868366944] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 20 remove_watcher() i=0 2024-09-12T17:11:31.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 2 removed watcher, disabling cache 2024-09-12T17:11:31.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93920868371184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x556ba7fe5830 2024-09-12T17:11:31.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93920868371184] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 20 remove_watcher() i=1 2024-09-12T17:11:31.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.279+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93920868372752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x556ba7feba30 2024-09-12T17:11:31.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e458b640 1 -- 172.21.15.193:0/2391821811 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93920868372752] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d80f4030 con 0x556ba7feba30 2024-09-12T17:11:31.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e72869c0 20 remove_watcher() i=2 2024-09-12T17:11:31.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93920868378848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x7f99d80f7060 2024-09-12T17:11:31.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e558d640 1 -- 172.21.15.193:0/2391821811 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93920868378848] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99d402f040 con 0x7f99d80f7060 2024-09-12T17:11:31.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e72869c0 20 remove_watcher() i=3 2024-09-12T17:11:31.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.283+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93920868377376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x556ba7fe5830 2024-09-12T17:11:31.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93920868377376] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x556ba7fe5830 2024-09-12T17:11:31.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e72869c0 20 remove_watcher() i=4 2024-09-12T17:11:31.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93920868383280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x7f99d4019040 2024-09-12T17:11:31.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93920868383280] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e72869c0 20 remove_watcher() i=5 2024-09-12T17:11:31.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.287+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93920868386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x7f99d4019040 2024-09-12T17:11:31.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93920868386656] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 20 remove_watcher() i=6 2024-09-12T17:11:31.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93920868390448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ba8019a60 con 0x7f99d4019040 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93920868390448] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f99dc00f030 con 0x7f99d4019040 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 20 remove_watcher() i=7 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f99d4019040 msgr2=0x7f99d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f99d4019040 0x7f99d4019930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7fe5830 msgr2=0x556ba7fe7ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7fe5830 0x556ba7fe7ca0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f99d80f7060 msgr2=0x7f99d80c8a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f99d80f7060 0x7f99d80c8a30 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ba7feba30 msgr2=0x556ba7fede20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ba7feba30 0x556ba7fede20 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98b0039a70 msgr2=0x7f98b003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98b0039a70 0x7f98b003bf30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f99d400f010 tx=0x7f99d401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 msgr2=0x556ba7fda520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2391821811 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fd3f90 0x556ba7fda520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f99d80bd9a0 tx=0x7f99d80ebe10 comp rx=0 tx=0).stop 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 reap_dead start 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e4d8c640 1 -- 172.21.15.193:0/2391821811 reap_dead start 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 shutdown_connections 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 >> 172.21.15.193:0/2391821811 conn(0x556ba7fcf3b0 msgr2=0x556ba7fcd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 shutdown_connections 2024-09-12T17:11:31.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.291+0000 7f99e72869c0 1 -- 172.21.15.193:0/2391821811 wait complete. 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 msgr2=0x7f98bc03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 0x7f98bc03bf20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x556ba7fb79b0 tx=0x7f99d4003070 comp rx=0 tx=0).stop 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 msgr2=0x556ba7fc6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99d8000c10 tx=0x7f99d80180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 shutdown_connections 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98bc039a60 0x7f98bc03bf20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/2768719685 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7fc6740 0x556ba7fc6b60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 >> 172.21.15.193:0/2768719685 conn(0x556ba7fbc0f0 msgr2=0x556ba7fbc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 shutdown_connections 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/2768719685 wait complete. 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 msgr2=0x556ba7fb6150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 0x556ba7fb6150 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 msgr2=0x7f98cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 0x7f98cc03bf80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99d80ae000 tx=0x7f99d80a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 msgr2=0x556ba7faefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x556ba7fa88d0 tx=0x7f99dc000f50 comp rx=0 tx=0).stop 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 shutdown_connections 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ba7e2e560 0x556ba7fb6150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f98cc039ac0 0x7f98cc03bf80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 --2- 172.21.15.193:0/1710123294 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ba7e2e180 0x556ba7faefe0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 >> 172.21.15.193:0/1710123294 conn(0x556ba7eb48a0 msgr2=0x556ba7fa2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 shutdown_connections 2024-09-12T17:11:31.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.295+0000 7f99e72869c0 1 -- 172.21.15.193:0/1710123294 wait complete. 2024-09-12T17:11:31.310 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:11:31.273491Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:31.273475Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:31.310 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:11:31.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:11:31.310 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-12T17:11:31.346 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:31.346 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:31.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db657d9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56230d8fd180 0x56230d98bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db657d9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56230d83d9c0 con 0x56230d98c0f0 2024-09-12T17:11:31.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db657d9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56230d88d6d0 con 0x56230d8fd180 2024-09-12T17:11:31.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db4083640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56230d8fd180 0x56230d98bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db3882640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56230d98c0f0 0x56230d98e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36734/0 (socket says 172.21.15.193:36734) 2024-09-12T17:11:31.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db4083640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56230d8fd180 0x56230d98bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52882/0 (socket says 172.21.15.193:52882) 2024-09-12T17:11:31.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db3882640 1 -- 172.21.15.193:0/3466701976 learned_addr learned my addr 172.21.15.193:0/3466701976 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:31.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db4083640 1 -- 172.21.15.193:0/3466701976 >> v1:172.21.15.62:6789/0 conn(0x56230d98c0f0 legacy=0x56230d98e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.343+0000 7f4db4083640 1 -- 172.21.15.193:0/3466701976 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230d831ca0 con 0x56230d8fd180 2024-09-12T17:11:31.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db4083640 1 --2- 172.21.15.193:0/3466701976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d98bbb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4da400a480 tx=0x7f4da401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb0f98678dbccca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db3081640 1 -- 172.21.15.193:0/3466701976 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40af070 con 0x56230d8fd180 2024-09-12T17:11:31.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db3081640 1 -- 172.21.15.193:0/3466701976 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da40aa530 con 0x56230d8fd180 2024-09-12T17:11:31.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db3081640 1 -- 172.21.15.193:0/3466701976 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40aa830 con 0x56230d8fd180 2024-09-12T17:11:31.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3466701976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 msgr2=0x56230d98bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3466701976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d98bbb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4da400a480 tx=0x7f4da401b280 comp rx=0 tx=0).stop 2024-09-12T17:11:31.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3466701976 shutdown_connections 2024-09-12T17:11:31.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3466701976 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d98bbb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3466701976 >> 172.21.15.193:0/3466701976 conn(0x56230d9838a0 msgr2=0x56230d985cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3466701976 shutdown_connections 2024-09-12T17:11:31.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.347+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3466701976 wait complete. 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db657d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db657d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56230d891680 con 0x56230d8fd180 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db4083640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db4083640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52896/0 (socket says 172.21.15.193:52896) 2024-09-12T17:11:31.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db4083640 1 -- 172.21.15.193:0/1089240346 learned_addr learned my addr 172.21.15.193:0/1089240346 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db4083640 1 -- 172.21.15.193:0/1089240346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230d80cda0 con 0x56230d8fd180 2024-09-12T17:11:31.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4db4083640 1 --2- 172.21.15.193:0/1089240346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4da40ad040 tx=0x7f4da4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58089548d6e0e300 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4ca260c640 1 -- 172.21.15.193:0/1089240346 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40af070 con 0x56230d8fd180 2024-09-12T17:11:31.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4ca260c640 1 -- 172.21.15.193:0/1089240346 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da40b0040 con 0x56230d8fd180 2024-09-12T17:11:31.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.363+0000 7f4ca260c640 1 -- 172.21.15.193:0/1089240346 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40aa830 con 0x56230d8fd180 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/1089240346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 msgr2=0x56230d989110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/1089240346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4da40ad040 tx=0x7f4da4003030 comp rx=0 tx=0).stop 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/1089240346 shutdown_connections 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/1089240346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230d989110 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/1089240346 >> 172.21.15.193:0/1089240346 conn(0x56230d9838a0 msgr2=0x56230da70400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/1089240346 shutdown_connections 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/1089240346 wait complete. 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56230d833a50 con 0x56230d8fd180 2024-09-12T17:11:31.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db4083640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db4083640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52902/0 (socket says 172.21.15.193:52902) 2024-09-12T17:11:31.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db4083640 1 -- 172.21.15.193:0/66800165 learned_addr learned my addr 172.21.15.193:0/66800165 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db4083640 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230da7e4e0 con 0x56230d8fd180 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db4083640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4da401bb20 tx=0x7f4da4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4ca0e09640 1 -- 172.21.15.193:0/66800165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40c4020 con 0x56230d8fd180 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56230da7e770 con 0x56230d8fd180 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4ca0e09640 1 -- 172.21.15.193:0/66800165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da40b6690 con 0x56230d8fd180 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4ca0e09640 1 -- 172.21.15.193:0/66800165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da40b6970 con 0x56230d8fd180 2024-09-12T17:11:31.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.367+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56230da7f0d0 con 0x56230d8fd180 2024-09-12T17:11:31.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4ca0e09640 1 -- 172.21.15.193:0/66800165 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da40c7020 con 0x56230d8fd180 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4ca0e09640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 0x7f4c9c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4ca0e09640 1 -- 172.21.15.193:0/66800165 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4da40bb070 con 0x56230d8fd180 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db3882640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 0x7f4c9c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 0x56230da850a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230da855e0 con 0x56230d98c0f0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 0x56230da850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db3882640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 0x7f4c9c03bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001d80 tx=0x7f4da80012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 0x56230da850a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 -- 172.21.15.193:0/66800165 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dac00a4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230da7f4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 -- 172.21.15.193:0/66800165 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dac00a4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230da87340 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 -- 172.21.15.193:0/66800165 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4dac00a4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230da86570 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 -- 172.21.15.193:0/66800165 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dac00a4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230da869c0 con 0x56230d98c0f0 2024-09-12T17:11:31.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db4884640 1 -- 172.21.15.193:0/66800165 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dac00a4d0 con 0x56230d98c0f0 2024-09-12T17:11:31.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db657d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56230d89e450 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52906/0 (socket says 172.21.15.193:52906) 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.371+0000 7f4db3882640 1 -- 172.21.15.193:0/3621292524 learned_addr learned my addr 172.21.15.193:0/3621292524 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 -- 172.21.15.193:0/3621292524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230da960b0 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d660 tx=0x7f4da800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 -- 172.21.15.193:0/3621292524 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da800c6b0 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56230da96910 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56230da96e80 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 -- 172.21.15.193:0/3621292524 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da800c850 con 0x56230da95650 2024-09-12T17:11:31.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 -- 172.21.15.193:0/3621292524 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da800cb30 con 0x56230da95650 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 -- 172.21.15.193:0/3621292524 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da8023020 con 0x56230da95650 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 0x7f4c8c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4c99ffb640 1 -- 172.21.15.193:0/3621292524 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4da8021020 con 0x56230da95650 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db4884640 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 0x7f4c8c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db657d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56230d9898a0 con 0x56230daa2010 2024-09-12T17:11:31.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db4884640 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 0x7f4c8c03bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56230da86090 tx=0x7f4dac005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52916/0 (socket says 172.21.15.193:52916) 2024-09-12T17:11:31.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 -- 172.21.15.193:0/723839022 learned_addr learned my addr 172.21.15.193:0/723839022 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.375+0000 7f4db3882640 1 -- 172.21.15.193:0/723839022 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230daa29c0 con 0x56230daa2010 2024-09-12T17:11:31.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 --2- 172.21.15.193:0/723839022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4da8050f50 tx=0x7f4da8023310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878504d1bdecef9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c937fe640 1 -- 172.21.15.193:0/723839022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8047070 con 0x56230daa2010 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c937fe640 1 -- 172.21.15.193:0/723839022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8024710 con 0x56230daa2010 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c937fe640 1 -- 172.21.15.193:0/723839022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da800ce00 con 0x56230daa2010 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/723839022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 msgr2=0x56230daa23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/723839022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4da8050f50 tx=0x7f4da8023310 comp rx=0 tx=0).stop 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/723839022 shutdown_connections 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/723839022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa23f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/723839022 >> 172.21.15.193:0/723839022 conn(0x56230da9e440 msgr2=0x56230da9c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/723839022 shutdown_connections 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/723839022 wait complete. 2024-09-12T17:11:31.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 Processor -- start 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- start start 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56230daa3020 con 0x56230daa2010 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52932/0 (socket says 172.21.15.193:52932) 2024-09-12T17:11:31.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 learned_addr learned my addr 172.21.15.193:0/3511564942 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230daa9b40 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db3882640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4da804c040 tx=0x7f4da8050eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c91ffb640 1 -- 172.21.15.193:0/3511564942 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da8034030 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56230daa9dd0 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c91ffb640 1 -- 172.21.15.193:0/3511564942 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da80236e0 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56230daa9dd0 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.379+0000 7f4c91ffb640 1 -- 172.21.15.193:0/3511564942 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4da803e060 con 0x56230daa2010 2024-09-12T17:11:31.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4c91ffb640 1 -- 172.21.15.193:0/3511564942 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4da8037030 con 0x56230daa2010 2024-09-12T17:11:31.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4c91ffb640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c84039a70 0x7f4c8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4c91ffb640 1 -- 172.21.15.193:0/3511564942 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f4da8035070 con 0x56230daa2010 2024-09-12T17:11:31.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4884640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c84039a70 0x7f4c8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230dab4650 0x56230dab6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab7260 con 0x56230dab4650 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230dab4650 0x56230dab6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4884640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c84039a70 0x7f4c8403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56230da7f410 tx=0x7f4dac01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230dab4650 0x56230dab6b10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 realm 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab7670 con 0x56230dab4650 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab7f40 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab82e0 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab8b30 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:31.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 20 searching for the correct realm 2024-09-12T17:11:31.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56230daba8a0 0x56230dabcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.383+0000 7f4db3882640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56230daba8a0 0x56230dabcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db3882640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56230daba8a0 0x56230dabcc90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db3882640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4da8015a30 0x7f4da80520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4da8015a30 2024-09-12T17:11:31.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4884640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4da8015a30 0x7f4da80520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4884640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4da8015a30 0x7f4da80520d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4884640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4dac031040 0x7f4dac032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4dac031040 0x7f4dac032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4dac031040 0x7f4dac032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.387+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4da8015a30 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4da8015a30 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.391+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4da8015a30 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230dab4650 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x56230daba8a0 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.395+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd1d0 con 0x7f4dac031040 2024-09-12T17:11:31.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4da40fe040 con 0x7f4da8015a30 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4da40fe040 con 0x56230daba8a0 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4da40fe040 con 0x7f4dac031040 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4da40fe040 con 0x56230dab4650 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f4da40fe040 con 0x7f4da8015a30 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dac01f070 con 0x7f4da8015a30 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:31.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab94b0 con 0x56230dab4650 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab9d50 con 0x56230dab4650 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dab9d50 con 0x56230dab4650 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.399+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 zone default found 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 4 Realm: () 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 zonegroup default 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dabd570 con 0x7f4dac031040 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dabf090 con 0x56230daba8a0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dabf5a0 con 0x56230daba8a0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 started sync module instance, tier type = 2024-09-12T17:11:31.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:31.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dabe400 con 0x7f4da8015a30 2024-09-12T17:11:31.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94708553213936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dabe060 con 0x7f4da8015a30 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.403+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac04d0 con 0x56230dab4650 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94708553213936] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94708553218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac04d0 con 0x56230dab4650 2024-09-12T17:11:31.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac0e90 con 0x56230daba8a0 2024-09-12T17:11:31.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94708553218560] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94708553220128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac0440 con 0x56230daba8a0 2024-09-12T17:11:31.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.407+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac1b90 con 0x7f4da8015a30 2024-09-12T17:11:31.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94708553226224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac2430 con 0x7f4da8015a30 2024-09-12T17:11:31.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac2e30 con 0x56230dab4650 2024-09-12T17:11:31.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94708553226224] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94708553220128] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94708553224752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac1f80 con 0x56230dab4650 2024-09-12T17:11:31.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.411+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac36d0 con 0x7f4dac031040 2024-09-12T17:11:31.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94708553224752] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94708553230656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac1f80 con 0x7f4dac031040 2024-09-12T17:11:31.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac3b60 con 0x7f4dac031040 2024-09-12T17:11:31.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94708553234032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac3fa0 con 0x7f4dac031040 2024-09-12T17:11:31.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94708553230656] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.415+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac30b0 con 0x7f4dac031040 2024-09-12T17:11:31.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94708553237856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac30b0 con 0x7f4dac031040 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=0 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=1 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=2 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=3 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=4 2024-09-12T17:11:31.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=5 2024-09-12T17:11:31.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94708553234032] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=6 2024-09-12T17:11:31.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94708553237856] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 20 add_watcher() i=7 2024-09-12T17:11:31.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:31.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230dac3a90 con 0x56230dab4650 2024-09-12T17:11:31.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.419+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94708553235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dac4ea0 con 0x56230dab4650 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94708553235088] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4c6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 5 note: GC not initialized 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4c697e2640 20 reqs_thread_entry: start 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 Filter name: none 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4bdaffd640 20 reqs_thread_entry: start 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:11:31.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daead20 con 0x7f4dac031040 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daea6b0 con 0x7f4da8015a30 2024-09-12T17:11:31.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.423+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daee5d0 con 0x56230daba8a0 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:31.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:31.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf2820 con 0x7f4da8015a30 2024-09-12T17:11:31.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.427+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 8.c 8:34902515:root::.bucket.meta.testx%3amyfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf6130 con 0x56230dab4650 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [create,call,writefull 0~420,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x7 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:31.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94708553432928 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5b20 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== watch-notify(notify (1) cookie 94708553213936 notify 137438953485 ret 0) ==== 897+0+0 (crc 0 0 0) 0x7f4dac0246a0 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4c92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94708553213936 notifier 4545 bl.length()=855 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(67 notify.0 [notify cookie 94708553432928 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4c92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x7 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4c92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4c92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4c92ffd640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4c78003eb0 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== watch-notify(notify_complete (2) cookie 94708553432928 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4dac032970 con 0x7f4da8015a30 2024-09-12T17:11:31.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 20 handle_bi_update(): bucket=testx:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 20 handle_bi_update(): bucket=testx:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 20 handle_bi_update(): bucket=testx:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 20 handle_bi_update(): bucket=testx:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5c80 con 0x56230dab4650 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.431+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5c80 con 0x56230dab4650 2024-09-12T17:11:31.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94708553439184 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daf6750 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify (1) cookie 94708553224752 notify 137438953492 ret 0) ==== 390+0+0 (crc 0 0 0) 0x56230daf4f70 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4c92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94708553224752 notifier 4545 bl.length()=348 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4c92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4c92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(71 notify.4 [notify cookie 94708553439184 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4c92ffd640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4c78003eb0 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify_complete (2) cookie 94708553439184 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56230daf2650 con 0x56230dab4650 2024-09-12T17:11:31.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5c00 con 0x7f4da8015a30 2024-09-12T17:11:31.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:11:31.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:31.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.435+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94708553439056 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daf2f50 con 0x7f4dac031040 2024-09-12T17:11:31.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== watch-notify(notify (1) cookie 94708553234032 notify 137438953480 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56230daf2650 con 0x7f4dac031040 2024-09-12T17:11:31.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4c92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94708553234032 notifier 4545 bl.length()=149 2024-09-12T17:11:31.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(74 notify.6 [notify cookie 94708553439056 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4c92ffd640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4c78003eb0 con 0x7f4dac031040 2024-09-12T17:11:31.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify_complete (2) cookie 94708553439056 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56230da7f0d0 con 0x7f4dac031040 2024-09-12T17:11:31.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5c00 con 0x56230daba8a0 2024-09-12T17:11:31.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.439+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(76 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db657d9c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 from cache 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db657d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94708553409856 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56230daf5c00 con 0x56230dab4650 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== watch-notify(notify (1) cookie 94708553218560 notify 137438953493 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56230da7f0d0 con 0x56230dab4650 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4c937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94708553218560 notifier 4545 bl.length()=206 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(77 notify.1 [notify cookie 94708553409856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4c937fe640 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4be80032d0 con 0x56230dab4650 2024-09-12T17:11:31.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== watch-notify(notify_complete (2) cookie 94708553409856 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56230da7e770 con 0x56230dab4650 2024-09-12T17:11:31.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4c6a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94708553235088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x56230dab4650 2024-09-12T17:11:31.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94708553235088] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.443+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94708553213936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x7f4da8015a30 2024-09-12T17:11:31.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94708553213936] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db657d9c0 20 remove_watcher() i=0 2024-09-12T17:11:31.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db657d9c0 2 removed watcher, disabling cache 2024-09-12T17:11:31.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94708553218560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x56230dab4650 2024-09-12T17:11:31.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94708553218560] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db657d9c0 20 remove_watcher() i=1 2024-09-12T17:11:31.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.447+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94708553220128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x56230daba8a0 2024-09-12T17:11:31.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db3882640 1 -- 172.21.15.193:0/3511564942 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94708553220128] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da8049070 con 0x56230daba8a0 2024-09-12T17:11:31.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db657d9c0 20 remove_watcher() i=2 2024-09-12T17:11:31.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94708553226224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x7f4da8015a30 2024-09-12T17:11:31.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db4884640 1 -- 172.21.15.193:0/3511564942 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94708553226224] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dac040040 con 0x7f4da8015a30 2024-09-12T17:11:31.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db657d9c0 20 remove_watcher() i=3 2024-09-12T17:11:31.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.451+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94708553224752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x56230dab4650 2024-09-12T17:11:31.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94708553224752] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x56230dab4650 2024-09-12T17:11:31.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db657d9c0 20 remove_watcher() i=4 2024-09-12T17:11:31.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94708553230656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x7f4dac031040 2024-09-12T17:11:31.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94708553230656] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db657d9c0 20 remove_watcher() i=5 2024-09-12T17:11:31.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.455+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94708553234032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x7f4dac031040 2024-09-12T17:11:31.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94708553234032] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 20 remove_watcher() i=6 2024-09-12T17:11:31.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94708553237856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56230dae89c0 con 0x7f4dac031040 2024-09-12T17:11:31.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94708553237856] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4da40a8070 con 0x7f4dac031040 2024-09-12T17:11:31.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 20 remove_watcher() i=7 2024-09-12T17:11:31.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4dac031040 msgr2=0x7f4dac032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4dac031040 0x7f4dac032430 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230dab4650 msgr2=0x56230dab6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230dab4650 0x56230dab6b10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4da8015a30 msgr2=0x7f4da80520d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4da8015a30 0x7f4da80520d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56230daba8a0 msgr2=0x56230dabcc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56230daba8a0 0x56230dabcc90 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c84039a70 msgr2=0x7f4c8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c84039a70 0x7f4c8403bf30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x56230da7f410 tx=0x7f4dac01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.459+0000 7f4db4083640 1 -- 172.21.15.193:0/3511564942 reap_dead start 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 msgr2=0x56230daa95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4da804c040 tx=0x7f4da8050eb0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 shutdown_connections 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3511564942 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230daa2010 0x56230daa95e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 >> 172.21.15.193:0/3511564942 conn(0x56230da9e440 msgr2=0x56230da9c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 shutdown_connections 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3511564942 wait complete. 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 msgr2=0x7f4c8c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 0x7f4c8c03bf30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x56230da86090 tx=0x7f4dac005850 comp rx=0 tx=0).stop 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 msgr2=0x56230da95a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4da800d660 tx=0x7f4da800da60 comp rx=0 tx=0).stop 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 shutdown_connections 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c8c039a70 0x7f4c8c03bf30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/3621292524 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230da95650 0x56230da95a70 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 >> 172.21.15.193:0/3621292524 conn(0x56230da8b000 msgr2=0x56230da8b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 shutdown_connections 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/3621292524 wait complete. 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 msgr2=0x56230da850a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 0x56230da850a0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 msgr2=0x7f4c9c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 0x7f4c9c03bf30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4da8001d80 tx=0x7f4da80012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 msgr2=0x56230da7df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4da401bb20 tx=0x7f4da4018020 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 shutdown_connections 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56230d98c0f0 0x56230da850a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4c9c039a70 0x7f4c9c03bf30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 --2- 172.21.15.193:0/66800165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56230d8fd180 0x56230da7df80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 >> 172.21.15.193:0/66800165 conn(0x56230d9838a0 msgr2=0x56230d987d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 shutdown_connections 2024-09-12T17:11:31.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.463+0000 7f4db657d9c0 1 -- 172.21.15.193:0/66800165 wait complete. 2024-09-12T17:11:31.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T17:11:31.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-12T17:11:31.478 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-12T17:11:31.553 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:31.553 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:31.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5b9879c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578bcaa3200 0x5578bcb31c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5b9879c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578bc9e39c0 con 0x5578bcb32170 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5b9879c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5578bca336d0 con 0x5578bcaa3200 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5948d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578bcaa3200 0x5578bcb31c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5948d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5578bcaa3200 0x5578bcb31c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52934/0 (socket says 172.21.15.193:52934) 2024-09-12T17:11:31.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5948d640 1 -- 172.21.15.193:0/3465708245 learned_addr learned my addr 172.21.15.193:0/3465708245 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5948d640 1 -- 172.21.15.193:0/3465708245 >> v1:172.21.15.62:6789/0 conn(0x5578bcb32170 legacy=0x5578bcb34560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.551+0000 7fac5948d640 1 -- 172.21.15.193:0/3465708245 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bc9d7ca0 con 0x5578bcaa3200 2024-09-12T17:11:31.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5948d640 1 --2- 172.21.15.193:0/3465708245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcb31c30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00a4e0 tx=0x7fac4c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136ce2f8559f1ae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac4bfff640 1 -- 172.21.15.193:0/3465708245 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0aa540 con 0x5578bcaa3200 2024-09-12T17:11:31.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac4bfff640 1 -- 172.21.15.193:0/3465708245 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c0aa6e0 con 0x5578bcaa3200 2024-09-12T17:11:31.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac4bfff640 1 -- 172.21.15.193:0/3465708245 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0aaa40 con 0x5578bcaa3200 2024-09-12T17:11:31.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 -- 172.21.15.193:0/3465708245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 msgr2=0x5578bcb31c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/3465708245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcb31c30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fac4c00a4e0 tx=0x7fac4c01b090 comp rx=0 tx=0).stop 2024-09-12T17:11:31.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 -- 172.21.15.193:0/3465708245 shutdown_connections 2024-09-12T17:11:31.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/3465708245 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcb31c30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 -- 172.21.15.193:0/3465708245 >> 172.21.15.193:0/3465708245 conn(0x5578bcb29920 msgr2=0x5578bcb2bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 -- 172.21.15.193:0/3465708245 shutdown_connections 2024-09-12T17:11:31.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.555+0000 7fac5b9879c0 1 -- 172.21.15.193:0/3465708245 wait complete. 2024-09-12T17:11:31.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5b9879c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5b9879c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578bca37680 con 0x5578bcaa3200 2024-09-12T17:11:31.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5948d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5948d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52938/0 (socket says 172.21.15.193:52938) 2024-09-12T17:11:31.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5948d640 1 -- 172.21.15.193:0/16155526 learned_addr learned my addr 172.21.15.193:0/16155526 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5948d640 1 -- 172.21.15.193:0/16155526 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bc9b2da0 con 0x5578bcaa3200 2024-09-12T17:11:31.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fac5948d640 1 --2- 172.21.15.193:0/16155526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fac4c019740 tx=0x7fac4c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787038793d584368 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fab47606640 1 -- 172.21.15.193:0/16155526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0b9070 con 0x5578bcaa3200 2024-09-12T17:11:31.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fab47606640 1 -- 172.21.15.193:0/16155526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c0aaa90 con 0x5578bcaa3200 2024-09-12T17:11:31.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.571+0000 7fab47606640 1 -- 172.21.15.193:0/16155526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0aad70 con 0x5578bcaa3200 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/16155526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 msgr2=0x5578bcc18600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/16155526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fac4c019740 tx=0x7fac4c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/16155526 shutdown_connections 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/16155526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc18600 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/16155526 >> 172.21.15.193:0/16155526 conn(0x5578bcb29920 msgr2=0x5578bcc14240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/16155526 shutdown_connections 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/16155526 wait complete. 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578bc9d9a50 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5948d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5948d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52946/0 (socket says 172.21.15.193:52946) 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5948d640 1 -- 172.21.15.193:0/1349238420 learned_addr learned my addr 172.21.15.193:0/1349238420 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5948d640 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bcc20080 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5948d640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fac4c018cc0 tx=0x7fac4c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fab45e03640 1 -- 172.21.15.193:0/1349238420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0b9070 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bcc20310 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fab45e03640 1 -- 172.21.15.193:0/1349238420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac4c0b5b10 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fab45e03640 1 -- 172.21.15.193:0/1349238420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac4c0b5df0 con 0x5578bcaa3200 2024-09-12T17:11:31.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bcc20cc0 con 0x5578bcaa3200 2024-09-12T17:11:31.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fab45e03640 1 -- 172.21.15.193:0/1349238420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fac4c0b3040 con 0x5578bcaa3200 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.575+0000 7fab45e03640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 0x7fab4003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fab45e03640 1 -- 172.21.15.193:0/1349238420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fac4c0c4070 con 0x5578bcaa3200 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac58c8c640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 0x7fab4003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 0x5578bcc26c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc271d0 con 0x5578bcb32170 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 0x5578bcc26c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac58c8c640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 0x7fab4003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac50001e60 tx=0x7fac500013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 0x5578bcc26c90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 -- 172.21.15.193:0/1349238420 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac540083f0 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc21020 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 -- 172.21.15.193:0/1349238420 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac540083f0 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc28f60 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 -- 172.21.15.193:0/1349238420 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fac540083f0 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc281c0 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 -- 172.21.15.193:0/1349238420 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac540083f0 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc28610 con 0x5578bcb32170 2024-09-12T17:11:31.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac59c8e640 1 -- 172.21.15.193:0/1349238420 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fac540083f0 con 0x5578bcb32170 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac5b9879c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578bca44450 con 0x5578bcc37210 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52962/0 (socket says 172.21.15.193:52962) 2024-09-12T17:11:31.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.579+0000 7fac58c8c640 1 -- 172.21.15.193:0/76146292 learned_addr learned my addr 172.21.15.193:0/76146292 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac58c8c640 1 -- 172.21.15.193:0/76146292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bcc37c70 con 0x5578bcc37210 2024-09-12T17:11:31.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac58c8c640 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac50010f90 tx=0x7fac5000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 -- 172.21.15.193:0/76146292 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5000a040 con 0x5578bcc37210 2024-09-12T17:11:31.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bcc384d0 con 0x5578bcc37210 2024-09-12T17:11:31.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 -- 172.21.15.193:0/76146292 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac50017050 con 0x5578bcc37210 2024-09-12T17:11:31.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bcc38a40 con 0x5578bcc37210 2024-09-12T17:11:31.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 -- 172.21.15.193:0/76146292 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5000e7e0 con 0x5578bcc37210 2024-09-12T17:11:31.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 -- 172.21.15.193:0/76146292 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fac5000e980 con 0x5578bcc37210 2024-09-12T17:11:31.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 0x7fab3003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fab3effd640 1 -- 172.21.15.193:0/76146292 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fac500521f0 con 0x5578bcc37210 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac59c8e640 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 0x7fab3003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac59c8e640 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 0x7fab3003bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5578bcc27ce0 tx=0x7fac54003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac5b9879c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578bcc18d90 con 0x5578bcc44c00 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52968/0 (socket says 172.21.15.193:52968) 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.583+0000 7fac58c8c640 1 -- 172.21.15.193:0/2028435451 learned_addr learned my addr 172.21.15.193:0/2028435451 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 -- 172.21.15.193:0/2028435451 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bcc455d0 con 0x5578bcc44c00 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 --2- 172.21.15.193:0/2028435451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac50050540 tx=0x7fac50049f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b57d3137866ade5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab3cff9640 1 -- 172.21.15.193:0/2028435451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac50025e20 con 0x5578bcc44c00 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab3cff9640 1 -- 172.21.15.193:0/2028435451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac50024c70 con 0x5578bcc44c00 2024-09-12T17:11:31.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab3cff9640 1 -- 172.21.15.193:0/2028435451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac50023de0 con 0x5578bcc44c00 2024-09-12T17:11:31.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/2028435451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 msgr2=0x5578bcc44fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/2028435451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fac50050540 tx=0x7fac50049f40 comp rx=0 tx=0).stop 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/2028435451 shutdown_connections 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/2028435451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc44fe0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/2028435451 >> 172.21.15.193:0/2028435451 conn(0x5578bcc3ffc0 msgr2=0x5578bcc3e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/2028435451 shutdown_connections 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/2028435451 wait complete. 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 Processor -- start 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- start start 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578bcc43af0 con 0x5578bcc44c00 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52980/0 (socket says 172.21.15.193:52980) 2024-09-12T17:11:31.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 learned_addr learned my addr 172.21.15.193:0/4184649593 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578bcc4b640 con 0x5578bcc44c00 2024-09-12T17:11:31.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac58c8c640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fac5001a990 tx=0x7fac500504d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab2effd640 1 -- 172.21.15.193:0/4184649593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5001abe0 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578bcc4b8d0 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab2effd640 1 -- 172.21.15.193:0/4184649593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac50046040 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578bcc4c280 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.587+0000 7fab2effd640 1 -- 172.21.15.193:0/4184649593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fac5001ccc0 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fab2effd640 1 -- 172.21.15.193:0/4184649593 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fac50035030 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fab2effd640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab24039a70 0x7fab2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fab2effd640 1 -- 172.21.15.193:0/4184649593 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fac50033020 con 0x5578bcc44c00 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac59c8e640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab24039a70 0x7fab2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcc56470 0x5578bcc58900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc59050 con 0x5578bcc56470 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcc56470 0x5578bcc58900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac59c8e640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab24039a70 0x7fab2403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac5400f010 tx=0x7fac5401c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcc56470 0x5578bcc58900 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 realm 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc59460 con 0x5578bcc56470 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc59d30 con 0x5578bcc56470 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5a0d0 con 0x5578bcc56470 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5a920 con 0x5578bcc56470 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 20 searching for the correct realm 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578bcc5c690 0x5578bcc5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc5c690 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac58c8c640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578bcc5c690 0x5578bcc5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.591+0000 7fac58c8c640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578bcc5c690 0x5578bcc5ea80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac58c8c640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fac5001c030 0x7fac50026a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5001c030 2024-09-12T17:11:31.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac59c8e640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fac5001c030 0x7fac50026a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac59c8e640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fac5001c030 0x7fac50026a00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac59c8e640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fac5401a940 0x7fac54011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5401a940 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fac5401a940 0x7fac54011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fac5401a940 0x7fac54011430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc56470 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc56470 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5401a940 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.595+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5401a940 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5001c030 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc5c690 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc56470 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5401a940 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc56470 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x7fac5001c030 2024-09-12T17:11:31.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc5c690 2024-09-12T17:11:31.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5efc0 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5401a940 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.599+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc56470 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc56470 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5401a940 2024-09-12T17:11:31.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc5c690 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5001c030 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc56470 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5401a940 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc5c690 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5401a940 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.603+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5001c030 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x5578bcc5c690 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac50060040 con 0x7fac5401a940 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac4c0f4040 con 0x5578bcc56470 2024-09-12T17:11:31.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fac4c0f4040 con 0x7fac5001c030 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5b200 con 0x5578bcc56470 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5ae40 con 0x5578bcc56470 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5bb20 con 0x5578bcc56470 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 zone default found 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 4 Realm: () 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:31.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 zonegroup default 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc5bb20 con 0x7fac5401a940 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc60de0 con 0x5578bcc5c690 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.607+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc61180 con 0x5578bcc5c690 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 20 started sync module instance, tier type = 2024-09-12T17:11:31.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:31.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc60280 con 0x7fac5001c030 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93977051530784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc60a40 con 0x7fac5001c030 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc61ec0 con 0x5578bcc56470 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93977051530784] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93977051534624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc61df0 con 0x5578bcc56470 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.611+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc628d0 con 0x5578bcc5c690 2024-09-12T17:11:31.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93977051538464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc63170 con 0x5578bcc5c690 2024-09-12T17:11:31.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc63b30 con 0x7fac5001c030 2024-09-12T17:11:31.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93977051534624] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93977051543168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc63aa0 con 0x7fac5001c030 2024-09-12T17:11:31.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc648e0 con 0x5578bcc56470 2024-09-12T17:11:31.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.615+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93977051538464] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93977051543168] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93977051540672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc648a0 con 0x5578bcc56470 2024-09-12T17:11:31.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc64d10 con 0x7fac5401a940 2024-09-12T17:11:31.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93977051540672] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93977051548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc643d0 con 0x7fac5401a940 2024-09-12T17:11:31.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.619+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc65720 con 0x7fac5401a940 2024-09-12T17:11:31.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93977051550320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc65b40 con 0x7fac5401a940 2024-09-12T17:11:31.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc66540 con 0x7fac5401a940 2024-09-12T17:11:31.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93977051548768] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93977051550320] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93977051545376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc65690 con 0x7fac5401a940 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=0 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=1 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=2 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=3 2024-09-12T17:11:31.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=4 2024-09-12T17:11:31.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=5 2024-09-12T17:11:31.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.623+0000 7fac5b9879c0 20 add_watcher() i=6 2024-09-12T17:11:31.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93977051545376] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 add_watcher() i=7 2024-09-12T17:11:31.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:31.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc69640 con 0x5578bcc56470 2024-09-12T17:11:31.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93977051553872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc66ac0 con 0x5578bcc56470 2024-09-12T17:11:31.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93977051553872] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fab0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:31.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:31.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 5 note: GC not initialized 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fab0efe5640 20 reqs_thread_entry: start 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 Filter name: none 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fab0cfe1640 20 reqs_thread_entry: start 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.627+0000 7fac5b9879c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8c180 con 0x5578bcc56470 2024-09-12T17:11:31.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5b9879c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:11:31.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fab0ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93977051553872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x5578bcc56470 2024-09-12T17:11:31.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93977051553872] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.631+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93977051530784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x7fac5001c030 2024-09-12T17:11:31.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93977051530784] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 20 remove_watcher() i=0 2024-09-12T17:11:31.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 2 removed watcher, disabling cache 2024-09-12T17:11:31.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93977051534624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x5578bcc56470 2024-09-12T17:11:31.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93977051534624] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 20 remove_watcher() i=1 2024-09-12T17:11:31.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93977051538464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x5578bcc5c690 2024-09-12T17:11:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac58c8c640 1 -- 172.21.15.193:0/4184649593 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93977051538464] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac5000d040 con 0x5578bcc5c690 2024-09-12T17:11:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 20 remove_watcher() i=2 2024-09-12T17:11:31.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.635+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93977051543168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x7fac5001c030 2024-09-12T17:11:31.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac59c8e640 1 -- 172.21.15.193:0/4184649593 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93977051543168] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac54030040 con 0x7fac5001c030 2024-09-12T17:11:31.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac5b9879c0 20 remove_watcher() i=3 2024-09-12T17:11:31.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93977051540672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x5578bcc56470 2024-09-12T17:11:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93977051540672] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x5578bcc56470 2024-09-12T17:11:31.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac5b9879c0 20 remove_watcher() i=4 2024-09-12T17:11:31.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.639+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93977051548768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x7fac5401a940 2024-09-12T17:11:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93977051548768] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5b9879c0 20 remove_watcher() i=5 2024-09-12T17:11:31.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93977051550320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x7fac5401a940 2024-09-12T17:11:31.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93977051550320] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5b9879c0 20 remove_watcher() i=6 2024-09-12T17:11:31.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.643+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93977051545376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5578bcc8a060 con 0x7fac5401a940 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93977051545376] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fac4c0c6d80 con 0x7fac5401a940 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 20 remove_watcher() i=7 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fac5401a940 msgr2=0x7fac54011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fac5401a940 0x7fac54011430 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcc56470 msgr2=0x5578bcc58900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcc56470 0x5578bcc58900 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fac5001c030 msgr2=0x7fac50026a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fac5001c030 0x7fac50026a00 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578bcc5c690 msgr2=0x5578bcc5ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5578bcc5c690 0x5578bcc5ea80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab24039a70 msgr2=0x7fab2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab24039a70 0x7fab2403bf30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac5400f010 tx=0x7fac5401c070 comp rx=0 tx=0).stop 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 msgr2=0x5578bcc4b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5948d640 1 -- 172.21.15.193:0/4184649593 reap_dead start 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fac5001a990 tx=0x7fac500504d0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 shutdown_connections 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/4184649593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc44c00 0x5578bcc4b0e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 >> 172.21.15.193:0/4184649593 conn(0x5578bcc3ffc0 msgr2=0x5578bcc3e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 shutdown_connections 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/4184649593 wait complete. 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 msgr2=0x7fab3003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 0x7fab3003bf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x5578bcc27ce0 tx=0x7fac54003070 comp rx=0 tx=0).stop 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 msgr2=0x5578bcc37630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fac50010f90 tx=0x7fac5000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 shutdown_connections 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab30039a70 0x7fab3003bf30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/76146292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcc37210 0x5578bcc37630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 >> 172.21.15.193:0/76146292 conn(0x5578bcc2cbc0 msgr2=0x5578bcc2cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 shutdown_connections 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/76146292 wait complete. 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 msgr2=0x5578bcc26c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 0x5578bcc26c90 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 msgr2=0x7fab4003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 0x7fab4003bf30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac50001e60 tx=0x7fac500013e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 msgr2=0x5578bcc1fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fac4c018cc0 tx=0x7fac4c017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 shutdown_connections 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5578bcb32170 0x5578bcc26c90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fab40039a70 0x7fab4003bf30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 --2- 172.21.15.193:0/1349238420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5578bcaa3200 0x5578bcc1fb20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 >> 172.21.15.193:0/1349238420 conn(0x5578bcb29920 msgr2=0x5578bcc12cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 shutdown_connections 2024-09-12T17:11:31.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.647+0000 7fac5b9879c0 1 -- 172.21.15.193:0/1349238420 wait complete. 2024-09-12T17:11:31.664 INFO:teuthology.orchestra.run.smithi193.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"lnFgekaUDn0oGaAdW9kKawSi","ver":2},"mtime":"2024-09-12T17:11:31.437911Z","data":{"bucket":{"name":"myfoo","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","bucket_id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-12T17:11:27.903968Z","linked":true,"has_bucket_info":false}} 2024-09-12T17:11:31.664 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'lnFgekaUDn0oGaAdW9kKawSi', 'ver': 2}, 'mtime': '2024-09-12T17:11:31.437911Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'bucket_id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-12T17:11:27.903968Z', 'linked': True, 'has_bucket_info': False}} 2024-09-12T17:11:31.664 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T17:11:31.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-12T17:11:31.665 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-12T17:11:31.742 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:31.742 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:31.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9e222b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5615affb5f70 0x5615affb6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9e222b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615afe6a9c0 con 0x5615affb90b0 2024-09-12T17:11:31.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9e222b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5615afeba6d0 con 0x5615affb5f70 2024-09-12T17:11:31.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9dfd31640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5615affb5f70 0x5615affb6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9dfd31640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5615affb5f70 0x5615affb6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52990/0 (socket says 172.21.15.193:52990) 2024-09-12T17:11:31.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3921547792 learned_addr learned my addr 172.21.15.193:0/3921547792 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3921547792 >> v1:172.21.15.62:6789/0 conn(0x5615affb90b0 legacy=0x5615affbb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.739+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3921547792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615afe5eca0 con 0x5615affb5f70 2024-09-12T17:11:31.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3921547792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615affb6350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a5c0 tx=0x7fb9c801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1025e4180eb061f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9ded2f640 1 -- 172.21.15.193:0/3921547792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80a6070 con 0x5615affb5f70 2024-09-12T17:11:31.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9ded2f640 1 -- 172.21.15.193:0/3921547792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c80af070 con 0x5615affb5f70 2024-09-12T17:11:31.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9ded2f640 1 -- 172.21.15.193:0/3921547792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80aa5c0 con 0x5615affb5f70 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3921547792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 msgr2=0x5615affb6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3921547792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615affb6350 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800a5c0 tx=0x7fb9c801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3921547792 shutdown_connections 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3921547792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615affb6350 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3921547792 >> 172.21.15.193:0/3921547792 conn(0x5615affb1a90 msgr2=0x5615affb3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3921547792 shutdown_connections 2024-09-12T17:11:31.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.743+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3921547792 wait complete. 2024-09-12T17:11:31.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9e222b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9e222b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5615afebe680 con 0x5615affb5f70 2024-09-12T17:11:31.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9dfd31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9dfd31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:52994/0 (socket says 172.21.15.193:52994) 2024-09-12T17:11:31.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9dfd31640 1 -- 172.21.15.193:0/2990506391 learned_addr learned my addr 172.21.15.193:0/2990506391 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9dfd31640 1 -- 172.21.15.193:0/2990506391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615afe39da0 con 0x5615affb5f70 2024-09-12T17:11:31.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/2990506391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8018f70 tx=0x7fb9c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be26a02abb2ee98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb8cde0b640 1 -- 172.21.15.193:0/2990506391 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80aa8b0 con 0x5615affb5f70 2024-09-12T17:11:31.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb8cde0b640 1 -- 172.21.15.193:0/2990506391 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c80aaa50 con 0x5615affb5f70 2024-09-12T17:11:31.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.759+0000 7fb8cde0b640 1 -- 172.21.15.193:0/2990506391 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80aad30 con 0x5615affb5f70 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/2990506391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 msgr2=0x5615aff2c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/2990506391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8018f70 tx=0x7fb9c8003030 comp rx=0 tx=0).stop 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/2990506391 shutdown_connections 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/2990506391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615aff2c280 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/2990506391 >> 172.21.15.193:0/2990506391 conn(0x5615affb1a90 msgr2=0x5615b009d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/2990506391 shutdown_connections 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/2990506391 wait complete. 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5615afe60a50 con 0x5615affb5f70 2024-09-12T17:11:31.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9dfd31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9dfd31640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53004/0 (socket says 172.21.15.193:53004) 2024-09-12T17:11:31.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3835840599 learned_addr learned my addr 172.21.15.193:0/3835840599 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b00ab390 con 0x5615affb5f70 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8018f70 tx=0x7fb9c80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb8c7fff640 1 -- 172.21.15.193:0/3835840599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80c6690 con 0x5615affb5f70 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b00ab620 con 0x5615affb5f70 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb8c7fff640 1 -- 172.21.15.193:0/3835840599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c80c6830 con 0x5615affb5f70 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb8c7fff640 1 -- 172.21.15.193:0/3835840599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9c80c6b30 con 0x5615affb5f70 2024-09-12T17:11:31.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.763+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b00abfd0 con 0x5615affb5f70 2024-09-12T17:11:31.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb8c7fff640 1 -- 172.21.15.193:0/3835840599 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9c80ce030 con 0x5615affb5f70 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb8c7fff640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 0x7fb8c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb8c7fff640 1 -- 172.21.15.193:0/3835840599 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb9c80cc020 con 0x5615affb5f70 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9df530640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 0x7fb8c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 0x5615b00b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00b24e0 con 0x5615affb90b0 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 0x5615b00b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9df530640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 0x7fb8c803bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001e60 tx=0x7fb9d00013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 0x5615b00b1fa0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 -- 172.21.15.193:0/3835840599 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9d800a4d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ac330 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 -- 172.21.15.193:0/3835840599 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9d800a4d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00b4270 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 -- 172.21.15.193:0/3835840599 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9d800a4d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00b34d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 -- 172.21.15.193:0/3835840599 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9d800a4d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00b3920 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e0532640 1 -- 172.21.15.193:0/3835840599 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9d800a4d0 con 0x5615affb90b0 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.767+0000 7fb9e222b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5615afecb450 con 0x5615b00c2520 2024-09-12T17:11:31.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53018/0 (socket says 172.21.15.193:53018) 2024-09-12T17:11:31.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9df530640 1 -- 172.21.15.193:0/3594378590 learned_addr learned my addr 172.21.15.193:0/3594378590 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9df530640 1 -- 172.21.15.193:0/3594378590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b00c2f80 con 0x5615b00c2520 2024-09-12T17:11:31.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9df530640 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0010f90 tx=0x7fb9d000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 -- 172.21.15.193:0/3594378590 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d000a040 con 0x5615b00c2520 2024-09-12T17:11:31.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 -- 172.21.15.193:0/3594378590 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0017050 con 0x5615b00c2520 2024-09-12T17:11:31.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b00c37e0 con 0x5615b00c2520 2024-09-12T17:11:31.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 -- 172.21.15.193:0/3594378590 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d000e7e0 con 0x5615b00c2520 2024-09-12T17:11:31.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b00c3d50 con 0x5615b00c2520 2024-09-12T17:11:31.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 -- 172.21.15.193:0/3594378590 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9d000e9d0 con 0x5615b00c2520 2024-09-12T17:11:31.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 0x7fb8b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb8c57fa640 1 -- 172.21.15.193:0/3594378590 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb9d0052100 con 0x5615b00c2520 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 0x7fb8b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 0x7fb8b803bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5615b00b2ff0 tx=0x7fb9d8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.771+0000 7fb9e222b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5615aff2ca10 con 0x5615b00ceea0 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53024/0 (socket says 172.21.15.193:53024) 2024-09-12T17:11:31.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 -- 172.21.15.193:0/1214311709 learned_addr learned my addr 172.21.15.193:0/1214311709 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 -- 172.21.15.193:0/1214311709 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b00cf850 con 0x5615b00ceea0 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- 172.21.15.193:0/1214311709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0050510 tx=0x7fb9d001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd3d1bd9990f546 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb8beffd640 1 -- 172.21.15.193:0/1214311709 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d0024360 con 0x5615b00ceea0 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb8beffd640 1 -- 172.21.15.193:0/1214311709 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d000ecc0 con 0x5615b00ceea0 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb8beffd640 1 -- 172.21.15.193:0/1214311709 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d001a310 con 0x5615b00ceea0 2024-09-12T17:11:31.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/1214311709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 msgr2=0x5615b00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/1214311709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0050510 tx=0x7fb9d001aa60 comp rx=0 tx=0).stop 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/1214311709 shutdown_connections 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/1214311709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00cf280 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/1214311709 >> 172.21.15.193:0/1214311709 conn(0x5615b00cb2d0 msgr2=0x5615b00c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/1214311709 shutdown_connections 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/1214311709 wait complete. 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 Processor -- start 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- start start 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9e222b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5615b00cfeb0 con 0x5615b00ceea0 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53026/0 (socket says 172.21.15.193:53026) 2024-09-12T17:11:31.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 learned_addr learned my addr 172.21.15.193:0/3319305185 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615b00d69a0 con 0x5615b00ceea0 2024-09-12T17:11:31.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb9df530640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000fcf0 tx=0x7fb9d00504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.775+0000 7fb8bd7fa640 1 -- 172.21.15.193:0/3319305185 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d0034070 con 0x5615b00ceea0 2024-09-12T17:11:31.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb8bd7fa640 1 -- 172.21.15.193:0/3319305185 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d0024360 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615b00d6c30 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb8bd7fa640 1 -- 172.21.15.193:0/3319305185 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9d001a310 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615b00d75e0 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb8bd7fa640 1 -- 172.21.15.193:0/3319305185 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb9d0037070 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb8bd7fa640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8a8039a70 0x7fb8a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb8bd7fa640 1 -- 172.21.15.193:0/3319305185 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fb9d0048040 con 0x5615b00ceea0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8a8039a70 0x7fb8a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615b00e1700 0x5615b00e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e4310 con 0x5615b00e1700 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615b00e1700 0x5615b00e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8a8039a70 0x7fb8a803bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5615b00ac280 tx=0x7fb9d801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615b00e1700 0x5615b00e3bc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 realm 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e4720 con 0x5615b00e1700 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e4ff0 con 0x5615b00e1700 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e5390 con 0x5615b00e1700 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e5be0 con 0x5615b00e1700 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.779+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e222b9c0 20 searching for the correct realm 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5615b00e7950 0x5615b00e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e7950 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9df530640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5615b00e7950 0x5615b00e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9df530640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5615b00e7950 0x5615b00e9d40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9df530640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb9d0039060 0x7fb9d0050870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d0039060 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb9d0039060 0x7fb9d0050870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb9d0039060 0x7fb9d0050870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e0532640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb9d8031040 0x7fb9d8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d8031040 2024-09-12T17:11:31.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb9d8031040 0x7fb9d8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb9d8031040 0x7fb9d8032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e1700 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e1700 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.783+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d8031040 2024-09-12T17:11:31.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d8031040 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d0039060 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e7950 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e1700 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d8031040 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e1700 2024-09-12T17:11:31.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x7fb9d0039060 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e7950 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea280 con 0x5615b00e7950 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.787+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d8031040 2024-09-12T17:11:31.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e1700 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e1700 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d8031040 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d0039060 2024-09-12T17:11:31.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e1700 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.791+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d8031040 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e7950 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d8031040 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d0039060 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e7950 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d8031040 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x5615b00e1700 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9d0060040 con 0x7fb9d0039060 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9d801f070 con 0x7fb9d0039060 2024-09-12T17:11:31.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e6560 con 0x5615b00e1700 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00e6e00 con 0x5615b00e1700 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.795+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea620 con 0x5615b00e1700 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 zone default found 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 4 Realm: () 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 zonegroup default 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ea6b0 con 0x7fb9d8031040 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ec4e0 con 0x5615b00e7950 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ec920 con 0x5615b00e7950 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 started sync module instance, tier type = 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00eb980 con 0x7fb9d0039060 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94651148058016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00eb5e0 con 0x7fb9d0039060 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.799+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ed850 con 0x5615b00e1700 2024-09-12T17:11:31.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94651148058016] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94651148062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ed850 con 0x5615b00e1700 2024-09-12T17:11:31.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ee260 con 0x5615b00e7950 2024-09-12T17:11:31.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94651148062080] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94651148063648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ed7c0 con 0x5615b00e7950 2024-09-12T17:11:31.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.803+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00eefb0 con 0x7fb9d0039060 2024-09-12T17:11:31.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94651148069936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ef850 con 0x7fb9d0039060 2024-09-12T17:11:31.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f0270 con 0x5615b00e1700 2024-09-12T17:11:31.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94651148063648] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94651148069936] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94651148074336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ef3a0 con 0x5615b00e1700 2024-09-12T17:11:31.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.807+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f0b10 con 0x7fb9d8031040 2024-09-12T17:11:31.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.811+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94651148074336] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.811+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.811+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94651148068432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ef3a0 con 0x7fb9d8031040 2024-09-12T17:11:31.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.811+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f0f70 con 0x7fb9d8031040 2024-09-12T17:11:31.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94651148068432] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94651148076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f0f70 con 0x7fb9d8031040 2024-09-12T17:11:31.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f1970 con 0x7fb9d8031040 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94651148076064] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94651148080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f1b50 con 0x7fb9d8031040 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=0 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=1 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=2 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=3 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=4 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=5 2024-09-12T17:11:31.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.815+0000 7fb9e222b9c0 20 add_watcher() i=6 2024-09-12T17:11:31.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94651148080256] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 20 add_watcher() i=7 2024-09-12T17:11:31.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:31.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f4f20 con 0x5615b00e1700 2024-09-12T17:11:31.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94651148081728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f2310 con 0x5615b00e1700 2024-09-12T17:11:31.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94651148081728] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb8967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:31.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:31.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb9e222b9c0 5 note: GC not initialized 2024-09-12T17:11:31.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.819+0000 7fb8957e2640 20 reqs_thread_entry: start 2024-09-12T17:11:31.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 Filter name: none 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb88e7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b0117fd0 con 0x5615b00e1700 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-12T17:11:31.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b011a0c0 con 0x5615b00e1700 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 8.c 8:34902515:root::.bucket.meta.testx%3amyfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b980 con 0x5615b00e1700 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 20 rados_obj.operate() r=0 bl.length=420 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b0120020 con 0x5615b00e1700 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.823+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b0123930 con 0x5615b00e7950 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [create,call,writefull 0~387,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x7 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94651148276832 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b0122f20 con 0x5615b00e1700 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify (1) cookie 94651148062080 notify 137438953494 ret 0) ==== 778+0+0 (crc 0 0 0) 0x5615b011bd70 con 0x5615b00e1700 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94651148062080 notifier 4559 bl.length()=736 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x7 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:31.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(67 notify.1 [notify cookie 94651148276832 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb8beffd640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8a4003eb0 con 0x5615b00e1700 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== watch-notify(notify_complete (2) cookie 94651148276832 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5615b011aea0 con 0x5615b00e1700 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:31.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.827+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b01230c0 con 0x7fb9d0039060 2024-09-12T17:11:31.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b01230c0 con 0x7fb9d0039060 2024-09-12T17:11:31.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e222b9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:31.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e222b9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:31.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e222b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:31.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94651148282896 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b0123030 con 0x7fb9d8031040 2024-09-12T17:11:31.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== watch-notify(notify (1) cookie 94651148076064 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5615b00abfd0 con 0x7fb9d8031040 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb8be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94651148076064 notifier 4559 bl.length()=314 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(71 notify.6 [notify cookie 94651148282896 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb8be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb8be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.831+0000 7fb8be7fc640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb808003410 con 0x7fb9d8031040 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify_complete (2) cookie 94651148282896 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5615b00ab620 con 0x7fb9d8031040 2024-09-12T17:11:31.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b01230c0 con 0x5615b00e1700 2024-09-12T17:11:31.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-12T17:11:31.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-12T17:11:31.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94651148282896 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b0123030 con 0x5615b00e1700 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== watch-notify(notify (1) cookie 94651148074336 notify 137438953495 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5615b00ab620 con 0x5615b00e1700 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb8be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94651148074336 notifier 4559 bl.length()=155 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb8be7fc640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb808003410 con 0x5615b00e1700 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(74 notify.4 [notify cookie 94651148282896 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== watch-notify(notify_complete (2) cookie 94651148282896 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5615b00ab390 con 0x5615b00e1700 2024-09-12T17:11:31.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 8.c 8:34902515:root::.bucket.meta.testx%3amyfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b01230c0 con 0x5615b00e1700 2024-09-12T17:11:31.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 from cache 2024-09-12T17:11:31.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.835+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94651148255264 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5615b01230c0 con 0x7fb9d0039060 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== watch-notify(notify (1) cookie 94651148058016 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x5615b0123460 con 0x7fb9d0039060 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94651148058016 notifier 4559 bl.length()=212 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(77 notify.0 [notify cookie 94651148255264 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb8beffd640 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8a4003eb0 con 0x7fb9d0039060 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== watch-notify(notify_complete (2) cookie 94651148255264 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5615b0122420 con 0x7fb9d0039060 2024-09-12T17:11:31.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb8967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:31.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94651148081728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b300 con 0x5615b00e1700 2024-09-12T17:11:31.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94651148081728] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.839+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94651148058016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x7fb9d0039060 2024-09-12T17:11:31.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94651148058016] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e222b9c0 20 remove_watcher() i=0 2024-09-12T17:11:31.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e222b9c0 2 removed watcher, disabling cache 2024-09-12T17:11:31.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94651148062080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x5615b00e1700 2024-09-12T17:11:31.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94651148062080] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e222b9c0 20 remove_watcher() i=1 2024-09-12T17:11:31.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.843+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94651148063648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x5615b00e7950 2024-09-12T17:11:31.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9df530640 1 -- 172.21.15.193:0/3319305185 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94651148063648] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d0036030 con 0x5615b00e7950 2024-09-12T17:11:31.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 20 remove_watcher() i=2 2024-09-12T17:11:31.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94651148069936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x7fb9d0039060 2024-09-12T17:11:31.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e0532640 1 -- 172.21.15.193:0/3319305185 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94651148069936] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9d8040040 con 0x7fb9d0039060 2024-09-12T17:11:31.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 20 remove_watcher() i=3 2024-09-12T17:11:31.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94651148074336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x5615b00e1700 2024-09-12T17:11:31.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94651148074336] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x5615b00e1700 2024-09-12T17:11:31.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 20 remove_watcher() i=4 2024-09-12T17:11:31.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.847+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94651148068432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b011b2d0 con 0x7fb9d8031040 2024-09-12T17:11:31.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94651148068432] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9e222b9c0 20 remove_watcher() i=5 2024-09-12T17:11:31.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94651148076064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00f1a40 con 0x7fb9d8031040 2024-09-12T17:11:31.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94651148076064] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9e222b9c0 20 remove_watcher() i=6 2024-09-12T17:11:31.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.851+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94651148080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5615b00ebda0 con 0x7fb9d8031040 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94651148080256] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9c80ae260 con 0x7fb9d8031040 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 20 remove_watcher() i=7 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb9d8031040 msgr2=0x7fb9d8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb9d8031040 0x7fb9d8032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615b00e1700 msgr2=0x5615b00e3bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615b00e1700 0x5615b00e3bc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb9d0039060 msgr2=0x7fb9d0050870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb9d0039060 0x7fb9d0050870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5615b00e7950 msgr2=0x5615b00e9d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5615b00e7950 0x5615b00e9d40 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8a8039a70 msgr2=0x7fb8a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8a8039a70 0x7fb8a803bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5615b00ac280 tx=0x7fb9d801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 msgr2=0x5615b00d6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9dfd31640 1 -- 172.21.15.193:0/3319305185 reap_dead start 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000fcf0 tx=0x7fb9d00504a0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 shutdown_connections 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3319305185 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00ceea0 0x5615b00d6440 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 >> 172.21.15.193:0/3319305185 conn(0x5615b00cb2d0 msgr2=0x5615b00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 shutdown_connections 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3319305185 wait complete. 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 msgr2=0x7fb8b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 0x7fb8b803bf30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5615b00b2ff0 tx=0x7fb9d8005850 comp rx=0 tx=0).stop 2024-09-12T17:11:31.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 msgr2=0x5615b00c2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0010f90 tx=0x7fb9d000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 shutdown_connections 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8b8039a70 0x7fb8b803bf30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3594378590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615b00c2520 0x5615b00c2940 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 >> 172.21.15.193:0/3594378590 conn(0x5615b00b7ed0 msgr2=0x5615b00b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 shutdown_connections 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3594378590 wait complete. 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 msgr2=0x5615b00b1fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 0x5615b00b1fa0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 msgr2=0x7fb8c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 0x7fb8c803bf30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0001e60 tx=0x7fb9d00013e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 msgr2=0x5615b00aae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8018f70 tx=0x7fb9c80180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 shutdown_connections 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5615affb90b0 0x5615b00b1fa0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb8c8039a70 0x7fb8c803bf30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 --2- 172.21.15.193:0/3835840599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5615affb5f70 0x5615b00aae30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 >> 172.21.15.193:0/3835840599 conn(0x5615affb1a90 msgr2=0x5615aff2aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 shutdown_connections 2024-09-12T17:11:31.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.855+0000 7fb9e222b9c0 1 -- 172.21.15.193:0/3835840599 wait complete. 2024-09-12T17:11:31.872 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:11:31.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-12T17:11:31.872 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-12T17:11:31.951 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:31.951 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:31.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e39f89c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x565515a431f0 0x565515a435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e39f89c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5655158f59c0 con 0x565515a46330 2024-09-12T17:11:31.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e39f89c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5655159456d0 con 0x565515a431f0 2024-09-12T17:11:31.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e14fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x565515a431f0 0x565515a435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e14fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x565515a431f0 0x565515a435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53036/0 (socket says 172.21.15.193:53036) 2024-09-12T17:11:31.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e14fe640 1 -- 172.21.15.193:0/2226329016 learned_addr learned my addr 172.21.15.193:0/2226329016 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e14fe640 1 -- 172.21.15.193:0/2226329016 >> v1:172.21.15.62:6789/0 conn(0x565515a46330 legacy=0x565515a48720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.947+0000 7fe3e14fe640 1 -- 172.21.15.193:0/2226329016 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655158e9ca0 con 0x565515a431f0 2024-09-12T17:11:31.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/2226329016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515a435d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a4e0 tx=0x7fe3dc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fae193fbf5b20b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3dbfff640 1 -- 172.21.15.193:0/2226329016 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0aa540 con 0x565515a431f0 2024-09-12T17:11:31.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3dbfff640 1 -- 172.21.15.193:0/2226329016 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0aa6e0 con 0x565515a431f0 2024-09-12T17:11:31.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3dbfff640 1 -- 172.21.15.193:0/2226329016 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0aaa40 con 0x565515a431f0 2024-09-12T17:11:31.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/2226329016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 msgr2=0x565515a435d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/2226329016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515a435d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00a4e0 tx=0x7fe3dc01b090 comp rx=0 tx=0).stop 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/2226329016 shutdown_connections 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/2226329016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515a435d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/2226329016 >> 172.21.15.193:0/2226329016 conn(0x5655159b6b00 msgr2=0x5655159b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/2226329016 shutdown_connections 2024-09-12T17:11:31.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.951+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/2226329016 wait complete. 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e39f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e39f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565515949680 con 0x565515a431f0 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e14fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e14fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53048/0 (socket says 172.21.15.193:53048) 2024-09-12T17:11:31.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e14fe640 1 -- 172.21.15.193:0/4156713683 learned_addr learned my addr 172.21.15.193:0/4156713683 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e14fe640 1 -- 172.21.15.193:0/4156713683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655158c4da0 con 0x565515a431f0 2024-09-12T17:11:31.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/4156713683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc017ca0 tx=0x7fe3dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb92496bb3de9ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe2cf606640 1 -- 172.21.15.193:0/4156713683 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0b9030 con 0x565515a431f0 2024-09-12T17:11:31.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe2cf606640 1 -- 172.21.15.193:0/4156713683 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0aaa80 con 0x565515a431f0 2024-09-12T17:11:31.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.967+0000 7fe2cf606640 1 -- 172.21.15.193:0/4156713683 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0aada0 con 0x565515a431f0 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/4156713683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 msgr2=0x565515b2e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/4156713683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc017ca0 tx=0x7fe3dc0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/4156713683 shutdown_connections 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/4156713683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b2e880 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/4156713683 >> 172.21.15.193:0/4156713683 conn(0x5655159b6b00 msgr2=0x565515b2a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/4156713683 shutdown_connections 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/4156713683 wait complete. 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5655158eba50 con 0x565515a431f0 2024-09-12T17:11:31.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e14fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e14fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53064/0 (socket says 172.21.15.193:53064) 2024-09-12T17:11:31.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e14fe640 1 -- 172.21.15.193:0/3015195180 learned_addr learned my addr 172.21.15.193:0/3015195180 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e14fe640 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565515b36340 con 0x565515a431f0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc01b930 tx=0x7fe3dc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe2cde03640 1 -- 172.21.15.193:0/3015195180 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0b9070 con 0x565515a431f0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe2cde03640 1 -- 172.21.15.193:0/3015195180 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3dc0c3030 con 0x565515a431f0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565515b365d0 con 0x565515a431f0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe2cde03640 1 -- 172.21.15.193:0/3015195180 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3dc0b5c40 con 0x565515a431f0 2024-09-12T17:11:31.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.971+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565515b36f30 con 0x565515a431f0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe2cde03640 1 -- 172.21.15.193:0/3015195180 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3dc0b3040 con 0x565515a431f0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe2cde03640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe2cde03640 1 -- 172.21.15.193:0/3015195180 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe3dc0ba070 con 0x565515a431f0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 0x565515b3cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b3d440 con 0x565515a46330 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 0x565515b3cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 0x7fe2c803bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc001ec0 tx=0x7fe3cc001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 0x565515b3cf00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 -- 172.21.15.193:0/3015195180 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3d40083f0 con 0x565515a46330 2024-09-12T17:11:31.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b3d880 con 0x565515a46330 2024-09-12T17:11:31.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 -- 172.21.15.193:0/3015195180 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3d40083f0 con 0x565515a46330 2024-09-12T17:11:31.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b3f180 con 0x565515a46330 2024-09-12T17:11:31.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 -- 172.21.15.193:0/3015195180 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3d40083f0 con 0x565515a46330 2024-09-12T17:11:31.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b3e2c0 con 0x565515a46330 2024-09-12T17:11:31.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 -- 172.21.15.193:0/3015195180 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3d40083f0 con 0x565515a46330 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b3e6e0 con 0x565515a46330 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e1cff640 1 -- 172.21.15.193:0/3015195180 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe3d40083f0 con 0x565515a46330 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e39f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565515956450 con 0x565515b4d4b0 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53078/0 (socket says 172.21.15.193:53078) 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.975+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/901875769 learned_addr learned my addr 172.21.15.193:0/901875769 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/901875769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565515b4df10 con 0x565515b4d4b0 2024-09-12T17:11:31.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc010fd0 tx=0x7fe3cc00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 -- 172.21.15.193:0/901875769 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc00a040 con 0x565515b4d4b0 2024-09-12T17:11:31.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 -- 172.21.15.193:0/901875769 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc017050 con 0x565515b4d4b0 2024-09-12T17:11:31.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 -- 172.21.15.193:0/901875769 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc00e6b0 con 0x565515b4d4b0 2024-09-12T17:11:31.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565515b4e770 con 0x565515b4d4b0 2024-09-12T17:11:31.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565515b4ece0 con 0x565515b4d4b0 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 -- 172.21.15.193:0/901875769 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3cc00e8e0 con 0x565515b4d4b0 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 0x7fe2b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe2c6ffd640 1 -- 172.21.15.193:0/901875769 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe3cc052180 con 0x565515b4d4b0 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 0x7fe2b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e39f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565515b2f010 con 0x565515b59e10 2024-09-12T17:11:31.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 0x7fe2b803bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x565515b3e660 tx=0x7fe3d4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53086/0 (socket says 172.21.15.193:53086) 2024-09-12T17:11:31.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.979+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/3181510826 learned_addr learned my addr 172.21.15.193:0/3181510826 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/3181510826 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565515b5a7e0 con 0x565515b59e10 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/3181510826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc050510 tx=0x7fe3cc024360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb724b1a2b8761c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2c4ff9640 1 -- 172.21.15.193:0/3181510826 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc01a310 con 0x565515b59e10 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2c4ff9640 1 -- 172.21.15.193:0/3181510826 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc01c410 con 0x565515b59e10 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2c4ff9640 1 -- 172.21.15.193:0/3181510826 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc01a4b0 con 0x565515b59e10 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3181510826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 msgr2=0x565515b5a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3181510826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc050510 tx=0x7fe3cc024360 comp rx=0 tx=0).stop 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3181510826 shutdown_connections 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3181510826 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b5a1f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:31.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3181510826 >> 172.21.15.193:0/3181510826 conn(0x565515b56240 msgr2=0x565515b54480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3181510826 shutdown_connections 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3181510826 wait complete. 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 Processor -- start 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- start start 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x565515b5ae20 con 0x565515b59e10 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53088/0 (socket says 172.21.15.193:53088) 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 learned_addr learned my addr 172.21.15.193:0/1072440730 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:31.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565515b61900 con 0x565515b59e10 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b613a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00fcf0 tx=0x7fe3cc0504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2b6ffd640 1 -- 172.21.15.193:0/1072440730 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc034070 con 0x565515b59e10 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2b6ffd640 1 -- 172.21.15.193:0/1072440730 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3cc01c410 con 0x565515b59e10 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe2b6ffd640 1 -- 172.21.15.193:0/1072440730 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3cc043040 con 0x565515b59e10 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565515b61b90 con 0x565515b59e10 2024-09-12T17:11:31.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.983+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565515b62540 con 0x565515b59e10 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe2b6ffd640 1 -- 172.21.15.193:0/1072440730 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe3cc023760 con 0x565515b59e10 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe2b6ffd640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ac039a70 0x7fe2ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe2b6ffd640 1 -- 172.21.15.193:0/1072440730 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fe3cc039c30 con 0x565515b59e10 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ac039a70 0x7fe2ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515b6c6b0 0x565515b6eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b6f290 con 0x565515b6c6b0 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515b6c6b0 0x565515b6eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ac039a70 0x7fe2ac03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400f010 tx=0x7fe3d401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515b6c6b0 0x565515b6eb40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 realm 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b6f6f0 con 0x565515b6c6b0 2024-09-12T17:11:31.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b6ffc0 con 0x565515b6c6b0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b70360 con 0x565515b6c6b0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:31.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b70bb0 con 0x565515b6c6b0 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 20 searching for the correct realm 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x565515b72920 0x565515b74d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.987+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x565515b72920 0x565515b74d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x565515b72920 0x565515b74d10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc00d040 con 0x565515b72920 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e0cfd640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe3cc01c030 0x7fe3cc02e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3cc01c030 2024-09-12T17:11:31.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe3cc01c030 0x7fe3cc02e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:31.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe3cc01c030 0x7fe3cc02e770 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:31.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:31.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e1cff640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe3d4019040 0x7fe3d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:31.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:31.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe3d4019040 0x7fe3d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe3d4019040 0x7fe3d4019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.991+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3cc01c030 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc00d040 con 0x565515b72920 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3cc01c030 2024-09-12T17:11:32.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.995+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3cc01c030 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b6c6b0 2024-09-12T17:11:32.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x565515b72920 2024-09-12T17:11:32.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:31.999+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x565515b75250 con 0x7fe3d4019040 2024-09-12T17:11:32.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe3dc0fd040 con 0x7fe3cc01c030 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe3dc0fd040 con 0x565515b72920 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe3dc0fd040 con 0x7fe3d4019040 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe3dc0fd040 con 0x565515b6c6b0 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe3dc0fd040 con 0x7fe3cc01c030 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b71490 con 0x565515b6c6b0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b71d30 con 0x565515b6c6b0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b71d30 con 0x565515b6c6b0 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 zone default found 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 4 Realm: () 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 zonegroup default 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.003+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b75680 con 0x7fe3d4019040 2024-09-12T17:11:32.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b77170 con 0x565515b72920 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b77590 con 0x565515b72920 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 started sync module instance, tier type = 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76510 con 0x7fe3cc01c030 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923436550400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76170 con 0x7fe3cc01c030 2024-09-12T17:11:32.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b784c0 con 0x565515b6c6b0 2024-09-12T17:11:32.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.007+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923436550400] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923436554736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b784c0 con 0x565515b6c6b0 2024-09-12T17:11:32.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b78e80 con 0x565515b72920 2024-09-12T17:11:32.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923436554736] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923436556304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b78430 con 0x565515b72920 2024-09-12T17:11:32.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.011+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b79bc0 con 0x7fe3cc01c030 2024-09-12T17:11:32.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923436562128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7a460 con 0x7fe3cc01c030 2024-09-12T17:11:32.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7aea0 con 0x565515b6c6b0 2024-09-12T17:11:32.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923436556304] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923436562128] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923436566896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b79fb0 con 0x565515b6c6b0 2024-09-12T17:11:32.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.015+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7b740 con 0x7fe3d4019040 2024-09-12T17:11:32.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.019+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923436566896] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.019+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.019+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923436560928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b79fb0 con 0x7fe3d4019040 2024-09-12T17:11:32.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.019+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7bba0 con 0x7fe3d4019040 2024-09-12T17:11:32.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.019+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923436560928] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923436568656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7bba0 con 0x7fe3d4019040 2024-09-12T17:11:32.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7c560 con 0x7fe3d4019040 2024-09-12T17:11:32.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923436568656] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923436570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7c560 con 0x7fe3d4019040 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=0 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=1 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=2 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=3 2024-09-12T17:11:32.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=4 2024-09-12T17:11:32.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=5 2024-09-12T17:11:32.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.023+0000 7fe3e39f89c0 20 add_watcher() i=6 2024-09-12T17:11:32.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923436570832] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 20 add_watcher() i=7 2024-09-12T17:11:32.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:32.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b7f9c0 con 0x565515b6c6b0 2024-09-12T17:11:32.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923436573312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7ce80 con 0x565515b6c6b0 2024-09-12T17:11:32.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923436573312] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe297fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:32.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:32.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.027+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b88160 con 0x565515b6c6b0 2024-09-12T17:11:32.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.031+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.031+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b88810 con 0x7fe3d4019040 2024-09-12T17:11:32.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.031+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.031+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b88810 con 0x565515b72920 2024-09-12T17:11:32.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b88ca0 con 0x565515b6c6b0 2024-09-12T17:11:32.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b88ca0 con 0x7fe3cc01c030 2024-09-12T17:11:32.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.035+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b89290 con 0x565515b72920 2024-09-12T17:11:32.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.039+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.039+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b896c0 con 0x565515b6c6b0 2024-09-12T17:11:32.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.039+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.039+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b89750 con 0x7fe3d4019040 2024-09-12T17:11:32.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b89750 con 0x7fe3cc01c030 2024-09-12T17:11:32.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b89d40 con 0x565515b72920 2024-09-12T17:11:32.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.043+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b89d20 con 0x7fe3cc01c030 2024-09-12T17:11:32.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.047+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'40 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.047+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a290 con 0x7fe3d4019040 2024-09-12T17:11:32.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.047+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.047+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a290 con 0x7fe3cc01c030 2024-09-12T17:11:32.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.051+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.051+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a470 con 0x7fe3d4019040 2024-09-12T17:11:32.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.051+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.051+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a470 con 0x565515b6c6b0 2024-09-12T17:11:32.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a470 con 0x565515b72920 2024-09-12T17:11:32.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a470 con 0x7fe3cc01c030 2024-09-12T17:11:32.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.055+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.059+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.059+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b6c6b0 2024-09-12T17:11:32.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.059+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.059+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b6c6b0 2024-09-12T17:11:32.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x7fe3cc01c030 2024-09-12T17:11:32.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.063+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.067+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a500 con 0x565515b72920 2024-09-12T17:11:32.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.071+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.071+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a520 con 0x7fe3d4019040 2024-09-12T17:11:32.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.071+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.071+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a520 con 0x565515b72920 2024-09-12T17:11:32.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.075+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.075+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a520 con 0x7fe3d4019040 2024-09-12T17:11:32.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.075+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.075+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a520 con 0x565515b72920 2024-09-12T17:11:32.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.079+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.079+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a520 con 0x7fe3d4019040 2024-09-12T17:11:32.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.079+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.079+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b8a560 con 0x7fe3cc01c030 2024-09-12T17:11:32.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe296fe5640 20 reqs_thread_entry: start 2024-09-12T17:11:32.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:32.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 20 Filter name: none 2024-09-12T17:11:32.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe294fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:32.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-12T17:11:32.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515b86390 con 0x7fe3d4019040 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515ba8100 con 0x565515b6c6b0 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv3 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:11:32.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.083+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515ba60e0 con 0x7fe3d4019040 2024-09-12T17:11:32.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:11:32.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94923436747840 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515ba8520 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== watch-notify(notify (1) cookie 94923436556304 notify 137438953477 ret 0) ==== 212+0+0 (crc 0 0 0) 0x565515b897a0 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe2c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94923436556304 notifier 4566 bl.length()=170 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(97 notify.2 [notify cookie 94923436747840 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe2c4ff9640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe2a4003d70 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== watch-notify(notify_complete (2) cookie 94923436747840 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565515b61900 con 0x565515b72920 2024-09-12T17:11:32.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 10 removing email index: 2024-09-12T17:11:32.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 10 removing user buckets index 2024-09-12T17:11:32.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515ba60e0 con 0x565515b6c6b0 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.087+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94923436747840 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515ba8520 con 0x565515b6c6b0 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== watch-notify(notify (1) cookie 94923436566896 notify 137438953496 ret 0) ==== 217+0+0 (crc 0 0 0) 0x565515b87e90 con 0x565515b6c6b0 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe2b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94923436566896 notifier 4566 bl.length()=175 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(100 notify.4 [notify cookie 94923436747840 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe2b7fff640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe2080032d0 con 0x565515b6c6b0 2024-09-12T17:11:32.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== watch-notify(notify_complete (2) cookie 94923436747840 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565515b869d0 con 0x565515b6c6b0 2024-09-12T17:11:32.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e39f89c0 10 removing user index: testx$tenanteduser 2024-09-12T17:11:32.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515baa120 con 0x7fe3d4019040 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e39f89c0 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e39f89c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94923436743728 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x565515ba7510 con 0x7fe3cc01c030 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== watch-notify(notify (1) cookie 94923436562128 notify 137438953487 ret 0) ==== 209+0+0 (crc 0 0 0) 0x565515b89cc0 con 0x7fe3cc01c030 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe2c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94923436562128 notifier 4566 bl.length()=167 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(103 notify.3 [notify cookie 94923436743728 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe2c4ff9640 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe2a4003d70 con 0x7fe3cc01c030 2024-09-12T17:11:32.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.091+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== watch-notify(notify_complete (2) cookie 94923436743728 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x565515b88cf0 con 0x7fe3cc01c030 2024-09-12T17:11:32.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe297fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923436573312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b84bf0 con 0x565515b6c6b0 2024-09-12T17:11:32.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94923436573312] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923436550400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7c250 con 0x7fe3cc01c030 2024-09-12T17:11:32.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94923436550400] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e39f89c0 20 remove_watcher() i=0 2024-09-12T17:11:32.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e39f89c0 2 removed watcher, disabling cache 2024-09-12T17:11:32.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.095+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923436554736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76900 con 0x565515b6c6b0 2024-09-12T17:11:32.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94923436554736] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e39f89c0 20 remove_watcher() i=1 2024-09-12T17:11:32.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923436556304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76900 con 0x565515b72920 2024-09-12T17:11:32.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e0cfd640 1 -- 172.21.15.193:0/1072440730 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94923436556304] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3cc05f040 con 0x565515b72920 2024-09-12T17:11:32.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e39f89c0 20 remove_watcher() i=2 2024-09-12T17:11:32.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.099+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923436562128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76900 con 0x7fe3cc01c030 2024-09-12T17:11:32.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e1cff640 1 -- 172.21.15.193:0/1072440730 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94923436562128] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d402f040 con 0x7fe3cc01c030 2024-09-12T17:11:32.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e39f89c0 20 remove_watcher() i=3 2024-09-12T17:11:32.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923436566896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76900 con 0x565515b6c6b0 2024-09-12T17:11:32.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94923436566896] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x565515b6c6b0 2024-09-12T17:11:32.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e39f89c0 20 remove_watcher() i=4 2024-09-12T17:11:32.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.103+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923436560928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7a970 con 0x7fe3d4019040 2024-09-12T17:11:32.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94923436560928] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e39f89c0 20 remove_watcher() i=5 2024-09-12T17:11:32.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923436568656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b76900 con 0x7fe3d4019040 2024-09-12T17:11:32.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94923436568656] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e39f89c0 20 remove_watcher() i=6 2024-09-12T17:11:32.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.107+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923436570832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x565515b7a970 con 0x7fe3d4019040 2024-09-12T17:11:32.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94923436570832] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3dc0e7040 con 0x7fe3d4019040 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 20 remove_watcher() i=7 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe3d4019040 msgr2=0x7fe3d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe3d4019040 0x7fe3d4019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515b6c6b0 msgr2=0x565515b6eb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515b6c6b0 0x565515b6eb40 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe3cc01c030 msgr2=0x7fe3cc02e770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe3cc01c030 0x7fe3cc02e770 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x565515b72920 msgr2=0x565515b74d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x565515b72920 0x565515b74d10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ac039a70 msgr2=0x7fe2ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ac039a70 0x7fe2ac03bf30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe3d400f010 tx=0x7fe3d401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 msgr2=0x565515b613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/1072440730 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b59e10 0x565515b613a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc00fcf0 tx=0x7fe3cc0504a0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e14fe640 1 -- 172.21.15.193:0/1072440730 reap_dead start 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 shutdown_connections 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 >> 172.21.15.193:0/1072440730 conn(0x565515b56240 msgr2=0x565515b54450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 shutdown_connections 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/1072440730 wait complete. 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 msgr2=0x7fe2b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 0x7fe2b803bf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x565515b3e660 tx=0x7fe3d4003070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 msgr2=0x565515b4d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc010fd0 tx=0x7fe3cc00f7a0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 shutdown_connections 2024-09-12T17:11:32.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2b8039a70 0x7fe2b803bf30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/901875769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515b4d4b0 0x565515b4d8d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 >> 172.21.15.193:0/901875769 conn(0x565515b42e60 msgr2=0x565515b43240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 shutdown_connections 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/901875769 wait complete. 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 msgr2=0x565515b3cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 0x565515b3cf00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 msgr2=0x7fe2c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 0x7fe2c803bf30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc001ec0 tx=0x7fe3cc001440 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 msgr2=0x565515b35de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc01b930 tx=0x7fe3dc017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 shutdown_connections 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x565515a46330 0x565515b3cf00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2c8039a70 0x7fe2c803bf30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.111+0000 7fe3e39f89c0 1 --2- 172.21.15.193:0/3015195180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x565515a431f0 0x565515b35de0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.115+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 >> 172.21.15.193:0/3015195180 conn(0x5655159b6b00 msgr2=0x565515b28f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.115+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 shutdown_connections 2024-09-12T17:11:32.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.115+0000 7fe3e39f89c0 1 -- 172.21.15.193:0/3015195180 wait complete. 2024-09-12T17:11:32.137 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T17:11:32.141 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-12T17:11:32.185 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:32.186 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T17:11:32.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-12T17:11:32.186 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-12T17:11:32.227 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:32.227 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:32.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f99111a59c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5616d7787340 0x5616d7789730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f99111a59c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616d76359c0 con 0x5616d77831f0 2024-09-12T17:11:32.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f99111a59c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5616d76856d0 con 0x5616d7787340 2024-09-12T17:11:32.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f990e4aa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5616d7787340 0x5616d7789730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f990ecab640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5616d77831f0 0x5616d77835d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36770/0 (socket says 172.21.15.193:36770) 2024-09-12T17:11:32.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.223+0000 7f990ecab640 1 -- 172.21.15.193:0/1538729790 learned_addr learned my addr 172.21.15.193:0/1538729790 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:32.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990e4aa640 1 -- 172.21.15.193:0/1538729790 >> v1:172.21.15.62:6789/0 conn(0x5616d77831f0 legacy=0x5616d77835d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990e4aa640 1 -- 172.21.15.193:0/1538729790 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d7629ca0 con 0x5616d7787340 2024-09-12T17:11:32.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990e4aa640 1 --2- 172.21.15.193:0/1538729790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7787340 0x5616d7789730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98f800a420 tx=0x7f98f801b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9684eca78b2958 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990dca9640 1 -- 172.21.15.193:0/1538729790 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80af070 con 0x5616d7787340 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990dca9640 1 -- 172.21.15.193:0/1538729790 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80aa530 con 0x5616d7787340 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f990dca9640 1 -- 172.21.15.193:0/1538729790 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80aa850 con 0x5616d7787340 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.227+0000 7f99111a59c0 1 -- 172.21.15.193:0/1538729790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7787340 msgr2=0x5616d7789730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1538729790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7787340 0x5616d7789730 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f98f800a420 tx=0x7f98f801b060 comp rx=0 tx=0).stop 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 -- 172.21.15.193:0/1538729790 shutdown_connections 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1538729790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7787340 0x5616d7789730 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 -- 172.21.15.193:0/1538729790 >> 172.21.15.193:0/1538729790 conn(0x5616d76f6b00 msgr2=0x5616d76f6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 -- 172.21.15.193:0/1538729790 shutdown_connections 2024-09-12T17:11:32.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.231+0000 7f99111a59c0 1 -- 172.21.15.193:0/1538729790 wait complete. 2024-09-12T17:11:32.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5616d7689680 con 0x5616d77831f0 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53116/0 (socket says 172.21.15.193:53116) 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 -- 172.21.15.193:0/2551194673 learned_addr learned my addr 172.21.15.193:0/2551194673 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 -- 172.21.15.193:0/2551194673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d7604da0 con 0x5616d77831f0 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 --2- 172.21.15.193:0/2551194673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9908001e50 tx=0x7f9908001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1593cdd8df13390 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f97fce09640 1 -- 172.21.15.193:0/2551194673 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9908012020 con 0x5616d77831f0 2024-09-12T17:11:32.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f97fce09640 1 -- 172.21.15.193:0/2551194673 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990800e7c0 con 0x5616d77831f0 2024-09-12T17:11:32.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f97fce09640 1 -- 172.21.15.193:0/2551194673 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990800eaa0 con 0x5616d77831f0 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- 172.21.15.193:0/2551194673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 msgr2=0x5616d786e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 --2- 172.21.15.193:0/2551194673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9908001e50 tx=0x7f9908001e80 comp rx=0 tx=0).stop 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- 172.21.15.193:0/2551194673 shutdown_connections 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 --2- 172.21.15.193:0/2551194673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d786e8e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- 172.21.15.193:0/2551194673 >> 172.21.15.193:0/2551194673 conn(0x5616d76f6b00 msgr2=0x5616d786a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- 172.21.15.193:0/2551194673 shutdown_connections 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- 172.21.15.193:0/2551194673 wait complete. 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f99111a59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5616d762ba50 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.247+0000 7f990ecab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990ecab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53120/0 (socket says 172.21.15.193:53120) 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990ecab640 1 -- 172.21.15.193:0/1304814226 learned_addr learned my addr 172.21.15.193:0/1304814226 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990ecab640 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d7876560 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990ecab640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9908001ec0 tx=0x7f9908000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 -- 172.21.15.193:0/1304814226 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9908012030 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 -- 172.21.15.193:0/1304814226 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99080014b0 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d78767f0 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 -- 172.21.15.193:0/1304814226 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990801a8d0 con 0x5616d77831f0 2024-09-12T17:11:32.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d78771a0 con 0x5616d77831f0 2024-09-12T17:11:32.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 -- 172.21.15.193:0/1304814226 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9908015020 con 0x5616d77831f0 2024-09-12T17:11:32.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 0x7f97f403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f97fb606640 1 -- 172.21.15.193:0/1304814226 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f9908020070 con 0x5616d77831f0 2024-09-12T17:11:32.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990e4aa640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 0x7f97f403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 0x5616d787d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d787d6b0 con 0x5616d7787340 2024-09-12T17:11:32.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990f4ac640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 0x5616d787d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990e4aa640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 0x7f97f403bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ac000 tx=0x7f98f80a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990f4ac640 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 0x5616d787d170 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.251+0000 7f990f4ac640 1 -- 172.21.15.193:0/1304814226 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f99000083f0 con 0x5616d7787340 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78774e0 con 0x5616d7787340 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990f4ac640 1 -- 172.21.15.193:0/1304814226 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f99000083f0 con 0x5616d7787340 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d787f410 con 0x5616d7787340 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990f4ac640 1 -- 172.21.15.193:0/1304814226 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f99000083f0 con 0x5616d7787340 2024-09-12T17:11:32.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d787e640 con 0x5616d7787340 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990f4ac640 1 -- 172.21.15.193:0/1304814226 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f99000083f0 con 0x5616d7787340 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d787ea90 con 0x5616d7787340 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990f4ac640 1 -- 172.21.15.193:0/1304814226 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f99000083f0 con 0x5616d7787340 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5616d7696450 con 0x5616d788d720 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53136/0 (socket says 172.21.15.193:53136) 2024-09-12T17:11:32.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990e4aa640 1 -- 172.21.15.193:0/231414922 learned_addr learned my addr 172.21.15.193:0/231414922 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990e4aa640 1 -- 172.21.15.193:0/231414922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d788e180 con 0x5616d788d720 2024-09-12T17:11:32.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f990e4aa640 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98f8096b50 tx=0x7f98f8017e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f97f8e01640 1 -- 172.21.15.193:0/231414922 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80c7070 con 0x5616d788d720 2024-09-12T17:11:32.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f97f8e01640 1 -- 172.21.15.193:0/231414922 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80b0040 con 0x5616d788d720 2024-09-12T17:11:32.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f97f8e01640 1 -- 172.21.15.193:0/231414922 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80c2680 con 0x5616d788d720 2024-09-12T17:11:32.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d788e9e0 con 0x5616d788d720 2024-09-12T17:11:32.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.255+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d788eef0 con 0x5616d788d720 2024-09-12T17:11:32.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f8e01640 1 -- 172.21.15.193:0/231414922 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98f80ca070 con 0x5616d788d720 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f8e01640 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 0x7f97e803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f8e01640 1 -- 172.21.15.193:0/231414922 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f98f80bd030 con 0x5616d788d720 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990f4ac640 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 0x7f97e803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990f4ac640 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 0x7f97e803bf80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f990000e3f0 tx=0x7f9900003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5616d786f130 con 0x5616d7899f60 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53146/0 (socket says 172.21.15.193:53146) 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990e4aa640 1 -- 172.21.15.193:0/1976805674 learned_addr learned my addr 172.21.15.193:0/1976805674 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990e4aa640 1 -- 172.21.15.193:0/1976805674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d789a910 con 0x5616d7899f60 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f990e4aa640 1 --2- 172.21.15.193:0/1976805674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f98f80eaf30 tx=0x7f98f80c03e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857f6c8dcb641de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f27fc640 1 -- 172.21.15.193:0/1976805674 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80c0a70 con 0x5616d7899f60 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f27fc640 1 -- 172.21.15.193:0/1976805674 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80c0c10 con 0x5616d7899f60 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f97f27fc640 1 -- 172.21.15.193:0/1976805674 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80c04e0 con 0x5616d7899f60 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 -- 172.21.15.193:0/1976805674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 msgr2=0x5616d789a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1976805674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f98f80eaf30 tx=0x7f98f80c03e0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 -- 172.21.15.193:0/1976805674 shutdown_connections 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1976805674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d789a340 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.259+0000 7f99111a59c0 1 -- 172.21.15.193:0/1976805674 >> 172.21.15.193:0/1976805674 conn(0x5616d7896390 msgr2=0x5616d78945d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- 172.21.15.193:0/1976805674 shutdown_connections 2024-09-12T17:11:32.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- 172.21.15.193:0/1976805674 wait complete. 2024-09-12T17:11:32.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 Processor -- start 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- start start 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5616d789af70 con 0x5616d7899f60 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f990e4aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53152/0 (socket says 172.21.15.193:53152) 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 learned_addr learned my addr 172.21.15.193:0/4145722692 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616d78a1aa0 con 0x5616d7899f60 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f990e4aa640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f98f80b7e20 tx=0x7f98f80eaec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 -- 172.21.15.193:0/4145722692 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80c0840 con 0x5616d7899f60 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616d78a1d30 con 0x5616d7899f60 2024-09-12T17:11:32.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 -- 172.21.15.193:0/4145722692 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f80b4400 con 0x5616d7899f60 2024-09-12T17:11:32.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 -- 172.21.15.193:0/4145722692 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98f80b4720 con 0x5616d7899f60 2024-09-12T17:11:32.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616d78a26e0 con 0x5616d7899f60 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 -- 172.21.15.193:0/4145722692 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f98f80f3060 con 0x5616d7899f60 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97d8039a70 0x7f97d803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.263+0000 7f97f0ff9640 1 -- 172.21.15.193:0/4145722692 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f98f80f6c40 con 0x5616d7899f60 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97d8039a70 0x7f97d803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d78ac7e0 0x5616d78aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78af3c0 con 0x5616d78ac7e0 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d78ac7e0 0x5616d78aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97d8039a70 0x7f97d803bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f990000f010 tx=0x7f990001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d78ac7e0 0x5616d78aec70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 realm 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78af7d0 con 0x5616d78ac7e0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b00a0 con 0x5616d78ac7e0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b0440 con 0x5616d78ac7e0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b0c90 con 0x5616d78ac7e0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 20 searching for the correct realm 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5616d78b2a00 0x5616d78b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990e4aa640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5616d78b2a00 0x5616d78b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990e4aa640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5616d78b2a00 0x5616d78b4df0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990e4aa640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f98f80d9040 0x7f98f8007aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f98f80d9040 0x7f98f8007aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f98f80d9040 0x7f98f8007aa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9900019040 0x7f9900019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.267+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9900019040 0x7f9900019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9900019040 0x7f9900019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.271+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.275+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.279+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78b2a00 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f9900019040 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x5616d78ac7e0 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b5330 con 0x7f98f80d9040 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b1570 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b1e10 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b1e10 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 zone default found 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 4 Realm: () 2024-09-12T17:11:32.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:32.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:32.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:32.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 zonegroup default 2024-09-12T17:11:32.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b1e10 con 0x7f9900019040 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b71d0 con 0x5616d78b2a00 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b7610 con 0x5616d78b2a00 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 started sync module instance, tier type = 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.283+0000 7f99111a59c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b1ba0 con 0x7f98f80d9040 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656105506592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b7ab0 con 0x7f98f80d9040 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b8520 con 0x5616d78ac7e0 2024-09-12T17:11:32.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656105506592] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656105512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b84e0 con 0x5616d78ac7e0 2024-09-12T17:11:32.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.287+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b8f60 con 0x5616d78b2a00 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656105512976] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656105515696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b9350 con 0x5616d78b2a00 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b9d10 con 0x7f98f80d9040 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656105519472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78ba440 con 0x7f98f80d9040 2024-09-12T17:11:32.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78baf60 con 0x5616d78ac7e0 2024-09-12T17:11:32.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.291+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656105515696] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656105519472] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656105523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78baf20 con 0x5616d78ac7e0 2024-09-12T17:11:32.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bb350 con 0x7f9900019040 2024-09-12T17:11:32.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656105523760] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656105507888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bb300 con 0x7f9900019040 2024-09-12T17:11:32.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.295+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bbd60 con 0x7f9900019040 2024-09-12T17:11:32.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.299+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.299+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656105527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc180 con 0x7f9900019040 2024-09-12T17:11:32.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.299+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bcbe0 con 0x7f9900019040 2024-09-12T17:11:32.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.299+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656105507888] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.299+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656105527472] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656105520784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bbcd0 con 0x7f9900019040 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=0 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=1 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=2 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=3 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=4 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=5 2024-09-12T17:11:32.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=6 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656105520784] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 20 add_watcher() i=7 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bfce0 con 0x5616d78ac7e0 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.303+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656105531072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bd160 con 0x5616d78ac7e0 2024-09-12T17:11:32.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656105531072] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f97c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f99111a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:32.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f99111a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:32.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c8370 con 0x5616d78ac7e0 2024-09-12T17:11:32.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.307+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c8370 con 0x7f9900019040 2024-09-12T17:11:32.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c8930 con 0x5616d78b2a00 2024-09-12T17:11:32.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c9180 con 0x5616d78ac7e0 2024-09-12T17:11:32.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.311+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c9180 con 0x7f98f80d9040 2024-09-12T17:11:32.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.315+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.315+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c6a60 con 0x5616d78b2a00 2024-09-12T17:11:32.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.315+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.315+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c9ce0 con 0x5616d78ac7e0 2024-09-12T17:11:32.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.315+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.319+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c9ce0 con 0x7f9900019040 2024-09-12T17:11:32.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.319+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.319+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c9ce0 con 0x7f98f80d9040 2024-09-12T17:11:32.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78ca190 con 0x5616d78b2a00 2024-09-12T17:11:32.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78ca530 con 0x7f98f80d9040 2024-09-12T17:11:32.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'43 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.323+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caaa0 con 0x7f9900019040 2024-09-12T17:11:32.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.327+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.327+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caaa0 con 0x7f98f80d9040 2024-09-12T17:11:32.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.327+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.327+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa00 con 0x7f9900019040 2024-09-12T17:11:32.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.331+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.331+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa00 con 0x5616d78ac7e0 2024-09-12T17:11:32.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.331+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.331+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa00 con 0x5616d78b2a00 2024-09-12T17:11:32.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa00 con 0x7f98f80d9040 2024-09-12T17:11:32.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa90 con 0x5616d78b2a00 2024-09-12T17:11:32.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.335+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa90 con 0x5616d78ac7e0 2024-09-12T17:11:32.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.339+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.339+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa90 con 0x5616d78ac7e0 2024-09-12T17:11:32.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.339+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.339+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa90 con 0x5616d78b2a00 2024-09-12T17:11:32.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78caa90 con 0x7f98f80d9040 2024-09-12T17:11:32.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cabc0 con 0x5616d78b2a00 2024-09-12T17:11:32.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.343+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cabc0 con 0x5616d78b2a00 2024-09-12T17:11:32.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cabc0 con 0x5616d78b2a00 2024-09-12T17:11:32.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cabc0 con 0x5616d78b2a00 2024-09-12T17:11:32.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.347+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac00 con 0x7f9900019040 2024-09-12T17:11:32.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.351+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.351+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac40 con 0x5616d78b2a00 2024-09-12T17:11:32.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.351+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.351+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac40 con 0x7f9900019040 2024-09-12T17:11:32.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.355+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.355+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac40 con 0x5616d78b2a00 2024-09-12T17:11:32.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.355+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.355+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac40 con 0x7f9900019040 2024-09-12T17:11:32.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.359+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.359+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78cac80 con 0x7f98f80d9040 2024-09-12T17:11:32.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f973ffff640 20 reqs_thread_entry: start 2024-09-12T17:11:32.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 Filter name: none 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f973dffb640 20 reqs_thread_entry: start 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78c5d40 con 0x7f98f80d9040 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:32.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:32.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:32.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:32.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:95 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78e7810 con 0x5616d78b2a00 2024-09-12T17:11:32.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(95 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 get_obj_state: octx=0x5616d789a340 obj=myfoo:four state=0x5616d78e8508 s->prefetch_data=0 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 3.10s0 3:080ca076:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616d78e9610 con 0x5616d78ac7e0 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(96 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 10 manifest: total_size = 4 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15173455510927302317 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 get_obj_state: octx=0x5616d789a340 obj=myfoo:four state=0x5616d78e8508 s->prefetch_data=0 2024-09-12T17:11:32.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 prepare_atomic_modification: state is not atomic. state=0x5616d78e8508 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.363+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78edff0 con 0x5616d78ac7e0 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.367+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.367+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 3.10s0 3:080ca076:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78edff0 con 0x5616d78ac7e0 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.367+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(98 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.367+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78eea80 con 0x5616d78ac7e0 2024-09-12T17:11:32.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f97c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656105531072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78eea80 con 0x5616d78ac7e0 2024-09-12T17:11:32.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(99 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f97f27fc640 20 handle_completion(): completion ok for obj=four 2024-09-12T17:11:32.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94656105531072] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656105506592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc6c0 con 0x7f98f80d9040 2024-09-12T17:11:32.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94656105506592] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f99111a59c0 20 remove_watcher() i=0 2024-09-12T17:11:32.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f99111a59c0 2 removed watcher, disabling cache 2024-09-12T17:11:32.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.371+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656105512976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc6c0 con 0x5616d78ac7e0 2024-09-12T17:11:32.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94656105512976] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f99111a59c0 20 remove_watcher() i=1 2024-09-12T17:11:32.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656105515696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc6c0 con 0x5616d78b2a00 2024-09-12T17:11:32.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f990e4aa640 1 -- 172.21.15.193:0/4145722692 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94656105515696] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98f80c9030 con 0x5616d78b2a00 2024-09-12T17:11:32.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f99111a59c0 20 remove_watcher() i=2 2024-09-12T17:11:32.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.375+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656105519472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b8ab0 con 0x7f98f80d9040 2024-09-12T17:11:32.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f990f4ac640 1 -- 172.21.15.193:0/4145722692 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94656105519472] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f990002f040 con 0x7f98f80d9040 2024-09-12T17:11:32.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f99111a59c0 20 remove_watcher() i=3 2024-09-12T17:11:32.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656105523760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc6c0 con 0x5616d78ac7e0 2024-09-12T17:11:32.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94656105523760] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x5616d78ac7e0 2024-09-12T17:11:32.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f99111a59c0 20 remove_watcher() i=4 2024-09-12T17:11:32.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.379+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656105507888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b8ab0 con 0x7f9900019040 2024-09-12T17:11:32.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94656105507888] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f99111a59c0 20 remove_watcher() i=5 2024-09-12T17:11:32.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656105527472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78bc6c0 con 0x7f9900019040 2024-09-12T17:11:32.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94656105527472] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f99111a59c0 20 remove_watcher() i=6 2024-09-12T17:11:32.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.383+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656105520784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616d78b8ab0 con 0x7f9900019040 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94656105520784] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9908008030 con 0x7f9900019040 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 20 remove_watcher() i=7 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9900019040 msgr2=0x7f9900019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9900019040 0x7f9900019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d78ac7e0 msgr2=0x5616d78aec70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d78ac7e0 0x5616d78aec70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f98f80d9040 msgr2=0x7f98f8007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f98f80d9040 0x7f98f8007aa0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5616d78b2a00 msgr2=0x5616d78b4df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5616d78b2a00 0x5616d78b4df0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97d8039a70 msgr2=0x7f97d803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97d8039a70 0x7f97d803bf30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f990000f010 tx=0x7f990001b070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f990ecab640 1 -- 172.21.15.193:0/4145722692 reap_dead start 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 msgr2=0x5616d78a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f98f80b7e20 tx=0x7f98f80eaec0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 shutdown_connections 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/4145722692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d7899f60 0x5616d78a1540 secure :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f98f80b7e20 tx=0x7f98f80eaec0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 >> 172.21.15.193:0/4145722692 conn(0x5616d7896390 msgr2=0x5616d78945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 shutdown_connections 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/4145722692 wait complete. 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 msgr2=0x7f97e803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 0x7f97e803bf80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f990000e3f0 tx=0x7f9900003070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 msgr2=0x5616d788db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98f8096b50 tx=0x7f98f8017e00 comp rx=0 tx=0).stop 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 shutdown_connections 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97e8039ac0 0x7f97e803bf80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/231414922 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d788d720 0x5616d788db40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 >> 172.21.15.193:0/231414922 conn(0x5616d78830d0 msgr2=0x5616d78834b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 shutdown_connections 2024-09-12T17:11:32.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/231414922 wait complete. 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 msgr2=0x5616d787d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 0x5616d787d170 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 msgr2=0x7f97f403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 0x7f97f403bf30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f80ac000 tx=0x7f98f80a5000 comp rx=0 tx=0).stop 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 msgr2=0x5616d7876000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9908001ec0 tx=0x7f9908000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 shutdown_connections 2024-09-12T17:11:32.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5616d7787340 0x5616d787d170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f97f4039a70 0x7f97f403bf30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 --2- 172.21.15.193:0/1304814226 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5616d77831f0 0x5616d7876000 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 >> 172.21.15.193:0/1304814226 conn(0x5616d76f6b00 msgr2=0x5616d7868fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 shutdown_connections 2024-09-12T17:11:32.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.387+0000 7f99111a59c0 1 -- 172.21.15.193:0/1304814226 wait complete. 2024-09-12T17:11:32.404 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:32.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-12T17:11:32.405 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-12T17:11:32.484 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:32.484 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:32.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.479+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.479+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f119c2959c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5613725ef710 0x5613725f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f119c2959c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613724a19c0 con 0x5613725f2040 2024-09-12T17:11:32.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f119c2959c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5613724f16d0 con 0x5613725ef710 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5613725ef710 0x5613725f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5613725ef710 0x5613725f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53154/0 (socket says 172.21.15.193:53154) 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 -- 172.21.15.193:0/3480386590 learned_addr learned my addr 172.21.15.193:0/3480386590 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f119959a640 1 --1- 172.21.15.193:0/3480386590 >> v1:172.21.15.62:6789/0 conn(0x5613725f2040 0x5613725f4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36778/0 (socket says 172.21.15.193:36778) 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1198d99640 1 -- 172.21.15.193:0/3480386590 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718230057 0 0) 0x5613724a19c0 con 0x5613725f2040 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 -- 172.21.15.193:0/3480386590 >> v1:172.21.15.62:6789/0 conn(0x5613725f2040 legacy=0x5613725f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 -- 172.21.15.193:0/3480386590 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372495ca0 con 0x5613725ef710 2024-09-12T17:11:32.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.483+0000 7f1199d9b640 1 --2- 172.21.15.193:0/3480386590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613725f1b00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f118400a5c0 tx=0x7f118401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d1a32b331869d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f1198d99640 1 -- 172.21.15.193:0/3480386590 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840a6070 con 0x5613725ef710 2024-09-12T17:11:32.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f1198d99640 1 -- 172.21.15.193:0/3480386590 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840af070 con 0x5613725ef710 2024-09-12T17:11:32.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f1198d99640 1 -- 172.21.15.193:0/3480386590 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840aa5c0 con 0x5613725ef710 2024-09-12T17:11:32.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 -- 172.21.15.193:0/3480386590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 msgr2=0x5613725f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 --2- 172.21.15.193:0/3480386590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613725f1b00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f118400a5c0 tx=0x7f118401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:32.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 -- 172.21.15.193:0/3480386590 shutdown_connections 2024-09-12T17:11:32.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 --2- 172.21.15.193:0/3480386590 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613725f1b00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 -- 172.21.15.193:0/3480386590 >> 172.21.15.193:0/3480386590 conn(0x561372562aa0 msgr2=0x561372562eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 -- 172.21.15.193:0/3480386590 shutdown_connections 2024-09-12T17:11:32.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.487+0000 7f119c2959c0 1 -- 172.21.15.193:0/3480386590 wait complete. 2024-09-12T17:11:32.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5613724f5680 con 0x5613725ef710 2024-09-12T17:11:32.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53166/0 (socket says 172.21.15.193:53166) 2024-09-12T17:11:32.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1199d9b640 1 -- 172.21.15.193:0/930734537 learned_addr learned my addr 172.21.15.193:0/930734537 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1199d9b640 1 -- 172.21.15.193:0/930734537 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372470da0 con 0x5613725ef710 2024-09-12T17:11:32.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1199d9b640 1 --2- 172.21.15.193:0/930734537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f11840ac040 tx=0x7f1184003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d3510eff927b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1087e07640 1 -- 172.21.15.193:0/930734537 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840aa970 con 0x5613725ef710 2024-09-12T17:11:32.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1087e07640 1 -- 172.21.15.193:0/930734537 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840aab10 con 0x5613725ef710 2024-09-12T17:11:32.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f1087e07640 1 -- 172.21.15.193:0/930734537 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840aae30 con 0x5613725ef710 2024-09-12T17:11:32.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- 172.21.15.193:0/930734537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 msgr2=0x5613726da700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 --2- 172.21.15.193:0/930734537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f11840ac040 tx=0x7f1184003030 comp rx=0 tx=0).stop 2024-09-12T17:11:32.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- 172.21.15.193:0/930734537 shutdown_connections 2024-09-12T17:11:32.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 --2- 172.21.15.193:0/930734537 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726da700 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- 172.21.15.193:0/930734537 >> 172.21.15.193:0/930734537 conn(0x561372562aa0 msgr2=0x5613726d6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- 172.21.15.193:0/930734537 shutdown_connections 2024-09-12T17:11:32.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.503+0000 7f119c2959c0 1 -- 172.21.15.193:0/930734537 wait complete. 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561372497a50 con 0x5613725ef710 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1199d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53180/0 (socket says 172.21.15.193:53180) 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1199d9b640 1 -- 172.21.15.193:0/2569935416 learned_addr learned my addr 172.21.15.193:0/2569935416 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1199d9b640 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613726e21d0 con 0x5613725ef710 2024-09-12T17:11:32.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1199d9b640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1184096f40 tx=0x7f11840180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1086604640 1 -- 172.21.15.193:0/2569935416 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840cb020 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1086604640 1 -- 172.21.15.193:0/2569935416 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11840c6650 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f1086604640 1 -- 172.21.15.193:0/2569935416 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11840c6950 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613726e2460 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.507+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613726e2e10 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f1086604640 1 -- 172.21.15.193:0/2569935416 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f11840ce020 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f1086604640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 0x7f108003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f1086604640 1 -- 172.21.15.193:0/2569935416 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f11840ebaa0 con 0x5613725ef710 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119959a640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 0x7f108003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 0x5613726e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613726e9320 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 0x5613726e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119959a640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 0x7f108003bf80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1194000f90 tx=0x7f1194006550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 0x5613726e8de0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 -- 172.21.15.193:0/2569935416 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f118c0083f0 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613726e3160 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 -- 172.21.15.193:0/2569935416 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f118c0083f0 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613726eb100 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 -- 172.21.15.193:0/2569935416 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f118c0083f0 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613726ea330 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 -- 172.21.15.193:0/2569935416 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f118c0083f0 con 0x5613725f2040 2024-09-12T17:11:32.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613726ea780 con 0x5613725f2040 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119a59c640 1 -- 172.21.15.193:0/2569935416 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f118c0083f0 con 0x5613725f2040 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.511+0000 7f119c2959c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561372502450 con 0x5613726f93d0 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53186/0 (socket says 172.21.15.193:53186) 2024-09-12T17:11:32.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119959a640 1 -- 172.21.15.193:0/1011579762 learned_addr learned my addr 172.21.15.193:0/1011579762 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119959a640 1 -- 172.21.15.193:0/1011579762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613726f9e30 con 0x5613726f93d0 2024-09-12T17:11:32.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119959a640 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1194006390 tx=0x7f1194015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 -- 172.21.15.193:0/1011579762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1194011440 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 -- 172.21.15.193:0/1011579762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11940115e0 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613726fa690 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 -- 172.21.15.193:0/1011579762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11940118c0 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613726fac00 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 -- 172.21.15.193:0/1011579762 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1194011a60 con 0x5613726f93d0 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 0x7f107403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f107f7fe640 1 -- 172.21.15.193:0/1011579762 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f119401b030 con 0x5613726f93d0 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.515+0000 7f119a59c640 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 0x7f107403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119a59c640 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 0x7f107403bf80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f118c00e3f0 tx=0x7f118c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5613726dae90 con 0x561372706d20 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53200/0 (socket says 172.21.15.193:53200) 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 -- 172.21.15.193:0/3035490728 learned_addr learned my addr 172.21.15.193:0/3035490728 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 -- 172.21.15.193:0/3035490728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561372707710 con 0x561372706d20 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 --2- 172.21.15.193:0/3035490728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1194050200 tx=0x7f119401f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeecf845b3c3df0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f107d7fa640 1 -- 172.21.15.193:0/3035490728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1194043070 con 0x561372706d20 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f107d7fa640 1 -- 172.21.15.193:0/3035490728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194013c80 con 0x561372706d20 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f107d7fa640 1 -- 172.21.15.193:0/3035490728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119401e330 con 0x561372706d20 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- 172.21.15.193:0/3035490728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 msgr2=0x561372707120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 --2- 172.21.15.193:0/3035490728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1194050200 tx=0x7f119401f390 comp rx=0 tx=0).stop 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- 172.21.15.193:0/3035490728 shutdown_connections 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 --2- 172.21.15.193:0/3035490728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x561372707120 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- 172.21.15.193:0/3035490728 >> 172.21.15.193:0/3035490728 conn(0x561372702140 msgr2=0x561372700380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- 172.21.15.193:0/3035490728 shutdown_connections 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- 172.21.15.193:0/3035490728 wait complete. 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 Processor -- start 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- start start 2024-09-12T17:11:32.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119c2959c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561372705c70 con 0x561372706d20 2024-09-12T17:11:32.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53214/0 (socket says 172.21.15.193:53214) 2024-09-12T17:11:32.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.519+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 learned_addr learned my addr 172.21.15.193:0/1133988796 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137270d7e0 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119959a640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1194022040 tx=0x7f1194050190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 -- 172.21.15.193:0/1133988796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1194043040 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 -- 172.21.15.193:0/1133988796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1194013e20 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56137270da70 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 -- 172.21.15.193:0/1133988796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119401f680 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56137270e420 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 -- 172.21.15.193:0/1133988796 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1194013640 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1064039a70 0x7f106403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f106b7fe640 1 -- 172.21.15.193:0/1133988796 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f1194032c30 con 0x561372706d20 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119a59c640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1064039a70 0x7f106403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561372718710 0x56137271aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271b2f0 con 0x561372718710 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f1199d9b640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561372718710 0x56137271aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119a59c640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1064039a70 0x7f106403bf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f118c00f010 tx=0x7f118c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f1199d9b640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561372718710 0x56137271aba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 realm 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271b700 con 0x561372718710 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.523+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271bfd0 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271c370 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271bc20 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 20 searching for the correct realm 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56137271e790 0x561372720b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119959a640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56137271e790 0x561372720b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119959a640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56137271e790 0x561372720b80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119959a640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f119403f050 0x7f1194003460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119a59c640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f119403f050 0x7f1194003460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119a59c640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f119403f050 0x7f1194003460 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119a59c640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f118c019040 0x7f118c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f1199d9b640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f118c019040 0x7f118c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.527+0000 7f1199d9b640 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f118c019040 0x7f118c019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.531+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.535+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x56137271e790 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f118c019040 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x561372718710 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613727211b0 con 0x7f119403f050 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:32.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271d230 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.539+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271dad0 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137271ce70 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:32.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 zone default found 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 4 Realm: () 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 zonegroup default 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372721ae0 con 0x7f118c019040 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613727235d0 con 0x56137271e790 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372723a90 con 0x56137271e790 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 started sync module instance, tier type = 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372722960 con 0x7f119403f050 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94641524452688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372724380 con 0x7f119403f050 2024-09-12T17:11:32.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.543+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372724bd0 con 0x561372718710 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94641524452688] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94641524457168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372724820 con 0x561372718710 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372725310 con 0x56137271e790 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94641524457168] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94641524461024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372725700 con 0x56137271e790 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.547+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727260c0 con 0x7f119403f050 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94641524464928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727267b0 con 0x7f119403f050 2024-09-12T17:11:32.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727272d0 con 0x561372718710 2024-09-12T17:11:32.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94641524461024] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94641524464928] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94641524469152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372727290 con 0x561372718710 2024-09-12T17:11:32.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.551+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727276c0 con 0x7f118c019040 2024-09-12T17:11:32.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94641524469152] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94641524458224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372727670 con 0x7f118c019040 2024-09-12T17:11:32.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727280d0 con 0x7f118c019040 2024-09-12T17:11:32.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94641524458224] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.555+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94641524466176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613727280d0 con 0x7f118c019040 2024-09-12T17:11:32.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728a90 con 0x7f118c019040 2024-09-12T17:11:32.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94641524466176] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94641524473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728a90 con 0x7f118c019040 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=0 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=1 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=2 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=3 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=4 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=5 2024-09-12T17:11:32.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f119c2959c0 20 add_watcher() i=6 2024-09-12T17:11:32.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.559+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94641524473136] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 add_watcher() i=7 2024-09-12T17:11:32.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:32.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137272bd90 con 0x561372718710 2024-09-12T17:11:32.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94641524475728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372729020 con 0x561372718710 2024-09-12T17:11:32.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94641524475728] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f104b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:32.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:32.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 5 note: GC not initialized 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f104a7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 Filter name: none 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f0fbbfff640 20 reqs_thread_entry: start 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137274f140 con 0x7f119403f050 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137274f9d0 con 0x56137271e790 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.563+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372751030 con 0x7f119403f050 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372751030 con 0x56137271e790 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(65 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 4.3f 4:fd0a111d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372750780 con 0x7f119403f050 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 4.16 4:69bce75d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372755980 con 0x56137271e790 2024-09-12T17:11:32.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 4.1d 4:b875d38d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613727581f0 con 0x56137271e790 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 4.10 4:0a81f2b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137275ab40 con 0x56137271e790 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 4.7 4:e0a76df3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137275d570 con 0x7f118c019040 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 4.2c 4:37088d08:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137275ff50 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 4.32 4:4c13f82f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372762920 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 4.1c 4:386218bb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372765330 con 0x7f118c019040 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 4.38 4:1f0a6c2d:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561372767dc0 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 4.36 4:6d69afdc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137276ac50 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:76 4.15 4:a8462aa2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56137276db10 con 0x56137271e790 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(71 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.5 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(70 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(74 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.8 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(68 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(69 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(76 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(75 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f104b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.567+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94641524475728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372765330 con 0x561372718710 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94641524475728] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94641524452688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728750 con 0x7f119403f050 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94641524452688] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f119c2959c0 20 remove_watcher() i=0 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f119c2959c0 2 removed watcher, disabling cache 2024-09-12T17:11:32.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.571+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94641524457168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728750 con 0x561372718710 2024-09-12T17:11:32.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94641524457168] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 20 remove_watcher() i=1 2024-09-12T17:11:32.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94641524461024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372723ed0 con 0x56137271e790 2024-09-12T17:11:32.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119959a640 1 -- 172.21.15.193:0/1133988796 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94641524461024] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1194037020 con 0x56137271e790 2024-09-12T17:11:32.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 20 remove_watcher() i=2 2024-09-12T17:11:32.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94641524464928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728750 con 0x7f119403f050 2024-09-12T17:11:32.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119a59c640 1 -- 172.21.15.193:0/1133988796 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94641524464928] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f118c02f040 con 0x7f119403f050 2024-09-12T17:11:32.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 20 remove_watcher() i=3 2024-09-12T17:11:32.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.575+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94641524469152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372723ed0 con 0x561372718710 2024-09-12T17:11:32.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94641524469152] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x561372718710 2024-09-12T17:11:32.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f119c2959c0 20 remove_watcher() i=4 2024-09-12T17:11:32.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94641524458224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372725d20 con 0x7f118c019040 2024-09-12T17:11:32.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94641524458224] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f119c2959c0 20 remove_watcher() i=5 2024-09-12T17:11:32.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.579+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94641524466176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372728750 con 0x7f118c019040 2024-09-12T17:11:32.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94641524466176] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 20 remove_watcher() i=6 2024-09-12T17:11:32.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94641524473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561372725d20 con 0x7f118c019040 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94641524473136] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11840bd910 con 0x7f118c019040 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 20 remove_watcher() i=7 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f118c019040 msgr2=0x7f118c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f118c019040 0x7f118c019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561372718710 msgr2=0x56137271aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x561372718710 0x56137271aba0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f119403f050 msgr2=0x7f1194003460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f119403f050 0x7f1194003460 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56137271e790 msgr2=0x561372720b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56137271e790 0x561372720b80 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1064039a70 msgr2=0x7f106403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1064039a70 0x7f106403bf30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f118c00f010 tx=0x7f118c01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f1199d9b640 1 -- 172.21.15.193:0/1133988796 reap_dead start 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 msgr2=0x56137270d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.583+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1194022040 tx=0x7f1194050190 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 shutdown_connections 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1133988796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561372706d20 0x56137270d280 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 >> 172.21.15.193:0/1133988796 conn(0x561372702140 msgr2=0x561372700350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 shutdown_connections 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1133988796 wait complete. 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 msgr2=0x7f107403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 0x7f107403bf80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f118c00e3f0 tx=0x7f118c003070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 msgr2=0x5613726f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1194006390 tx=0x7f1194015820 comp rx=0 tx=0).stop 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 shutdown_connections 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1074039ac0 0x7f107403bf80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/1011579762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613726f93d0 0x5613726f97f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 >> 172.21.15.193:0/1011579762 conn(0x5613726eed80 msgr2=0x5613726ef160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 shutdown_connections 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/1011579762 wait complete. 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 msgr2=0x5613726e8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 0x5613726e8de0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 msgr2=0x7f108003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 0x7f108003bf80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1194000f90 tx=0x7f1194006550 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 msgr2=0x5613726e1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1184096f40 tx=0x7f11840180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 shutdown_connections 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5613725f2040 0x5613726e8de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1080039ac0 0x7f108003bf80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 --2- 172.21.15.193:0/2569935416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5613725ef710 0x5613726e1c70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 >> 172.21.15.193:0/2569935416 conn(0x561372562aa0 msgr2=0x5613726d4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 shutdown_connections 2024-09-12T17:11:32.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.587+0000 7f119c2959c0 1 -- 172.21.15.193:0/2569935416 wait complete. 2024-09-12T17:11:32.601 INFO:teuthology.orchestra.run.smithi193.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"8d996106-34ba-42aa-8283-014f90bfb7e7","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","marker":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-12T17:11:31.829882Z","creation_time":"2024-09-12T17:11:27.903968Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-12T17:11:32.602 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:11:31.829882Z', 'creation_time': '2024-09-12T17:11:27.903968Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-12T17:11:32.602 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-12T17:11:32.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-12T17:11:32.602 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-12T17:11:32.679 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:32.680 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839d7c09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564fee3ea210 0x564fee47afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839d7c09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fee32a9c0 con 0x564fee3ea5f0 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839d7c09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x564fee37a6d0 con 0x564fee3ea210 2024-09-12T17:11:32.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839b2c6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564fee3ea210 0x564fee47afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839b2c6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x564fee3ea210 0x564fee47afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53218/0 (socket says 172.21.15.193:53218) 2024-09-12T17:11:32.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839b2c6640 1 -- 172.21.15.193:0/746049513 learned_addr learned my addr 172.21.15.193:0/746049513 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.675+0000 7f839aac5640 1 --1- 172.21.15.193:0/746049513 >> v1:172.21.15.62:6789/0 conn(0x564fee3ea5f0 0x564fee47d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36794/0 (socket says 172.21.15.193:36794) 2024-09-12T17:11:32.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839b2c6640 1 -- 172.21.15.193:0/746049513 >> v1:172.21.15.62:6789/0 conn(0x564fee3ea5f0 legacy=0x564fee47d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839b2c6640 1 -- 172.21.15.193:0/746049513 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee31eca0 con 0x564fee3ea210 2024-09-12T17:11:32.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839b2c6640 1 --2- 172.21.15.193:0/746049513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee47afc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f838c00a4e0 tx=0x7f838c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8c54556db989d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839a2c4640 1 -- 172.21.15.193:0/746049513 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0aa540 con 0x564fee3ea210 2024-09-12T17:11:32.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839a2c4640 1 -- 172.21.15.193:0/746049513 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0aa6e0 con 0x564fee3ea210 2024-09-12T17:11:32.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839a2c4640 1 -- 172.21.15.193:0/746049513 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0aaa40 con 0x564fee3ea210 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 -- 172.21.15.193:0/746049513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 msgr2=0x564fee47afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/746049513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee47afc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f838c00a4e0 tx=0x7f838c01b090 comp rx=0 tx=0).stop 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 -- 172.21.15.193:0/746049513 shutdown_connections 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/746049513 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee47afc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 -- 172.21.15.193:0/746049513 >> 172.21.15.193:0/746049513 conn(0x564fee4708f0 msgr2=0x564fee472d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 -- 172.21.15.193:0/746049513 shutdown_connections 2024-09-12T17:11:32.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.679+0000 7f839d7c09c0 1 -- 172.21.15.193:0/746049513 wait complete. 2024-09-12T17:11:32.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.695+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.695+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.695+0000 7f839d7c09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.695+0000 7f839d7c09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564fee37e680 con 0x564fee3ea210 2024-09-12T17:11:32.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53232/0 (socket says 172.21.15.193:53232) 2024-09-12T17:11:32.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 -- 172.21.15.193:0/2335945556 learned_addr learned my addr 172.21.15.193:0/2335945556 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 -- 172.21.15.193:0/2335945556 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee2f9da0 con 0x564fee3ea210 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 --2- 172.21.15.193:0/2335945556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ac040 tx=0x7f838c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66d37ad3f12fb08 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f828960a640 1 -- 172.21.15.193:0/2335945556 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b9030 con 0x564fee3ea210 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f828960a640 1 -- 172.21.15.193:0/2335945556 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0aaa40 con 0x564fee3ea210 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f828960a640 1 -- 172.21.15.193:0/2335945556 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0aad20 con 0x564fee3ea210 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- 172.21.15.193:0/2335945556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 msgr2=0x564fee563850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/2335945556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f838c0ac040 tx=0x7f838c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- 172.21.15.193:0/2335945556 shutdown_connections 2024-09-12T17:11:32.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/2335945556 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee563850 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- 172.21.15.193:0/2335945556 >> 172.21.15.193:0/2335945556 conn(0x564fee4708f0 msgr2=0x564fee55f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- 172.21.15.193:0/2335945556 shutdown_connections 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- 172.21.15.193:0/2335945556 wait complete. 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839d7c09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564fee320a50 con 0x564fee3ea210 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53242/0 (socket says 172.21.15.193:53242) 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.699+0000 7f839b2c6640 1 -- 172.21.15.193:0/1339697088 learned_addr learned my addr 172.21.15.193:0/1339697088 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839b2c6640 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee56b360 con 0x564fee3ea210 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839b2c6640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f838c003430 tx=0x7f838c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 -- 172.21.15.193:0/1339697088 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b9070 con 0x564fee3ea210 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 -- 172.21.15.193:0/1339697088 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c0c2070 con 0x564fee3ea210 2024-09-12T17:11:32.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 -- 172.21.15.193:0/1339697088 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838c0b5ca0 con 0x564fee3ea210 2024-09-12T17:11:32.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fee56b5f0 con 0x564fee3ea210 2024-09-12T17:11:32.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fee56bfa0 con 0x564fee3ea210 2024-09-12T17:11:32.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 -- 172.21.15.193:0/1339697088 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f838c0b3040 con 0x564fee3ea210 2024-09-12T17:11:32.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 0x7f828003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f8287e07640 1 -- 172.21.15.193:0/1339697088 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f838c0ba070 con 0x564fee3ea210 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839aac5640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 0x7f828003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 0x564fee571f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5724b0 con 0x564fee3ea5f0 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839bac7640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 0x564fee571f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839aac5640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 0x7f828003bf80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8384001e90 tx=0x7f83840013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839bac7640 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 0x564fee571f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839bac7640 1 -- 172.21.15.193:0/1339697088 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83940083f0 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee572920 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839bac7640 1 -- 172.21.15.193:0/1339697088 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83940083f0 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.703+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee574220 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839bac7640 1 -- 172.21.15.193:0/1339697088 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83940083f0 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee573450 con 0x564fee3ea5f0 2024-09-12T17:11:32.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839bac7640 1 -- 172.21.15.193:0/1339697088 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83940083f0 con 0x564fee3ea5f0 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5738a0 con 0x564fee3ea5f0 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839bac7640 1 -- 172.21.15.193:0/1339697088 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83940083f0 con 0x564fee3ea5f0 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564fee38b450 con 0x564fee582520 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53246/0 (socket says 172.21.15.193:53246) 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839aac5640 1 -- 172.21.15.193:0/667388832 learned_addr learned my addr 172.21.15.193:0/667388832 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839aac5640 1 -- 172.21.15.193:0/667388832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee582f80 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839aac5640 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f838400e670 tx=0x7f838400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f8285602640 1 -- 172.21.15.193:0/667388832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384022070 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fee5837e0 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f8285602640 1 -- 172.21.15.193:0/667388832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838400d660 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fee583d50 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.707+0000 7f8285602640 1 -- 172.21.15.193:0/667388832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384006070 con 0x564fee582520 2024-09-12T17:11:32.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f8285602640 1 -- 172.21.15.193:0/667388832 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8384025070 con 0x564fee582520 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f8285602640 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 0x7f827403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f8285602640 1 -- 172.21.15.193:0/667388832 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8384051c20 con 0x564fee582520 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839bac7640 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 0x7f827403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839bac7640 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 0x7f827403bf20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f839400e3f0 tx=0x7f8394003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839d7c09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839d7c09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564fee563fe0 con 0x564fee58fe90 2024-09-12T17:11:32.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53252/0 (socket says 172.21.15.193:53252) 2024-09-12T17:11:32.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839aac5640 1 -- 172.21.15.193:0/1882642398 learned_addr learned my addr 172.21.15.193:0/1882642398 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839aac5640 1 -- 172.21.15.193:0/1882642398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee590880 con 0x564fee58fe90 2024-09-12T17:11:32.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f839aac5640 1 --2- 172.21.15.193:0/1882642398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f838400be20 tx=0x7f8384024980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb839e590e161e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f827effd640 1 -- 172.21.15.193:0/1882642398 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838400d940 con 0x564fee58fe90 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f827effd640 1 -- 172.21.15.193:0/1882642398 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83840263b0 con 0x564fee58fe90 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.711+0000 7f827effd640 1 -- 172.21.15.193:0/1882642398 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f838400dcc0 con 0x564fee58fe90 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1882642398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 msgr2=0x564fee590290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1882642398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f838400be20 tx=0x7f8384024980 comp rx=0 tx=0).stop 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1882642398 shutdown_connections 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1882642398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee590290 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1882642398 >> 172.21.15.193:0/1882642398 conn(0x564fee58b2b0 msgr2=0x564fee5894f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1882642398 shutdown_connections 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1882642398 wait complete. 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 Processor -- start 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- start start 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee5963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839d7c09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x564fee58ede0 con 0x564fee58fe90 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee5963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839aac5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee5963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53254/0 (socket says 172.21.15.193:53254) 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 learned_addr learned my addr 172.21.15.193:0/3625190585 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fee596930 con 0x564fee58fe90 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.715+0000 7f839aac5640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee5963d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f838400be20 tx=0x7f838404ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 -- 172.21.15.193:0/3625190585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384043030 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 -- 172.21.15.193:0/3625190585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838400dcc0 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 -- 172.21.15.193:0/3625190585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8384025c40 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fee596bc0 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fee596bc0 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 -- 172.21.15.193:0/3625190585 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8384049040 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8264039ac0 0x7f826403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.719+0000 7f827d7fa640 1 -- 172.21.15.193:0/3625190585 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f8384036ce0 con 0x564fee58fe90 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839bac7640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8264039ac0 0x7f826403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee5a1500 0x564fee5a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a40a0 con 0x564fee5a1500 2024-09-12T17:11:32.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee5a1500 0x564fee5a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee5a1500 0x564fee5a3950 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839bac7640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8264039ac0 0x7f826403bf80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f839400f010 tx=0x7f839401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 realm 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a44b0 con 0x564fee5a1500 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:32.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a4d80 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5120 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a55c0 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 20 searching for the correct realm 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x564fee5a7530 0x564fee5a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839aac5640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x564fee5a7530 0x564fee5a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839aac5640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x564fee5a7530 0x564fee5a9920 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839aac5640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8384027060 0x7f8384029080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8384027060 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839bac7640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8384027060 0x7f8384029080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.723+0000 7f839bac7640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8384027060 0x7f8384029080 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839bac7640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8394019040 0x7f8394019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8394019040 0x7f8394019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8394019040 0x7f8394019930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8384027060 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.727+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8384027060 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.731+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8384027060 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a1500 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8384027060 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x564fee5a7530 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.735+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a9fa0 con 0x7f8394019040 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f838c0fc040 con 0x564fee5a1500 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f838c0fc040 con 0x7f8384027060 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x564fee5a1500 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a6290 con 0x564fee5a1500 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a6290 con 0x564fee5a1500 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 zone default found 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 4 Realm: () 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 zonegroup default 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a66b0 con 0x7f8394019040 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a66b0 con 0x564fee5a7530 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5abdf0 con 0x564fee5a7530 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 started sync module instance, tier type = 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:32.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.739+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94901301327488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ac640 con 0x7f8384027060 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ace90 con 0x564fee5a1500 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94901301327488] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94901301330320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5acae0 con 0x564fee5a1500 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.743+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ad600 con 0x564fee5a7530 2024-09-12T17:11:32.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94901301330320] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94901301334224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ad9f0 con 0x564fee5a7530 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ae3b0 con 0x7f8384027060 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94901301338128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5aeaa0 con 0x7f8384027060 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.747+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5af5a0 con 0x564fee5a1500 2024-09-12T17:11:32.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94901301334224] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94901301338128] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94901301342352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5af560 con 0x564fee5a1500 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5af9c0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94901301342352] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94901301331376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5af970 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.751+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b03d0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.755+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94901301331376] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.755+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.755+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94901301339376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b03d0 con 0x7f8394019040 2024-09-12T17:11:32.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.755+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0d90 con 0x7f8394019040 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.755+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94901301339376] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94901301346352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0d90 con 0x7f8394019040 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=0 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=1 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=2 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=3 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=4 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=5 2024-09-12T17:11:32.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=6 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94901301346352] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 20 add_watcher() i=7 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b4080 con 0x564fee5a1500 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94901301348944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b1320 con 0x564fee5a1500 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.759+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94901301348944] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f838c0beca0 con 0x564fee5a1500 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f8251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 5 note: GC not initialized 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f8250fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 20 Filter name: none 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f81ca7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5d6a60 con 0x7f8394019040 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x7f8394019040 2024-09-12T17:11:32.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x564fee5a7530 2024-09-12T17:11:32.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x7f8394019040 2024-09-12T17:11:32.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f838c0beca0 con 0x7f8394019040 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.763+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x564fee5a1500 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5a5ea0 con 0x7f8384027060 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a1500 2024-09-12T17:11:32.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.767+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a1500 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a1500 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a1500 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8394019040 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'44 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.771+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8394019040 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x564fee5a1500 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8384027060 2024-09-12T17:11:32.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ab290 con 0x7f8394019040 2024-09-12T17:11:32.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.775+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.782 INFO:teuthology.orchestra.run.smithi193.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-12T17:11:32.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f8251fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94901301348944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5d63c0 con 0x564fee5a1500 2024-09-12T17:11:32.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94901301348944] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94901301327488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0a50 con 0x7f8384027060 2024-09-12T17:11:32.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94901301327488] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839d7c09c0 20 remove_watcher() i=0 2024-09-12T17:11:32.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839d7c09c0 2 removed watcher, disabling cache 2024-09-12T17:11:32.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.779+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94901301330320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0a50 con 0x564fee5a1500 2024-09-12T17:11:32.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.783+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94901301330320] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.783+0000 7f839d7c09c0 20 remove_watcher() i=1 2024-09-12T17:11:32.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.783+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94901301334224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ac190 con 0x564fee5a7530 2024-09-12T17:11:32.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839aac5640 1 -- 172.21.15.193:0/3625190585 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94901301334224] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8384024030 con 0x564fee5a7530 2024-09-12T17:11:32.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 20 remove_watcher() i=2 2024-09-12T17:11:32.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94901301338128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0a50 con 0x7f8384027060 2024-09-12T17:11:32.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839bac7640 1 -- 172.21.15.193:0/3625190585 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94901301338128] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f839402f040 con 0x7f8384027060 2024-09-12T17:11:32.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 20 remove_watcher() i=3 2024-09-12T17:11:32.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94901301342352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ae010 con 0x564fee5a1500 2024-09-12T17:11:32.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94901301342352] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c109160 con 0x564fee5a1500 2024-09-12T17:11:32.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 20 remove_watcher() i=4 2024-09-12T17:11:32.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.787+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94901301331376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0a50 con 0x7f8394019040 2024-09-12T17:11:32.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.791+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94901301331376] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.791+0000 7f839d7c09c0 20 remove_watcher() i=5 2024-09-12T17:11:32.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.791+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94901301339376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5ae010 con 0x7f8394019040 2024-09-12T17:11:32.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94901301339376] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 20 remove_watcher() i=6 2024-09-12T17:11:32.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94901301346352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fee5b0a50 con 0x7f8394019040 2024-09-12T17:11:32.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94901301346352] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f838c109160 con 0x7f8394019040 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 20 remove_watcher() i=7 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8394019040 msgr2=0x7f8394019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8394019040 0x7f8394019930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee5a1500 msgr2=0x564fee5a3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee5a1500 0x564fee5a3950 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8384027060 msgr2=0x7f8384029080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8384027060 0x7f8384029080 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x564fee5a7530 msgr2=0x564fee5a9920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x564fee5a7530 0x564fee5a9920 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8264039ac0 msgr2=0x7f826403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8264039ac0 0x7f826403bf80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f839400f010 tx=0x7f839401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 msgr2=0x564fee5963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/3625190585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee58fe90 0x564fee5963d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f838400be20 tx=0x7f838404ff00 comp rx=0 tx=0).stop 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 reap_dead start 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839b2c6640 1 -- 172.21.15.193:0/3625190585 reap_dead start 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 shutdown_connections 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 >> 172.21.15.193:0/3625190585 conn(0x564fee58b2b0 msgr2=0x564fee5894c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 shutdown_connections 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/3625190585 wait complete. 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 msgr2=0x7f827403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 0x7f827403bf20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f839400e3f0 tx=0x7f8394003070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 msgr2=0x564fee582940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f838400e670 tx=0x7f838400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 shutdown_connections 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8274039a60 0x7f827403bf20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/667388832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee582520 0x564fee582940 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 >> 172.21.15.193:0/667388832 conn(0x564fee577ed0 msgr2=0x564fee5782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 shutdown_connections 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/667388832 wait complete. 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 msgr2=0x564fee571f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 0x564fee571f70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 msgr2=0x7f828003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 0x7f828003bf80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8384001e90 tx=0x7f83840013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 msgr2=0x564fee56ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f838c003430 tx=0x7f838c017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 shutdown_connections 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x564fee3ea5f0 0x564fee571f70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8280039ac0 0x7f828003bf80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 --2- 172.21.15.193:0/1339697088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x564fee3ea210 0x564fee56ae00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 >> 172.21.15.193:0/1339697088 conn(0x564fee4708f0 msgr2=0x564fee55df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 shutdown_connections 2024-09-12T17:11:32.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.795+0000 7f839d7c09c0 1 -- 172.21.15.193:0/1339697088 wait complete. 2024-09-12T17:11:32.813 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-12T17:11:32.813 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-12T17:11:32.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-12T17:11:32.813 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-12T17:11:32.885 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:32.885 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:32.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5c3989c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55989c3d8200 0x55989c3d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5c3989c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55989c28a9c0 con 0x55989c3db340 2024-09-12T17:11:32.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5c3989c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55989c2da6d0 con 0x55989c3d8200 2024-09-12T17:11:32.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f59e9e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55989c3d8200 0x55989c3d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5969d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55989c3db340 0x55989c3dd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36804/0 (socket says 172.21.15.193:36804) 2024-09-12T17:11:32.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f5969d640 1 -- 172.21.15.193:0/1843612022 learned_addr learned my addr 172.21.15.193:0/1843612022 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:32.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f59e9e640 1 -- 172.21.15.193:0/1843612022 >> v1:172.21.15.62:6789/0 conn(0x55989c3db340 legacy=0x55989c3dd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.883+0000 7f0f59e9e640 1 -- 172.21.15.193:0/1843612022 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c27eca0 con 0x55989c3d8200 2024-09-12T17:11:32.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/1843612022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3d8200 0x55989c3d85e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a420 tx=0x7f0f4c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0f606306c847d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f58e9c640 1 -- 172.21.15.193:0/1843612022 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0af070 con 0x55989c3d8200 2024-09-12T17:11:32.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f58e9c640 1 -- 172.21.15.193:0/1843612022 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0aa530 con 0x55989c3d8200 2024-09-12T17:11:32.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f58e9c640 1 -- 172.21.15.193:0/1843612022 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0aa850 con 0x55989c3d8200 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/1843612022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3d8200 msgr2=0x55989c3d85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/1843612022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3d8200 0x55989c3d85e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00a420 tx=0x7f0f4c01afd0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/1843612022 shutdown_connections 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/1843612022 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3d8200 0x55989c3d85e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/1843612022 >> 172.21.15.193:0/1843612022 conn(0x55989c34bb10 msgr2=0x55989c34bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/1843612022 shutdown_connections 2024-09-12T17:11:32.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.887+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/1843612022 wait complete. 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55989c2de680 con 0x55989c3db340 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f59e9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f59e9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53268/0 (socket says 172.21.15.193:53268) 2024-09-12T17:11:32.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f59e9e640 1 -- 172.21.15.193:0/708440829 learned_addr learned my addr 172.21.15.193:0/708440829 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f59e9e640 1 -- 172.21.15.193:0/708440829 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c259da0 con 0x55989c3db340 2024-09-12T17:11:32.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/708440829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0ad040 tx=0x7f0f4c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cf3482e9c490f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0e47e07640 1 -- 172.21.15.193:0/708440829 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0af040 con 0x55989c3db340 2024-09-12T17:11:32.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0e47e07640 1 -- 172.21.15.193:0/708440829 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0bb070 con 0x55989c3db340 2024-09-12T17:11:32.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0e47e07640 1 -- 172.21.15.193:0/708440829 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0aab70 con 0x55989c3db340 2024-09-12T17:11:32.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/708440829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 msgr2=0x55989c4c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/708440829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0ad040 tx=0x7f0f4c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/708440829 shutdown_connections 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/708440829 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4c39d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/708440829 >> 172.21.15.193:0/708440829 conn(0x55989c34bb10 msgr2=0x55989c4bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/708440829 shutdown_connections 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.903+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/708440829 wait complete. 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55989c280a50 con 0x55989c3db340 2024-09-12T17:11:32.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f59e9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f59e9e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53280/0 (socket says 172.21.15.193:53280) 2024-09-12T17:11:32.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f59e9e640 1 -- 172.21.15.193:0/112127731 learned_addr learned my addr 172.21.15.193:0/112127731 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f59e9e640 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c4cb490 con 0x55989c3db340 2024-09-12T17:11:32.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01b870 tx=0x7f0f4c017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 -- 172.21.15.193:0/112127731 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0b5680 con 0x55989c3db340 2024-09-12T17:11:32.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 -- 172.21.15.193:0/112127731 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0bb040 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989c4cb720 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 -- 172.21.15.193:0/112127731 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4c0b5990 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989c4cc080 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 -- 172.21.15.193:0/112127731 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0f4c0c8020 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 0x7f0e4003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0e46604640 1 -- 172.21.15.193:0/112127731 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0f4c0eb1a0 con 0x55989c3db340 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5969d640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 0x7f0e4003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 0x55989c4d2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.907+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c4d2970 con 0x55989c4d0040 2024-09-12T17:11:32.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 0x55989c4d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5969d640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 0x7f0e4003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001d80 tx=0x7f0f440012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 0x55989c4d2430 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 -- 172.21.15.193:0/112127731 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f540083f0 con 0x55989c4d0040 2024-09-12T17:11:32.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c4d2d10 con 0x55989c4d0040 2024-09-12T17:11:32.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 -- 172.21.15.193:0/112127731 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f540083f0 con 0x55989c4d0040 2024-09-12T17:11:32.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c4d45e0 con 0x55989c4d0040 2024-09-12T17:11:32.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 -- 172.21.15.193:0/112127731 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f540083f0 con 0x55989c4d0040 2024-09-12T17:11:32.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c4d3810 con 0x55989c4d0040 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 -- 172.21.15.193:0/112127731 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f540083f0 con 0x55989c4d0040 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c4d3c30 con 0x55989c4d0040 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5a69f640 1 -- 172.21.15.193:0/112127731 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f540083f0 con 0x55989c4d0040 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5c3989c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55989c2eb450 con 0x55989c4e2960 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53292/0 (socket says 172.21.15.193:53292) 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.911+0000 7f0f5969d640 1 -- 172.21.15.193:0/3623362639 learned_addr learned my addr 172.21.15.193:0/3623362639 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5969d640 1 -- 172.21.15.193:0/3623362639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c4e33c0 con 0x55989c4e2960 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5969d640 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400d660 tx=0x7f0f4400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 -- 172.21.15.193:0/3623362639 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4400c6b0 con 0x55989c4e2960 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989c4e3c20 con 0x55989c4e2960 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 -- 172.21.15.193:0/3623362639 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400c850 con 0x55989c4e2960 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 -- 172.21.15.193:0/3623362639 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4400cb30 con 0x55989c4e2960 2024-09-12T17:11:32.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989c4e4190 con 0x55989c4e2960 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 -- 172.21.15.193:0/3623362639 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0f44023020 con 0x55989c4e2960 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 0x7f0e3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0e3f7fe640 1 -- 172.21.15.193:0/3623362639 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0f44021020 con 0x55989c4e2960 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 0x7f0e3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 0x7f0e3403bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55989c4d3bb0 tx=0x7f0f54003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5c3989c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55989c4c4160 con 0x55989c4f0330 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53294/0 (socket says 172.21.15.193:53294) 2024-09-12T17:11:32.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.915+0000 7f0f5969d640 1 -- 172.21.15.193:0/2681390141 learned_addr learned my addr 172.21.15.193:0/2681390141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 -- 172.21.15.193:0/2681390141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c4f0d20 con 0x55989c4f0330 2024-09-12T17:11:32.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 --2- 172.21.15.193:0/2681390141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0f44050f10 tx=0x7f0f44023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20736c10f1aa52da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0e3d7fa640 1 -- 172.21.15.193:0/2681390141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44047070 con 0x55989c4f0330 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0e3d7fa640 1 -- 172.21.15.193:0/2681390141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400cd20 con 0x55989c4f0330 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0e3d7fa640 1 -- 172.21.15.193:0/2681390141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f4401bcc0 con 0x55989c4f0330 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/2681390141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 msgr2=0x55989c4f0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/2681390141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0f44050f10 tx=0x7f0f44023420 comp rx=0 tx=0).stop 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/2681390141 shutdown_connections 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/2681390141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f0730 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/2681390141 >> 172.21.15.193:0/2681390141 conn(0x55989c4eb750 msgr2=0x55989c4e9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/2681390141 shutdown_connections 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/2681390141 wait complete. 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 Processor -- start 2024-09-12T17:11:32.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- start start 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5c3989c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55989c4ef280 con 0x55989c4f0330 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53304/0 (socket says 172.21.15.193:53304) 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 learned_addr learned my addr 172.21.15.193:0/711258236 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989c4f6e00 con 0x55989c4f0330 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0f5969d640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0f4404fdb0 tx=0x7f0f44050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.919+0000 7f0e2b7fe640 1 -- 172.21.15.193:0/711258236 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44032030 con 0x55989c4f0330 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989c4f7090 con 0x55989c4f0330 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0e2b7fe640 1 -- 172.21.15.193:0/711258236 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44048040 con 0x55989c4f0330 2024-09-12T17:11:32.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0e2b7fe640 1 -- 172.21.15.193:0/711258236 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f44047070 con 0x55989c4f0330 2024-09-12T17:11:32.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989c4f7090 con 0x55989c4f0330 2024-09-12T17:11:32.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0e2b7fe640 1 -- 172.21.15.193:0/711258236 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0f44035030 con 0x55989c4f0330 2024-09-12T17:11:32.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0e2b7fe640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e24039a70 0x7f0e2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0e2b7fe640 1 -- 172.21.15.193:0/711258236 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7f0f44033070 con 0x55989c4f0330 2024-09-12T17:11:32.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e24039a70 0x7f0e2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c5019d0 0x55989c503e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c5045b0 con 0x55989c5019d0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c5019d0 0x55989c503e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e24039a70 0x7f0e2403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400f010 tx=0x7f0f5401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c5019d0 0x55989c503e60 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 realm 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c5049c0 con 0x55989c5019d0 2024-09-12T17:11:32.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505290 con 0x55989c5019d0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505e80 con 0x55989c5019d0 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.923+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5c3989c0 20 searching for the correct realm 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55989c507570 0x55989c509a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c50a090 con 0x55989c507570 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5969d640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55989c507570 0x55989c509a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5969d640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55989c507570 0x55989c509a10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5969d640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0f44050480 0x7f0f44050900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c50a090 con 0x7f0f44050480 2024-09-12T17:11:32.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0f44050480 0x7f0f44050900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0f44050480 0x7f0f44050900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5a69f640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0f54019040 0x7f0f54019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c50a090 con 0x7f0f54019040 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0f54019040 0x7f0f54019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:32.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0f54019040 0x7f0f54019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.927+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f44050480 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f44050480 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.931+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f44050480 2024-09-12T17:11:32.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.935+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f44050480 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c507570 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x7f0f54019040 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0f4c0fd040 con 0x55989c5019d0 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0f4c0fd040 con 0x7f0f44050480 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:32.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505630 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505a00 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.939+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c505a10 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 zone default found 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 4 Realm: () 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 zonegroup default 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c506b40 con 0x7f0f54019040 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c50bf00 con 0x55989c507570 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c50c2a0 con 0x55989c507570 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 started sync module instance, tier type = 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50b3a0 con 0x7f0f44050480 2024-09-12T17:11:32.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94113945925520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50b000 con 0x7f0f44050480 2024-09-12T17:11:32.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.943+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50cfa0 con 0x55989c5019d0 2024-09-12T17:11:32.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.947+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94113945925520] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.947+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.947+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94113945929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50cf10 con 0x55989c5019d0 2024-09-12T17:11:32.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.947+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50d9b0 con 0x55989c507570 2024-09-12T17:11:32.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94113945929280] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94113945930336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50ce80 con 0x55989c507570 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50e700 con 0x7f0f44050480 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94113945936736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50ee30 con 0x7f0f44050480 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50f950 con 0x55989c5019d0 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94113945930336] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94113945936736] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94113945941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50f910 con 0x55989c5019d0 2024-09-12T17:11:32.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.951+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5101f0 con 0x7f0f54019040 2024-09-12T17:11:32.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.955+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94113945941024] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.955+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.955+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94113945935264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50fdc0 con 0x7f0f54019040 2024-09-12T17:11:32.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.955+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c510690 con 0x7f0f54019040 2024-09-12T17:11:32.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94113945943488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c510d20 con 0x7f0f54019040 2024-09-12T17:11:32.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5115d0 con 0x7f0f54019040 2024-09-12T17:11:32.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94113945935264] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94113945943488] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94113945942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c510d20 con 0x7f0f54019040 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=0 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=1 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=2 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=3 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=4 2024-09-12T17:11:32.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=5 2024-09-12T17:11:32.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.959+0000 7f0f5c3989c0 20 add_watcher() i=6 2024-09-12T17:11:32.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94113945942288] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 add_watcher() i=7 2024-09-12T17:11:32.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:32.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c5146d0 con 0x55989c5019d0 2024-09-12T17:11:32.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94113945946224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c511b50 con 0x55989c5019d0 2024-09-12T17:11:32.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94113945946224] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0e0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 5 note: GC not initialized 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0e0a7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 Filter name: none 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0d7bfff640 20 reqs_thread_entry: start 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c5376f0 con 0x55989c5019d0 2024-09-12T17:11:32.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.963+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c53a180 con 0x7f0f44050480 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 20 disabling bucket name=myfoo 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c538160 con 0x7f0f44050480 2024-09-12T17:11:32.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c53aaf0 con 0x55989c507570 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(65 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:32.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:32.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:32.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:32.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:32.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c542380 con 0x55989c507570 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.967+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94113946120624 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c541140 con 0x55989c5019d0 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== watch-notify(notify (1) cookie 94113945929280 notify 137438953497 ret 0) ==== 802+0+0 (crc 0 0 0) 0x7f0f4c0e8040 con 0x55989c5019d0 2024-09-12T17:11:32.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94113945929280 notifier 4594 bl.length()=760 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3d7fa640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e1c003eb0 con 0x55989c5019d0 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(67 notify.1 [notify cookie 94113946120624 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify_complete (2) cookie 94113946120624 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55989c4cc080 con 0x55989c5019d0 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:32.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c53b190 con 0x55989c5019d0 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94113946111552 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55989c539260 con 0x55989c5019d0 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify (1) cookie 94113945941024 notify 137438953498 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55989c4cc080 con 0x55989c5019d0 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94113945941024 notifier 4594 bl.length()=567 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:32.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0e3cff9640 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d84003440 con 0x55989c5019d0 2024-09-12T17:11:32.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(70 notify.4 [notify cookie 94113946111552 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== watch-notify(notify_complete (2) cookie 94113946111552 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55989c4cb720 con 0x55989c5019d0 2024-09-12T17:11:32.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.971+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.980 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:32.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0e0b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:32.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94113945946224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x55989c5019d0 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94113945946224] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94113945925520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x7f0f44050480 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94113945925520] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5c3989c0 20 remove_watcher() i=0 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5c3989c0 2 removed watcher, disabling cache 2024-09-12T17:11:32.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.975+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94113945929280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x55989c5019d0 2024-09-12T17:11:32.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94113945929280] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f5c3989c0 20 remove_watcher() i=1 2024-09-12T17:11:32.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94113945930336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50c640 con 0x55989c507570 2024-09-12T17:11:32.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f5969d640 1 -- 172.21.15.193:0/711258236 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94113945930336] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f440247a0 con 0x55989c507570 2024-09-12T17:11:32.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f5c3989c0 20 remove_watcher() i=2 2024-09-12T17:11:32.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.979+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94113945936736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x7f0f44050480 2024-09-12T17:11:32.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f5a69f640 1 -- 172.21.15.193:0/711258236 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94113945936736] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f5402f040 con 0x7f0f44050480 2024-09-12T17:11:32.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f5c3989c0 20 remove_watcher() i=3 2024-09-12T17:11:32.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94113945941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x55989c5019d0 2024-09-12T17:11:32.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94113945941024] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x55989c5019d0 2024-09-12T17:11:32.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f5c3989c0 20 remove_watcher() i=4 2024-09-12T17:11:32.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.983+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94113945935264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50f420 con 0x7f0f54019040 2024-09-12T17:11:32.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94113945935264] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f5c3989c0 20 remove_watcher() i=5 2024-09-12T17:11:32.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94113945943488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c5354d0 con 0x7f0f54019040 2024-09-12T17:11:32.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94113945943488] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f5c3989c0 20 remove_watcher() i=6 2024-09-12T17:11:32.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.987+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94113945942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55989c50dda0 con 0x7f0f54019040 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94113945942288] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f4c0b2040 con 0x7f0f54019040 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 20 remove_watcher() i=7 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0f54019040 msgr2=0x7f0f54019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0f54019040 0x7f0f54019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c5019d0 msgr2=0x55989c503e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c5019d0 0x55989c503e60 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0f44050480 msgr2=0x7f0f44050900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f0f44050480 0x7f0f44050900 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55989c507570 msgr2=0x55989c509a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55989c507570 0x55989c509a10 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e24039a70 msgr2=0x7f0e2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e24039a70 0x7f0e2403bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400f010 tx=0x7f0f5401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 msgr2=0x55989c4f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f59e9e640 1 -- 172.21.15.193:0/711258236 reap_dead start 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f0f4404fdb0 tx=0x7f0f44050e70 comp rx=0 tx=0).stop 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 shutdown_connections 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/711258236 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4f0330 0x55989c4f68a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 >> 172.21.15.193:0/711258236 conn(0x55989c4eb750 msgr2=0x55989c4e9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 shutdown_connections 2024-09-12T17:11:32.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/711258236 wait complete. 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 msgr2=0x7f0e3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 0x7f0e3403bf30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55989c4d3bb0 tx=0x7f0f54003070 comp rx=0 tx=0).stop 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 msgr2=0x55989c4e2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400d660 tx=0x7f0f4400da60 comp rx=0 tx=0).stop 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 shutdown_connections 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e34039a70 0x7f0e3403bf30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/3623362639 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c4e2960 0x55989c4e2d80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 >> 172.21.15.193:0/3623362639 conn(0x55989c4d8310 msgr2=0x55989c4d86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 shutdown_connections 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/3623362639 wait complete. 2024-09-12T17:11:32.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 msgr2=0x55989c4d2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 0x55989c4d2430 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 msgr2=0x7f0e4003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 0x7f0e4003bf80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f44001d80 tx=0x7f0f440012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 msgr2=0x55989c4caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c01b870 tx=0x7f0f4c017d70 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 shutdown_connections 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55989c4d0040 0x55989c4d2430 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0e40039ac0 0x7f0e4003bf80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 --2- 172.21.15.193:0/112127731 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55989c3db340 0x55989c4caf30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 >> 172.21.15.193:0/112127731 conn(0x55989c34bb10 msgr2=0x55989c4be060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 shutdown_connections 2024-09-12T17:11:33.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:32.991+0000 7f0f5c3989c0 1 -- 172.21.15.193:0/112127731 wait complete. 2024-09-12T17:11:33.008 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:33.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-12T17:11:33.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-12T17:11:33.010 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-12T17:11:33.085 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:33.085 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:33.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea91fc09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ef68c71200 0x55ef68c715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea91fc09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef68b239c0 con 0x55ef68c74340 2024-09-12T17:11:33.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea91fc09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ef68b736d0 con 0x55ef68c71200 2024-09-12T17:11:33.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea8fac6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ef68c71200 0x55ef68c715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea8f2c5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ef68c74340 0x55ef68c76730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:36806/0 (socket says 172.21.15.193:36806) 2024-09-12T17:11:33.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea8f2c5640 1 -- 172.21.15.193:0/288908605 learned_addr learned my addr 172.21.15.193:0/288908605 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:33.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea8fac6640 1 -- 172.21.15.193:0/288908605 >> v1:172.21.15.62:6789/0 conn(0x55ef68c74340 legacy=0x55ef68c76730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.083+0000 7fea8fac6640 1 -- 172.21.15.193:0/288908605 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68b17ca0 con 0x55ef68c71200 2024-09-12T17:11:33.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea8fac6640 1 --2- 172.21.15.193:0/288908605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68c715e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea8000a480 tx=0x7fea8001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fbcebef397d844 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea8eac4640 1 -- 172.21.15.193:0/288908605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800b0070 con 0x55ef68c71200 2024-09-12T17:11:33.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea8eac4640 1 -- 172.21.15.193:0/288908605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea800ab540 con 0x55ef68c71200 2024-09-12T17:11:33.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea8eac4640 1 -- 172.21.15.193:0/288908605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800ab840 con 0x55ef68c71200 2024-09-12T17:11:33.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 -- 172.21.15.193:0/288908605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 msgr2=0x55ef68c715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/288908605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68c715e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea8000a480 tx=0x7fea8001b280 comp rx=0 tx=0).stop 2024-09-12T17:11:33.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 -- 172.21.15.193:0/288908605 shutdown_connections 2024-09-12T17:11:33.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/288908605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68c715e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 -- 172.21.15.193:0/288908605 >> 172.21.15.193:0/288908605 conn(0x55ef68be4b10 msgr2=0x55ef68be4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 -- 172.21.15.193:0/288908605 shutdown_connections 2024-09-12T17:11:33.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.087+0000 7fea91fc09c0 1 -- 172.21.15.193:0/288908605 wait complete. 2024-09-12T17:11:33.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ef68b77680 con 0x55ef68c71200 2024-09-12T17:11:33.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea8fac6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea8fac6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53318/0 (socket says 172.21.15.193:53318) 2024-09-12T17:11:33.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea8fac6640 1 -- 172.21.15.193:0/4268055202 learned_addr learned my addr 172.21.15.193:0/4268055202 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea8fac6640 1 -- 172.21.15.193:0/4268055202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68af2da0 con 0x55ef68c71200 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea8fac6640 1 --2- 172.21.15.193:0/4268055202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fea80017e90 tx=0x7fea80003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f58941c0366de8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fe97de0b640 1 -- 172.21.15.193:0/4268055202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800b0030 con 0x55ef68c71200 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fe97de0b640 1 -- 172.21.15.193:0/4268055202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea800bc070 con 0x55ef68c71200 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fe97de0b640 1 -- 172.21.15.193:0/4268055202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800ab840 con 0x55ef68c71200 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- 172.21.15.193:0/4268055202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 msgr2=0x55ef68d5c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/4268055202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fea80017e90 tx=0x7fea80003030 comp rx=0 tx=0).stop 2024-09-12T17:11:33.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- 172.21.15.193:0/4268055202 shutdown_connections 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/4268055202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d5c8b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- 172.21.15.193:0/4268055202 >> 172.21.15.193:0/4268055202 conn(0x55ef68be4b10 msgr2=0x55ef68d58550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- 172.21.15.193:0/4268055202 shutdown_connections 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.103+0000 7fea91fc09c0 1 -- 172.21.15.193:0/4268055202 wait complete. 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ef68b19a50 con 0x55ef68c71200 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8fac6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8fac6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53326/0 (socket says 172.21.15.193:53326) 2024-09-12T17:11:33.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8fac6640 1 -- 172.21.15.193:0/18371832 learned_addr learned my addr 172.21.15.193:0/18371832 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8fac6640 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68d64370 con 0x55ef68c71200 2024-09-12T17:11:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8fac6640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fea80017e90 tx=0x7fea80018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 -- 172.21.15.193:0/18371832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800cb5b0 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef68d64600 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 -- 172.21.15.193:0/18371832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea800bc040 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 -- 172.21.15.193:0/18371832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea800cb8e0 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef68d64f60 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 -- 172.21.15.193:0/18371832 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fea800b7430 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 0x7fe97803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fe977fff640 1 -- 172.21.15.193:0/18371832 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea800b1070 con 0x55ef68c71200 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 0x7fe97803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 0x55ef68d6af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.107+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d6b470 con 0x55ef68c74340 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 0x55ef68d6af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 0x7fe97803bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea84001d80 tx=0x7fea840012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 0x55ef68d6af30 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 -- 172.21.15.193:0/18371832 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea8800a4d0 con 0x55ef68c74340 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d6b8e0 con 0x55ef68c74340 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 -- 172.21.15.193:0/18371832 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea8800a4d0 con 0x55ef68c74340 2024-09-12T17:11:33.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d6d1e0 con 0x55ef68c74340 2024-09-12T17:11:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 -- 172.21.15.193:0/18371832 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fea8800a4d0 con 0x55ef68c74340 2024-09-12T17:11:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d6c410 con 0x55ef68c74340 2024-09-12T17:11:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 -- 172.21.15.193:0/18371832 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea8800a4d0 con 0x55ef68c74340 2024-09-12T17:11:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d6c860 con 0x55ef68c74340 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea902c7640 1 -- 172.21.15.193:0/18371832 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fea8800a4d0 con 0x55ef68c74340 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea91fc09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ef68b84450 con 0x55ef68d7b4e0 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53336/0 (socket says 172.21.15.193:53336) 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1034270658 learned_addr learned my addr 172.21.15.193:0/1034270658 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.111+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1034270658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68d7bf40 con 0x55ef68d7b4e0 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fea8400d660 tx=0x7fea8400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 -- 172.21.15.193:0/1034270658 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8400c6b0 con 0x55ef68d7b4e0 2024-09-12T17:11:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef68d7c7a0 con 0x55ef68d7b4e0 2024-09-12T17:11:33.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 -- 172.21.15.193:0/1034270658 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8400c850 con 0x55ef68d7b4e0 2024-09-12T17:11:33.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 -- 172.21.15.193:0/1034270658 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8400cb30 con 0x55ef68d7b4e0 2024-09-12T17:11:33.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef68d7cd10 con 0x55ef68d7b4e0 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 -- 172.21.15.193:0/1034270658 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fea84023020 con 0x55ef68d7b4e0 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 0x7fe96803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fe9757fa640 1 -- 172.21.15.193:0/1034270658 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea84021020 con 0x55ef68d7b4e0 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea902c7640 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 0x7fe96803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea902c7640 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 0x7fe96803bf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ef68d6bf30 tx=0x7fea88005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea91fc09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ef68d5d040 con 0x55ef68d88f10 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53340/0 (socket says 172.21.15.193:53340) 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea8f2c5640 1 -- 172.21.15.193:0/421947285 learned_addr learned my addr 172.21.15.193:0/421947285 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.115+0000 7fea8f2c5640 1 -- 172.21.15.193:0/421947285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68d898e0 con 0x55ef68d88f10 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/421947285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fea84050f10 tx=0x7fea84023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fd69c65e639ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96effd640 1 -- 172.21.15.193:0/421947285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8400cd20 con 0x55ef68d88f10 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96effd640 1 -- 172.21.15.193:0/421947285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea8401bcc0 con 0x55ef68d88f10 2024-09-12T17:11:33.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96effd640 1 -- 172.21.15.193:0/421947285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea84019a70 con 0x55ef68d88f10 2024-09-12T17:11:33.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/421947285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 msgr2=0x55ef68d892f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/421947285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fea84050f10 tx=0x7fea84023420 comp rx=0 tx=0).stop 2024-09-12T17:11:33.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/421947285 shutdown_connections 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/421947285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d892f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/421947285 >> 172.21.15.193:0/421947285 conn(0x55ef68d842d0 msgr2=0x55ef68d82510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/421947285 shutdown_connections 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/421947285 wait complete. 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 Processor -- start 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- start start 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ef68d87e00 con 0x55ef68d88f10 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:53344/0 (socket says 172.21.15.193:53344) 2024-09-12T17:11:33.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 learned_addr learned my addr 172.21.15.193:0/1402886652 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef68d8f970 con 0x55ef68d88f10 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fea8404c040 tx=0x7fea84050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96d7fa640 1 -- 172.21.15.193:0/1402886652 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea84025410 con 0x55ef68d88f10 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef68d8fc00 con 0x55ef68d88f10 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96d7fa640 1 -- 172.21.15.193:0/1402886652 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea840196f0 con 0x55ef68d88f10 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fe96d7fa640 1 -- 172.21.15.193:0/1402886652 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fea8401b420 con 0x55ef68d88f10 2024-09-12T17:11:33.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.119+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef68d8fc00 con 0x55ef68d88f10 2024-09-12T17:11:33.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fe96d7fa640 1 -- 172.21.15.193:0/1402886652 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fea8404a040 con 0x55ef68d88f10 2024-09-12T17:11:33.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fe96d7fa640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe958039a70 0x7fe95803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fe96d7fa640 1 -- 172.21.15.193:0/1402886652 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6110+0+0 (secure 0 0 0) 0x7fea84048020 con 0x55ef68d88f10 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea902c7640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe958039a70 0x7fe95803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68d9a540 0x55ef68d9c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9d120 con 0x55ef68d9a540 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68d9a540 0x55ef68d9c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea902c7640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe958039a70 0x7fe95803bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55ef68d653c0 tx=0x7fea8801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68d9a540 0x55ef68d9c9d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 realm 2024-09-12T17:11:33.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9d530 con 0x55ef68d9a540 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9de00 con 0x55ef68d9a540 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9e1a0 con 0x55ef68d9a540 2024-09-12T17:11:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9e9f0 con 0x55ef68d9a540 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 20 searching for the correct realm 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ef68da0760 0x55ef68da2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ef68da0760 0x55ef68da2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.123+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ef68da0760 0x55ef68da2b50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8f2c5640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fea8404f1b0 0x7fea84053a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea902c7640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fea8404f1b0 0x7fea84053a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea902c7640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fea8404f1b0 0x7fea84053a60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea902c7640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fea88031040 0x7fea88032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fea88031040 0x7fea88032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fea88031040 0x7fea88032430 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.127+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.131+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.135+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68da0760 2024-09-12T17:11:33.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea88031040 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x55ef68d9a540 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da3090 con 0x7fea8404f1b0 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fea8801f070 con 0x7fea8404f1b0 2024-09-12T17:11:33.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9f340 con 0x55ef68d9a540 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68d9fb90 con 0x55ef68d9a540 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da34c0 con 0x55ef68d9a540 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 zone default found 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 4 Realm: () 2024-09-12T17:11:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 zonegroup default 2024-09-12T17:11:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da34c0 con 0x7fea88031040 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da52d0 con 0x55ef68da0760 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.139+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da5770 con 0x55ef68da0760 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 20 started sync module instance, tier type = 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da4770 con 0x7fea8404f1b0 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486744681312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da43d0 con 0x7fea8404f1b0 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da66a0 con 0x55ef68d9a540 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.143+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486744681312] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486744685520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da66a0 con 0x55ef68d9a540 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da7060 con 0x55ef68da0760 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486744689584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da78b0 con 0x55ef68da0760 2024-09-12T17:11:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da82b0 con 0x7fea8404f1b0 2024-09-12T17:11:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.147+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486744685520] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486744687088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da86a0 con 0x7fea8404f1b0 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da9060 con 0x55ef68d9a540 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486744689584] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486744687088] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486744694208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da8bb0 con 0x55ef68d9a540 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.151+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da9400 con 0x7fea88031040 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486744694208] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486744697776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da97f0 con 0x7fea88031040 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68daa040 con 0x7fea88031040 2024-09-12T17:11:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486744697776] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486744698832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68da9ca0 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.155+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68daa6c0 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486744698832] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486744703408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68daa8a0 con 0x7fea88031040 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=0 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=1 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=2 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=3 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=4 2024-09-12T17:11:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=5 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.159+0000 7fea91fc09c0 20 add_watcher() i=6 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486744703408] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 add_watcher() i=7 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dadc70 con 0x55ef68d9a540 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486744704912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dab060 con 0x55ef68d9a540 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486744704912] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fe945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 5 note: GC not initialized 2024-09-12T17:11:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fe944fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 Filter name: none 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fe8be7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd0d60 con 0x55ef68d9a540 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd37f0 con 0x7fea8404f1b0 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 enabling bucket name=myfoo 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.163+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd17d0 con 0x7fea8404f1b0 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 : miss 2024-09-12T17:11:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd4150 con 0x55ef68da0760 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(65 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 8.f 8:f68ed28a:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68ddb640 con 0x55ef68da0760 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1, ofs0, ns] 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94486744875200 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd5cd0 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== watch-notify(notify (1) cookie 94486744685520 notify 137438953499 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55ef68d64f60 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(67 notify.1 [notify cookie 94486744875200 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fe96effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94486744685520 notifier 4601 bl.length()=760 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fe96effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 info.flags=0x17 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fe96effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1 to cache LRU end 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fe96effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.167+0000 7fe96effd640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe954003eb0 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify_complete (2) cookie 94486744875200 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef68d64600 con 0x55ef68d9a540 2024-09-12T17:11:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_sources= new_sources= 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential sources added=[] removed=[] 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): orig_dests= new_dests= 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 20 handle_bi_update(): bucket=:myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1]): potential dests added=[] removed=[] 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68ddae70 con 0x55ef68d9a540 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94486744875200 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dd6d50 con 0x55ef68d9a540 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify (1) cookie 94486744694208 notify 137438953500 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55ef68d64600 con 0x55ef68d9a540 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fe96effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94486744694208 notifier 4601 bl.length()=567 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fe96effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fe96effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:33.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(70 notify.4 [notify cookie 94486744875200 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fe96effd640 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fe954003eb0 con 0x55ef68d9a540 2024-09-12T17:11:33.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== watch-notify(notify_complete (2) cookie 94486744875200 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef68d64370 con 0x55ef68d9a540 2024-09-12T17:11:33.184 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fe945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.171+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486744704912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x55ef68d9a540 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94486744704912] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486744681312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x7fea8404f1b0 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94486744681312] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 20 remove_watcher() i=0 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 2 removed watcher, disabling cache 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486744685520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x55ef68d9a540 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94486744685520] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 20 remove_watcher() i=1 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.175+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486744689584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x55ef68da0760 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea8f2c5640 1 -- 172.21.15.193:0/1402886652 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94486744689584] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea84052880 con 0x55ef68da0760 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea91fc09c0 20 remove_watcher() i=2 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486744687088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x7fea8404f1b0 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea902c7640 1 -- 172.21.15.193:0/1402886652 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94486744687088] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea88040040 con 0x7fea8404f1b0 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea91fc09c0 20 remove_watcher() i=3 2024-09-12T17:11:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.179+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486744694208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x55ef68d9a540 2024-09-12T17:11:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94486744694208] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x55ef68d9a540 2024-09-12T17:11:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea91fc09c0 20 remove_watcher() i=4 2024-09-12T17:11:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486744697776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x7fea88031040 2024-09-12T17:11:33.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94486744697776] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea91fc09c0 20 remove_watcher() i=5 2024-09-12T17:11:33.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.183+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486744698832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x7fea88031040 2024-09-12T17:11:33.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.187+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94486744698832] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.187+0000 7fea91fc09c0 20 remove_watcher() i=6 2024-09-12T17:11:33.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.187+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486744703408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef68dceb70 con 0x7fea88031040 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94486744703408] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fea800b7900 con 0x7fea88031040 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 20 remove_watcher() i=7 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fea88031040 msgr2=0x7fea88032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fea88031040 0x7fea88032430 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68d9a540 msgr2=0x55ef68d9c9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68d9a540 0x55ef68d9c9d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fea8404f1b0 msgr2=0x7fea84053a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fea8404f1b0 0x7fea84053a60 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ef68da0760 msgr2=0x55ef68da2b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ef68da0760 0x55ef68da2b50 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe958039a70 msgr2=0x7fe95803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe958039a70 0x7fe95803bf30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55ef68d653c0 tx=0x7fea8801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 msgr2=0x55ef68d8f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea8fac6640 1 -- 172.21.15.193:0/1402886652 reap_dead start 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fea8404c040 tx=0x7fea84050e70 comp rx=0 tx=0).stop 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 shutdown_connections 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1402886652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d88f10 0x55ef68d8f410 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 >> 172.21.15.193:0/1402886652 conn(0x55ef68d842d0 msgr2=0x55ef68d824e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 shutdown_connections 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1402886652 wait complete. 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 msgr2=0x7fe96803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 0x7fe96803bf20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55ef68d6bf30 tx=0x7fea88005850 comp rx=0 tx=0).stop 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 msgr2=0x55ef68d7b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fea8400d660 tx=0x7fea8400da60 comp rx=0 tx=0).stop 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 shutdown_connections 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe968039a60 0x7fe96803bf20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/1034270658 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68d7b4e0 0x55ef68d7b900 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 >> 172.21.15.193:0/1034270658 conn(0x55ef68d70e90 msgr2=0x55ef68d71270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 shutdown_connections 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/1034270658 wait complete. 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 msgr2=0x55ef68d6af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 0x55ef68d6af30 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 msgr2=0x7fe97803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 0x7fe97803bf30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fea84001d80 tx=0x7fea840012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 msgr2=0x55ef68d63e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fea80017e90 tx=0x7fea80018020 comp rx=0 tx=0).stop 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 shutdown_connections 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ef68c74340 0x55ef68d6af30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe978039a70 0x7fe97803bf30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 --2- 172.21.15.193:0/18371832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ef68c71200 0x55ef68d63e10 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 >> 172.21.15.193:0/18371832 conn(0x55ef68be4b10 msgr2=0x55ef68d56fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 shutdown_connections 2024-09-12T17:11:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:33.191+0000 7fea91fc09c0 1 -- 172.21.15.193:0/18371832 wait complete. 2024-09-12T17:11:33.206 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:33.216 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:11:33.587 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-12T17:11:33.604 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:48.605 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T17:11:48.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T17:11:48.605 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T17:11:48.645 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:48.645 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.639+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.639+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.639+0000 7f2e492d09c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ca39f57200 0x55ca39fe5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.639+0000 7f2e492d09c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca39e979c0 con 0x55ca39fe6170 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.639+0000 7f2e492d09c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ca39ee76d0 con 0x55ca39f57200 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e46dd6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ca39f57200 0x55ca39fe5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e465d5640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ca39fe6170 0x55ca39fe8560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47512/0 (socket says 172.21.15.193:47512) 2024-09-12T17:11:48.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e465d5640 1 -- 172.21.15.193:0/621886557 learned_addr learned my addr 172.21.15.193:0/621886557 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:48.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e46dd6640 1 -- 172.21.15.193:0/621886557 >> v1:172.21.15.62:6789/0 conn(0x55ca39fe6170 legacy=0x55ca39fe8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e46dd6640 1 -- 172.21.15.193:0/621886557 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca39e8bca0 con 0x55ca39f57200 2024-09-12T17:11:48.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/621886557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe5c30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a480 tx=0x7f2e3801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b70e4643382d6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e45dd4640 1 -- 172.21.15.193:0/621886557 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380af070 con 0x55ca39f57200 2024-09-12T17:11:48.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e45dd4640 1 -- 172.21.15.193:0/621886557 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e380aa530 con 0x55ca39f57200 2024-09-12T17:11:48.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.643+0000 7f2e45dd4640 1 -- 172.21.15.193:0/621886557 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380aa830 con 0x55ca39f57200 2024-09-12T17:11:48.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 -- 172.21.15.193:0/621886557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 msgr2=0x55ca39fe5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/621886557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe5c30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800a480 tx=0x7f2e3801b280 comp rx=0 tx=0).stop 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 -- 172.21.15.193:0/621886557 shutdown_connections 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/621886557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe5c30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 -- 172.21.15.193:0/621886557 >> 172.21.15.193:0/621886557 conn(0x55ca39fdd920 msgr2=0x55ca39fdfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 -- 172.21.15.193:0/621886557 shutdown_connections 2024-09-12T17:11:48.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.647+0000 7f2e492d09c0 1 -- 172.21.15.193:0/621886557 wait complete. 2024-09-12T17:11:48.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.659+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ca39eeb680 con 0x55ca39f57200 2024-09-12T17:11:48.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33146/0 (socket says 172.21.15.193:33146) 2024-09-12T17:11:48.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 -- 172.21.15.193:0/1631087396 learned_addr learned my addr 172.21.15.193:0/1631087396 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 -- 172.21.15.193:0/1631087396 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca39e66da0 con 0x55ca39f57200 2024-09-12T17:11:48.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/1631087396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2e380ad040 tx=0x7f2e38003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371e509ef20566cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2d34e09640 1 -- 172.21.15.193:0/1631087396 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380af070 con 0x55ca39f57200 2024-09-12T17:11:48.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2d34e09640 1 -- 172.21.15.193:0/1631087396 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e380b0040 con 0x55ca39f57200 2024-09-12T17:11:48.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2d34e09640 1 -- 172.21.15.193:0/1631087396 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380aa830 con 0x55ca39f57200 2024-09-12T17:11:48.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1631087396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 msgr2=0x55ca39fe3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1631087396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2e380ad040 tx=0x7f2e38003030 comp rx=0 tx=0).stop 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1631087396 shutdown_connections 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1631087396 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca39fe3170 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1631087396 >> 172.21.15.193:0/1631087396 conn(0x55ca39fdd920 msgr2=0x55ca3a0ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1631087396 shutdown_connections 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1631087396 wait complete. 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e492d09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ca39e8da50 con 0x55ca39f57200 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33156/0 (socket says 172.21.15.193:33156) 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.663+0000 7f2e46dd6640 1 -- 172.21.15.193:0/152856195 learned_addr learned my addr 172.21.15.193:0/152856195 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e46dd6640 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3a0d83f0 con 0x55ca39f57200 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2e3801bb20 tx=0x7f2e38018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 -- 172.21.15.193:0/152856195 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380c4020 con 0x55ca39f57200 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 -- 172.21.15.193:0/152856195 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e380b6690 con 0x55ca39f57200 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca3a0d8680 con 0x55ca39f57200 2024-09-12T17:11:48.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 -- 172.21.15.193:0/152856195 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e380b6970 con 0x55ca39f57200 2024-09-12T17:11:48.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3a0d9030 con 0x55ca39f57200 2024-09-12T17:11:48.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 -- 172.21.15.193:0/152856195 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e380c7020 con 0x55ca39f57200 2024-09-12T17:11:48.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 0x7f2d2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2d33606640 1 -- 172.21.15.193:0/152856195 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2e380bb070 con 0x55ca39f57200 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e465d5640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 0x7f2d2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 0x55ca3a0df000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a0df540 con 0x55ca39fe6170 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e475d7640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 0x55ca3a0df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e465d5640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 0x7f2d2c03bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004180 tx=0x7f2e3c001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e475d7640 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 0x55ca3a0df000 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.667+0000 7f2e475d7640 1 -- 172.21.15.193:0/152856195 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e4000a4d0 con 0x55ca39fe6170 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a0df990 con 0x55ca39fe6170 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e475d7640 1 -- 172.21.15.193:0/152856195 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e4000a4d0 con 0x55ca39fe6170 2024-09-12T17:11:48.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a0e1290 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e475d7640 1 -- 172.21.15.193:0/152856195 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2e4000a4d0 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a0e04c0 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e475d7640 1 -- 172.21.15.193:0/152856195 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e4000a4d0 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a0e08e0 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e475d7640 1 -- 172.21.15.193:0/152856195 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2e4000a4d0 con 0x55ca39fe6170 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ca39ef8450 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33166/0 (socket says 172.21.15.193:33166) 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e465d5640 1 -- 172.21.15.193:0/1729823307 learned_addr learned my addr 172.21.15.193:0/1729823307 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e465d5640 1 -- 172.21.15.193:0/1729823307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3a0f0050 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e465d5640 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00d660 tx=0x7f2e3c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2d30e01640 1 -- 172.21.15.193:0/1729823307 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c00c6b0 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2d30e01640 1 -- 172.21.15.193:0/1729823307 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00c850 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca3a0f08b0 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2d30e01640 1 -- 172.21.15.193:0/1729823307 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c00cb30 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.671+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3a0f0e20 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d30e01640 1 -- 172.21.15.193:0/1729823307 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e3c023020 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d30e01640 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 0x7f2d2003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d30e01640 1 -- 172.21.15.193:0/1729823307 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2e3c021020 con 0x55ca3a0ef5f0 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e475d7640 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 0x7f2d2003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e475d7640 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 0x7f2d2003bf70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55ca3a0e0860 tx=0x7f2e40005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ca39fe3900 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33174/0 (socket says 172.21.15.193:33174) 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e465d5640 1 -- 172.21.15.193:0/3682939258 learned_addr learned my addr 172.21.15.193:0/3682939258 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e465d5640 1 -- 172.21.15.193:0/3682939258 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3a0fc960 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e465d5640 1 --2- 172.21.15.193:0/3682939258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c050f50 tx=0x7f2e3c023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c931e5c3b102d3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d2a7fc640 1 -- 172.21.15.193:0/3682939258 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c047070 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d2a7fc640 1 -- 172.21.15.193:0/3682939258 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c00cd20 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2d2a7fc640 1 -- 172.21.15.193:0/3682939258 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c01bcc0 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- 172.21.15.193:0/3682939258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 msgr2=0x55ca3a0fc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/3682939258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c050f50 tx=0x7f2e3c023430 comp rx=0 tx=0).stop 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- 172.21.15.193:0/3682939258 shutdown_connections 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/3682939258 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a0fc390 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- 172.21.15.193:0/3682939258 >> 172.21.15.193:0/3682939258 conn(0x55ca3a0f83e0 msgr2=0x55ca3a0f6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.675+0000 7f2e492d09c0 1 -- 172.21.15.193:0/3682939258 shutdown_connections 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- 172.21.15.193:0/3682939258 wait complete. 2024-09-12T17:11:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 Processor -- start 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- start start 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ca3a0fcfc0 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e465d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33180/0 (socket says 172.21.15.193:33180) 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 learned_addr learned my addr 172.21.15.193:0/2536274264 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca3a103ae0 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e465d5640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c04c040 tx=0x7f2e3c04d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 -- 172.21.15.193:0/2536274264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c034070 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca3a103d70 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 -- 172.21.15.193:0/2536274264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e3c0196f0 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 -- 172.21.15.193:0/2536274264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e3c047030 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca3a103d70 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 -- 172.21.15.193:0/2536274264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2e3c052d10 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d10039a70 0x7f2d1003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2d28ff9640 1 -- 172.21.15.193:0/2536274264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2e3c005030 con 0x55ca3a0fbfb0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e475d7640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d10039a70 0x7f2d1003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca3a10e5c0 0x55ca3a110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.679+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1111a0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca3a10e5c0 0x55ca3a110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d10039a70 0x7f2d1003bf30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55ca3a0dffe0 tx=0x7f2e4001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca3a10e5c0 0x55ca3a110a50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 realm 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1115b0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a111e80 con 0x55ca3a10e5c0 2024-09-12T17:11:48.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a112220 con 0x55ca3a10e5c0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a112a70 con 0x55ca3a10e5c0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 20 searching for the correct realm 2024-09-12T17:11:48.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ca3a1147e0 0x55ca3a116bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e465d5640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ca3a1147e0 0x55ca3a116bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e465d5640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ca3a1147e0 0x55ca3a116bd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e465d5640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2e3c039070 0x7f2e3c04c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2e3c039070 0x7f2e3c04c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2e3c039070 0x7f2e3c04c070 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2e40031040 0x7f2e40032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.683+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2e40031040 0x7f2e40032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2e40031040 0x7f2e40032430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.687+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.691+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a1147e0 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.695+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e40031040 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x55ca3a10e5c0 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117110 con 0x7f2e3c039070 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2e4001f070 con 0x7f2e3c039070 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:48.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1133f0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a113c90 con 0x55ca3a10e5c0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a113030 con 0x55ca3a10e5c0 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 zone default found 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 4 Realm: () 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 zonegroup default 2024-09-12T17:11:48.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a117570 con 0x7f2e40031040 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a119060 con 0x55ca3a1147e0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a119570 con 0x55ca3a1147e0 2024-09-12T17:11:48.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 started sync module instance, tier type = 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.699+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a118400 con 0x7f2e3c039070 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327045982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a119e80 con 0x7f2e3c039070 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11a6d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327045982192] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327045986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11a320 con 0x55ca3a10e5c0 2024-09-12T17:11:48.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.703+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11ae40 con 0x55ca3a1147e0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327045990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11b6e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11c0a0 con 0x7f2e3c039070 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327045986768] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327045995504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11c010 con 0x7f2e3c039070 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11ce70 con 0x55ca3a10e5c0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.707+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327045990672] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.711+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327045995504] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.711+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.711+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327045993008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11ce30 con 0x55ca3a10e5c0 2024-09-12T17:11:48.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.711+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11d2a0 con 0x7f2e40031040 2024-09-12T17:11:48.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327045993008] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327046001168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11c940 con 0x7f2e40031040 2024-09-12T17:11:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11dcb0 con 0x7f2e40031040 2024-09-12T17:11:48.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327046001168] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327045997984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11dcb0 con 0x7f2e40031040 2024-09-12T17:11:48.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.715+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11e580 con 0x7f2e40031040 2024-09-12T17:11:48.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327045997984] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327046002688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11e760 con 0x7f2e40031040 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=0 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=1 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=2 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=3 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=4 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=5 2024-09-12T17:11:48.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=6 2024-09-12T17:11:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327046002688] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 20 add_watcher() i=7 2024-09-12T17:11:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.719+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a121b30 con 0x55ca3a10e5c0 2024-09-12T17:11:48.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327046006352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a11ef20 con 0x55ca3a10e5c0 2024-09-12T17:11:48.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327046006352] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2cfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:48.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e492d09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:48.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e492d09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:48.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.723+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a123e70 con 0x55ca3a10e5c0 2024-09-12T17:11:48.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.727+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.727+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a4b0 con 0x7f2e40031040 2024-09-12T17:11:48.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.727+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.727+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a2e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a910 con 0x55ca3a10e5c0 2024-09-12T17:11:48.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a880 con 0x7f2e3c039070 2024-09-12T17:11:48.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12acd0 con 0x55ca3a1147e0 2024-09-12T17:11:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.731+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12acd0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.735+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.735+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12acd0 con 0x7f2e40031040 2024-09-12T17:11:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12acd0 con 0x7f2e3c039070 2024-09-12T17:11:48.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12b240 con 0x55ca3a1147e0 2024-09-12T17:11:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.739+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12b6f0 con 0x7f2e3c039070 2024-09-12T17:11:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.743+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'46 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.743+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a129950 con 0x7f2e40031040 2024-09-12T17:11:48.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.743+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.743+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a129950 con 0x7f2e3c039070 2024-09-12T17:11:48.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.747+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.747+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x7f2e40031040 2024-09-12T17:11:48.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.747+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.747+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.751+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.751+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.751+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.751+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x7f2e3c039070 2024-09-12T17:11:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.755+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.755+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.755+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.755+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.759+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.759+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.759+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.759+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x55ca3a1147e0 2024-09-12T17:11:48.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.763+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.763+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x7f2e3c039070 2024-09-12T17:11:48.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.763+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.763+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x55ca3a1147e0 2024-09-12T17:11:48.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a170 con 0x55ca3a1147e0 2024-09-12T17:11:48.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a170 con 0x55ca3a1147e0 2024-09-12T17:11:48.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.767+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a170 con 0x55ca3a1147e0 2024-09-12T17:11:48.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.771+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.771+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a170 con 0x7f2e40031040 2024-09-12T17:11:48.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.771+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.771+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a12a170 con 0x55ca3a1147e0 2024-09-12T17:11:48.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.775+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.775+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x7f2e40031040 2024-09-12T17:11:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.775+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'30 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.775+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294a0 con 0x55ca3a1147e0 2024-09-12T17:11:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.779+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.779+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x7f2e40031040 2024-09-12T17:11:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.779+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.779+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1292d0 con 0x7f2e3c039070 2024-09-12T17:11:48.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2c77fff640 20 reqs_thread_entry: start 2024-09-12T17:11:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e492d09c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e492d09c0 20 Filter name: none 2024-09-12T17:11:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2c75ffb640 20 reqs_thread_entry: start 2024-09-12T17:11:48.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.783+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1284d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.787+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.791+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.795+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x55ca3a1147e0 2024-09-12T17:11:48.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.799+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e40031040 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1294e0 con 0x7f2e3c039070 2024-09-12T17:11:48.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(132 gc.12 [call out=1702b] v0'0 uv18 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e40031040 2024-09-12T17:11:48.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.803+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e3c039070 2024-09-12T17:11:48.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.807+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.811+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e3c039070 2024-09-12T17:11:48.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.815+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e40031040 2024-09-12T17:11:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.819+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e40031040 2024-09-12T17:11:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.823+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x55ca3a1147e0 2024-09-12T17:11:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x55ca3a1147e0 2024-09-12T17:11:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.827+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1473c0 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a1483d0 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2cfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327046006352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a146bc0 con 0x55ca3a10e5c0 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94327046006352] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.831+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327045982192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94327045982192] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e492d09c0 20 remove_watcher() i=0 2024-09-12T17:11:48.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e492d09c0 2 removed watcher, disabling cache 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327045986768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x55ca3a10e5c0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94327045986768] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e492d09c0 20 remove_watcher() i=1 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.835+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327045990672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x55ca3a1147e0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e465d5640 1 -- 172.21.15.193:0/2536274264 <== osd.3 v2:172.21.15.193:6816/1944991354 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94327045990672] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e3c036030 con 0x55ca3a1147e0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e492d09c0 20 remove_watcher() i=2 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327045995504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x7f2e3c039070 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e475d7640 1 -- 172.21.15.193:0/2536274264 <== osd.2 v2:172.21.15.193:6800/1491583795 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94327045995504] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e40040040 con 0x7f2e3c039070 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e492d09c0 20 remove_watcher() i=3 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.839+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327045993008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x55ca3a10e5c0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.843+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94327045993008] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x55ca3a10e5c0 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.843+0000 7f2e492d09c0 20 remove_watcher() i=4 2024-09-12T17:11:48.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.843+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327046001168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.843+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94327046001168] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.843+0000 7f2e492d09c0 20 remove_watcher() i=5 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.847+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327045997984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.847+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94327045997984] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.847+0000 7f2e492d09c0 20 remove_watcher() i=6 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.847+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327046002688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ca3a128930 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94327046002688] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2e380a8070 con 0x7f2e40031040 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 20 remove_watcher() i=7 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2e40031040 msgr2=0x7f2e40032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2e40031040 0x7f2e40032430 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca3a10e5c0 msgr2=0x55ca3a110a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca3a10e5c0 0x55ca3a110a50 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2e3c039070 msgr2=0x7f2e3c04c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2e3c039070 0x7f2e3c04c070 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ca3a1147e0 msgr2=0x55ca3a116bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ca3a1147e0 0x55ca3a116bd0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d10039a70 msgr2=0x7f2d1003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d10039a70 0x7f2d1003bf30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55ca3a0dffe0 tx=0x7f2e4001f000 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 msgr2=0x55ca3a103580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e46dd6640 1 -- 172.21.15.193:0/2536274264 reap_dead start 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c04c040 tx=0x7f2e3c04d040 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 shutdown_connections 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/2536274264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0fbfb0 0x55ca3a103580 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 >> 172.21.15.193:0/2536274264 conn(0x55ca3a0f83e0 msgr2=0x55ca3a0f65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 shutdown_connections 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/2536274264 wait complete. 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 msgr2=0x7f2d2003bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 0x7f2d2003bf70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55ca3a0e0860 tx=0x7f2e40005850 comp rx=0 tx=0).stop 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 msgr2=0x55ca3a0efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00d660 tx=0x7f2e3c00da60 comp rx=0 tx=0).stop 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 shutdown_connections 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d20039ab0 0x7f2d2003bf70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/1729823307 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca3a0ef5f0 0x55ca3a0efa10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 >> 172.21.15.193:0/1729823307 conn(0x55ca3a0e4fa0 msgr2=0x55ca3a0e5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 shutdown_connections 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/1729823307 wait complete. 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 msgr2=0x55ca3a0df000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 0x55ca3a0df000 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 msgr2=0x7f2d2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 0x7f2d2c03bf30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c004180 tx=0x7f2e3c001340 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 msgr2=0x55ca3a0d7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2e3801bb20 tx=0x7f2e38018020 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 shutdown_connections 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ca39fe6170 0x55ca3a0df000 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2d2c039a70 0x7f2d2c03bf30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 --2- 172.21.15.193:0/152856195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ca39f57200 0x55ca3a0d7e90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 >> 172.21.15.193:0/152856195 conn(0x55ca39fdd920 msgr2=0x55ca39fe1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 shutdown_connections 2024-09-12T17:11:48.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.851+0000 7f2e492d09c0 1 -- 172.21.15.193:0/152856195 wait complete. 2024-09-12T17:11:48.868 INFO:teuthology.orchestra.run.smithi193.stdout:[{"tag":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15037132847887650165\u0000","time":"2024-09-12T17:11:48.600177+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__7","key":"","instance":""}]}] 2024-09-12T17:11:48.868 DEBUG:tasks.util.rgw: json result: [{'tag': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15037132847887650165\x00', 'time': '2024-09-12T17:11:48.600177+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__7', 'key': '', 'instance': ''}]}] 2024-09-12T17:11:48.869 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-12T17:11:48.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-12T17:11:48.869 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-12T17:11:48.945 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:48.945 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6597b319c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dd598eb320 0x55dd598ed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6597b319c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dd5979b9c0 con 0x55dd5985b1d0 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6597b319c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55dd597eb6d0 con 0x55dd598eb320 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6594e36640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dd598eb320 0x55dd598ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6594e36640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55dd598eb320 0x55dd598ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33194/0 (socket says 172.21.15.193:33194) 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6595637640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55dd5985b1d0 0x55dd598e9c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47516/0 (socket says 172.21.15.193:47516) 2024-09-12T17:11:48.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6594e36640 1 -- 172.21.15.193:0/2730789481 learned_addr learned my addr 172.21.15.193:0/2730789481 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6594e36640 1 -- 172.21.15.193:0/2730789481 >> v1:172.21.15.62:6789/0 conn(0x55dd5985b1d0 legacy=0x55dd598e9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.943+0000 7f6594e36640 1 -- 172.21.15.193:0/2730789481 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5978fca0 con 0x55dd598eb320 2024-09-12T17:11:48.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6594e36640 1 --2- 172.21.15.193:0/2730789481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd598ed710 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f658800a4e0 tx=0x7f658801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff6a6c5d4a6ed0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f658ffff640 1 -- 172.21.15.193:0/2730789481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880aa540 con 0x55dd598eb320 2024-09-12T17:11:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f658ffff640 1 -- 172.21.15.193:0/2730789481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65880aa6e0 con 0x55dd598eb320 2024-09-12T17:11:48.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f658ffff640 1 -- 172.21.15.193:0/2730789481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880aaa40 con 0x55dd598eb320 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 -- 172.21.15.193:0/2730789481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 msgr2=0x55dd598ed710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2730789481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd598ed710 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f658800a4e0 tx=0x7f658801b090 comp rx=0 tx=0).stop 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 -- 172.21.15.193:0/2730789481 shutdown_connections 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2730789481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd598ed710 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 -- 172.21.15.193:0/2730789481 >> 172.21.15.193:0/2730789481 conn(0x55dd598e18f0 msgr2=0x55dd598e3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 -- 172.21.15.193:0/2730789481 shutdown_connections 2024-09-12T17:11:48.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.947+0000 7f6597b319c0 1 -- 172.21.15.193:0/2730789481 wait complete. 2024-09-12T17:11:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6597b319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6597b319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dd597ef680 con 0x55dd5985b1d0 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6595637640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6595637640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33198/0 (socket says 172.21.15.193:33198) 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6595637640 1 -- 172.21.15.193:0/796709146 learned_addr learned my addr 172.21.15.193:0/796709146 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6595637640 1 -- 172.21.15.193:0/796709146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5976ada0 con 0x55dd5985b1d0 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.963+0000 7f6595637640 1 --2- 172.21.15.193:0/796709146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f658000b270 tx=0x7f658000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbc7d7bc0b539a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6483606640 1 -- 172.21.15.193:0/796709146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658000e5d0 con 0x55dd5985b1d0 2024-09-12T17:11:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6483606640 1 -- 172.21.15.193:0/796709146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658000e770 con 0x55dd5985b1d0 2024-09-12T17:11:48.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6483606640 1 -- 172.21.15.193:0/796709146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658000ea70 con 0x55dd5985b1d0 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/796709146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 msgr2=0x55dd599d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 --2- 172.21.15.193:0/796709146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f658000b270 tx=0x7f658000b670 comp rx=0 tx=0).stop 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/796709146 shutdown_connections 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 --2- 172.21.15.193:0/796709146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd5985b1d0 0x55dd599d2790 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/796709146 >> 172.21.15.193:0/796709146 conn(0x55dd598e18f0 msgr2=0x55dd599ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/796709146 shutdown_connections 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/796709146 wait complete. 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dd59791a50 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6595637640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6595637640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33200/0 (socket says 172.21.15.193:33200) 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6595637640 1 -- 172.21.15.193:0/292467055 learned_addr learned my addr 172.21.15.193:0/292467055 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6595637640 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd599da6d0 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6595637640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55dd599d3720 tx=0x7f6580000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6481e03640 1 -- 172.21.15.193:0/292467055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658000be70 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd599da960 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd599db220 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6481e03640 1 -- 172.21.15.193:0/292467055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658000ee20 con 0x55dd598eb320 2024-09-12T17:11:48.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.967+0000 7f6481e03640 1 -- 172.21.15.193:0/292467055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f658002c060 con 0x55dd598eb320 2024-09-12T17:11:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6481e03640 1 -- 172.21.15.193:0/292467055 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6580017070 con 0x55dd598eb320 2024-09-12T17:11:48.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6481e03640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 0x7f647c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6481e03640 1 -- 172.21.15.193:0/292467055 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6580015020 con 0x55dd598eb320 2024-09-12T17:11:48.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6594e36640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 0x7f647c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 0x55dd599e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd599e1b10 con 0x55dd599df1e0 2024-09-12T17:11:48.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 0x55dd599e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6594e36640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 0x7f647c03bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65880ab000 tx=0x7f65880a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 0x55dd599e15d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 -- 172.21.15.193:0/292467055 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65900083f0 con 0x55dd599df1e0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd599e1eb0 con 0x55dd599df1e0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 -- 172.21.15.193:0/292467055 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65900083f0 con 0x55dd599df1e0 2024-09-12T17:11:48.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd599e37b0 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 -- 172.21.15.193:0/292467055 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65900083f0 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd599e29e0 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 -- 172.21.15.193:0/292467055 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65900083f0 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd599e2e30 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.971+0000 7f6595e38640 1 -- 172.21.15.193:0/292467055 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65900083f0 con 0x55dd599df1e0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dd597fc450 con 0x55dd599f1ac0 2024-09-12T17:11:48.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33210/0 (socket says 172.21.15.193:33210) 2024-09-12T17:11:48.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6594e36640 1 -- 172.21.15.193:0/2148447591 learned_addr learned my addr 172.21.15.193:0/2148447591 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6594e36640 1 -- 172.21.15.193:0/2148447591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd599f2520 con 0x55dd599f1ac0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6594e36640 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6588000f90 tx=0x7f6588017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f647affd640 1 -- 172.21.15.193:0/2148447591 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880c4020 con 0x55dd599f1ac0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f647affd640 1 -- 172.21.15.193:0/2148447591 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65880b5be0 con 0x55dd599f1ac0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd599f2d80 con 0x55dd599f1ac0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f647affd640 1 -- 172.21.15.193:0/2148447591 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880b9030 con 0x55dd599f1ac0 2024-09-12T17:11:48.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd599f3290 con 0x55dd599f1ac0 2024-09-12T17:11:48.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.975+0000 7f647affd640 1 -- 172.21.15.193:0/2148447591 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65880c7020 con 0x55dd599f1ac0 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f647affd640 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 0x7f646c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f647affd640 1 -- 172.21.15.193:0/2148447591 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f65880ba070 con 0x55dd599f1ac0 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6595e38640 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 0x7f646c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6595e38640 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 0x7f646c03bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55dd599e2500 tx=0x7f6590003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dd599d2fe0 con 0x55dd599fe2e0 2024-09-12T17:11:48.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33226/0 (socket says 172.21.15.193:33226) 2024-09-12T17:11:48.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 -- 172.21.15.193:0/1418723804 learned_addr learned my addr 172.21.15.193:0/1418723804 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 -- 172.21.15.193:0/1418723804 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd599fec90 con 0x55dd599fe2e0 2024-09-12T17:11:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 --2- 172.21.15.193:0/1418723804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f65880c8ff0 tx=0x7f65880bef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adaeb2ad99f12dff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6478ff9640 1 -- 172.21.15.193:0/1418723804 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880b3a20 con 0x55dd599fe2e0 2024-09-12T17:11:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6478ff9640 1 -- 172.21.15.193:0/1418723804 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65880b3bc0 con 0x55dd599fe2e0 2024-09-12T17:11:48.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6478ff9640 1 -- 172.21.15.193:0/1418723804 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880bfbd0 con 0x55dd599fe2e0 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- 172.21.15.193:0/1418723804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 msgr2=0x55dd599fe6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1418723804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f65880c8ff0 tx=0x7f65880bef10 comp rx=0 tx=0).stop 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- 172.21.15.193:0/1418723804 shutdown_connections 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1418723804 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd599fe6c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- 172.21.15.193:0/1418723804 >> 172.21.15.193:0/1418723804 conn(0x55dd599fa710 msgr2=0x55dd599f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:48.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- 172.21.15.193:0/1418723804 shutdown_connections 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- 172.21.15.193:0/1418723804 wait complete. 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 Processor -- start 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- start start 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd59a057e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6597b319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55dd599ff2f0 con 0x55dd599fe2e0 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd59a057e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd59a057e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33236/0 (socket says 172.21.15.193:33236) 2024-09-12T17:11:48.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.979+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 learned_addr learned my addr 172.21.15.193:0/1679310198 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:48.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd59a05d40 con 0x55dd599fe2e0 2024-09-12T17:11:48.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6594e36640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd59a057e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f65880aa6b0 tx=0x7f65880eb130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 -- 172.21.15.193:0/1679310198 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880e1070 con 0x55dd599fe2e0 2024-09-12T17:11:48.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dd59a05fd0 con 0x55dd599fe2e0 2024-09-12T17:11:48.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 -- 172.21.15.193:0/1679310198 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65880bf390 con 0x55dd599fe2e0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd59a06980 con 0x55dd599fe2e0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 -- 172.21.15.193:0/1679310198 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65880bf670 con 0x55dd599fe2e0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 -- 172.21.15.193:0/1679310198 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65880e4070 con 0x55dd599fe2e0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6460039a70 0x7f646003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f646affd640 1 -- 172.21.15.193:0/1679310198 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f65880d8040 con 0x55dd599fe2e0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6595e38640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6460039a70 0x7f646003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd59a10b30 0x55dd59a12fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a13710 con 0x55dd59a10b30 2024-09-12T17:11:48.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6595637640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd59a10b30 0x55dd59a12fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6595e38640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6460039a70 0x7f646003bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f659000f010 tx=0x7f659001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.983+0000 7f6595637640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd59a10b30 0x55dd59a12fc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 realm 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a13b20 con 0x55dd59a10b30 2024-09-12T17:11:48.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a143f0 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a14790 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a14fe0 con 0x55dd59a10b30 2024-09-12T17:11:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 20 searching for the correct realm 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55dd59a16d50 0x55dd59a19140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a16d50 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6594e36640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55dd59a16d50 0x55dd59a19140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6594e36640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55dd59a16d50 0x55dd59a19140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6594e36640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65880c9020 0x7f65880eb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f65880c9020 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595e38640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65880c9020 0x7f65880eb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595e38640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65880c9020 0x7f65880eb7d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595e38640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6590019040 0x7f6590019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:48.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f6590019040 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6590019040 0x7f6590019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.987+0000 7f6595637640 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6590019040 0x7f6590019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a10b30 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a10b30 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f6590019040 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f6590019040 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f65880c9020 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a16d50 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a10b30 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.991+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f6590019040 2024-09-12T17:11:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a10b30 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x7f65880c9020 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a16d50 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19680 con 0x55dd59a16d50 2024-09-12T17:11:49.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f6590019040 2024-09-12T17:11:49.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a16d50 2024-09-12T17:11:49.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a16d50 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a10b30 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a10b30 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.995+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f6590019040 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a16d50 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f65880c9020 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a10b30 2024-09-12T17:11:49.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f6590019040 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a16d50 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f6590019040 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f65880c9020 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a16d50 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f6590019040 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:48.999+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x55dd59a10b30 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6588107040 con 0x7f65880c9020 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:49.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a15960 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a161b0 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19ab0 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:49.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 zone default found 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 4 Realm: () 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 zonegroup default 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a19ab0 con 0x7f6590019040 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1b8c0 con 0x55dd59a16d50 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1bd80 con 0x55dd59a16d50 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 started sync module instance, tier type = 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:49.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1ad60 con 0x7f65880c9020 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.003+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409179902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1a9c0 con 0x7f65880c9020 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1ccb0 con 0x55dd59a10b30 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94409179902336] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409179906528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1ccb0 con 0x55dd59a10b30 2024-09-12T17:11:49.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.007+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1d670 con 0x55dd59a16d50 2024-09-12T17:11:49.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94409179906528] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409179908096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1cc20 con 0x55dd59a16d50 2024-09-12T17:11:49.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1e3c0 con 0x7f65880c9020 2024-09-12T17:11:49.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409179914304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1ec60 con 0x7f65880c9020 2024-09-12T17:11:49.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1f660 con 0x55dd59a10b30 2024-09-12T17:11:49.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94409179908096] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94409179914304] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409179912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1e7b0 con 0x55dd59a10b30 2024-09-12T17:11:49.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.011+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1ff30 con 0x7f6590019040 2024-09-12T17:11:49.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.015+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94409179912800] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.015+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.015+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409179918704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1e7b0 con 0x7f6590019040 2024-09-12T17:11:49.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.015+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a203d0 con 0x7f6590019040 2024-09-12T17:11:49.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94409179918704] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409179922112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a20390 con 0x7f6590019040 2024-09-12T17:11:49.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a20d90 con 0x7f6590019040 2024-09-12T17:11:49.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409179924640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a211b0 con 0x7f6590019040 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=0 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=1 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=2 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=3 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=4 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=5 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94409179922112] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.019+0000 7f6597b319c0 20 add_watcher() i=6 2024-09-12T17:11:49.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94409179924640] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 20 add_watcher() i=7 2024-09-12T17:11:49.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:49.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1f8a0 con 0x55dd59a10b30 2024-09-12T17:11:49.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409179920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a216f0 con 0x55dd59a10b30 2024-09-12T17:11:49.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94409179920544] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f644bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:49.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:49.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.023+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2cb00 con 0x55dd59a10b30 2024-09-12T17:11:49.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.027+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.027+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2cfb0 con 0x7f6590019040 2024-09-12T17:11:49.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.027+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.027+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2cfb0 con 0x55dd59a16d50 2024-09-12T17:11:49.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2d350 con 0x55dd59a10b30 2024-09-12T17:11:49.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2d350 con 0x7f65880c9020 2024-09-12T17:11:49.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.031+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2d8c0 con 0x55dd59a16d50 2024-09-12T17:11:49.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.035+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.035+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2dc60 con 0x55dd59a10b30 2024-09-12T17:11:49.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.035+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.035+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2dd30 con 0x7f6590019040 2024-09-12T17:11:49.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.039+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.039+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2dd30 con 0x7f65880c9020 2024-09-12T17:11:49.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.039+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.039+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2e2c0 con 0x55dd59a16d50 2024-09-12T17:11:49.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2e2a0 con 0x7f65880c9020 2024-09-12T17:11:49.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'49 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2e890 con 0x7f6590019040 2024-09-12T17:11:49.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.043+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2e810 con 0x7f65880c9020 2024-09-12T17:11:49.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.047+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'20 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.047+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea70 con 0x7f6590019040 2024-09-12T17:11:49.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.047+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.047+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a10b30 2024-09-12T17:11:49.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.051+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.051+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a16d50 2024-09-12T17:11:49.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.051+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.051+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x7f65880c9020 2024-09-12T17:11:49.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.055+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'50 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.055+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a16d50 2024-09-12T17:11:49.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.055+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.055+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a10b30 2024-09-12T17:11:49.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a10b30 2024-09-12T17:11:49.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x55dd59a16d50 2024-09-12T17:11:49.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.059+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2ea50 con 0x7f65880c9020 2024-09-12T17:11:49.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.063+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.063+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eae0 con 0x55dd59a16d50 2024-09-12T17:11:49.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.063+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.063+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eae0 con 0x55dd59a16d50 2024-09-12T17:11:49.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eae0 con 0x55dd59a16d50 2024-09-12T17:11:49.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eb40 con 0x55dd59a16d50 2024-09-12T17:11:49.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.067+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eb40 con 0x7f6590019040 2024-09-12T17:11:49.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.071+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.071+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eb20 con 0x55dd59a16d50 2024-09-12T17:11:49.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.075+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.075+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eae0 con 0x7f6590019040 2024-09-12T17:11:49.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.075+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'32 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.075+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eae0 con 0x55dd59a16d50 2024-09-12T17:11:49.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.079+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.079+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eb20 con 0x7f6590019040 2024-09-12T17:11:49.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.079+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.079+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2eb80 con 0x7f65880c9020 2024-09-12T17:11:49.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f644afe5640 20 reqs_thread_entry: start 2024-09-12T17:11:49.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6597b319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:49.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6597b319c0 20 Filter name: none 2024-09-12T17:11:49.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6448fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:49.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-12T17:11:49.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.083+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(94 gc.20 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:96 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(96 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(97 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(98 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.087+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(99 gc.20 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-12T17:11:49.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:100 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(100 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:101 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(101 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:102 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(102 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:103 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(103 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(104 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.091+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:105 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(105 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-12T17:11:49.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(106 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:107 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(107 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:108 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(108 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(109 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.095+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:110 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(110 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(111 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-12T17:11:49.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:112 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(112 gc.23 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:113 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(113 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:114 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(114 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.099+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:115 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(115 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:116 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(116 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:117 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(117 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-12T17:11:49.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:118 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(118 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:119 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(119 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.103+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:120 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(120 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:121 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(121 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:122 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(122 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:123 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(123 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-12T17:11:49.112 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:124 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.107+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== osd_op_reply(124 gc.25 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:125 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(125 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:126 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(126 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:127 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== osd_op_reply(127 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:128 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(128 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:129 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 55 ==== osd_op_reply(129 gc.25 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-12T17:11:49.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.111+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:130 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(130 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:131 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(131 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:132 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(132 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:133 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(133 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.115+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:134 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(134 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:135 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(135 gc.26 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-12T17:11:49.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.119+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:136 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 56 ==== osd_op_reply(136 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:137 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 57 ==== osd_op_reply(137 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:138 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 58 ==== osd_op_reply(138 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:139 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 59 ==== osd_op_reply(139 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:140 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 60 ==== osd_op_reply(140 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:141 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 61 ==== osd_op_reply(141 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-12T17:11:49.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.123+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:142 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(142 gc.28 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:143 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(143 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:144 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(144 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:145 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(145 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.127+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:146 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(146 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:147 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(147 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-12T17:11:49.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.131+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:148 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 62 ==== osd_op_reply(148 gc.29 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:149 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 63 ==== osd_op_reply(149 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:150 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 64 ==== osd_op_reply(150 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:151 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 65 ==== osd_op_reply(151 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:152 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 66 ==== osd_op_reply(152 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.135+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:153 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 67 ==== osd_op_reply(153 gc.29 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-12T17:11:49.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:154 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(154 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:155 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(155 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.139+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:156 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(156 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:157 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(157 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:158 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(158 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.143+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:159 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(159 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-12T17:11:49.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:160 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(160 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:161 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(161 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.147+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:162 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(162 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:163 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(163 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:164 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(164 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:165 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(165 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-12T17:11:49.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.151+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:166 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(166 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:167 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(167 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:168 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(168 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:169 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(169 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(170 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.155+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:171 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.159+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(171 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.159+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-12T17:11:49.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.159+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:172 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(172 gc.1 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:173 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(173 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:174 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(174 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:175 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== osd_op_reply(175 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:176 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(176 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.163+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:177 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.167+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(177 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.167+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-12T17:11:49.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.167+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:178 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 68 ==== osd_op_reply(178 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:179 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 69 ==== osd_op_reply(179 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:180 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 70 ==== osd_op_reply(180 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:181 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 71 ==== osd_op_reply(181 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:182 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 72 ==== osd_op_reply(182 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.171+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:183 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 73 ==== osd_op_reply(183 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-12T17:11:49.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:184 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(184 gc.3 [call] v34'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:185 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(185 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:186 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(186 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:187 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(187 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.175+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:188 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(188 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:189 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(189 gc.3 [call] v34'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-12T17:11:49.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.179+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:190 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(190 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:191 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(191 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:192 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(192 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:193 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(193 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.183+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:194 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(194 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:195 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(195 gc.4 [call] v34'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-12T17:11:49.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.187+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:196 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 74 ==== osd_op_reply(196 gc.5 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:197 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 75 ==== osd_op_reply(197 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:198 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 76 ==== osd_op_reply(198 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:199 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 77 ==== osd_op_reply(199 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:200 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 78 ==== osd_op_reply(200 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.191+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:201 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.195+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 79 ==== osd_op_reply(201 gc.5 [call] v34'37 uv37 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.195+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-12T17:11:49.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.195+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:202 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.195+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(202 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.195+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:203 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(203 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:204 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(204 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:205 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(205 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:206 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== osd_op_reply(206 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.199+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:207 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a10b30 2024-09-12T17:11:49.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(207 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-12T17:11:49.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:208 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 48 ==== osd_op_reply(208 gc.7 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:209 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 49 ==== osd_op_reply(209 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.203+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:210 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 50 ==== osd_op_reply(210 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:211 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 51 ==== osd_op_reply(211 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:212 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 52 ==== osd_op_reply(212 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:213 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 53 ==== osd_op_reply(213 gc.7 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-12T17:11:49.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.207+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:214 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.211+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(214 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.211+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:215 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.211+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(215 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.211+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.211+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:216 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 38 ==== osd_op_reply(216 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:217 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 39 ==== osd_op_reply(217 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:218 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 40 ==== osd_op_reply(218 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.215+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:219 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 41 ==== osd_op_reply(219 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-12T17:11:49.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:220 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 80 ==== osd_op_reply(220 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:221 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 81 ==== osd_op_reply(221 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:222 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 82 ==== osd_op_reply(222 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.219+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:223 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 83 ==== osd_op_reply(223 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:224 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 84 ==== osd_op_reply(224 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:225 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x55dd59a16d50 2024-09-12T17:11:49.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 85 ==== osd_op_reply(225 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-12T17:11:49.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.223+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:226 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 42 ==== osd_op_reply(226 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:227 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 43 ==== osd_op_reply(227 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:228 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 44 ==== osd_op_reply(228 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:229 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 45 ==== osd_op_reply(229 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:230 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 46 ==== osd_op_reply(230 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.227+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:231 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.231+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 47 ==== osd_op_reply(231 gc.10 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.231+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-12T17:11:49.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.231+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:232 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.231+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 54 ==== osd_op_reply(232 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:233 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 55 ==== osd_op_reply(233 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:234 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 56 ==== osd_op_reply(234 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:235 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 57 ==== osd_op_reply(235 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:236 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 58 ==== osd_op_reply(236 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.235+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:237 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f6590019040 2024-09-12T17:11:49.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.239+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 59 ==== osd_op_reply(237 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.239+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-12T17:11:49.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.239+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:238 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 48 ==== osd_op_reply(238 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:239 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 49 ==== osd_op_reply(239 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:240 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 50 ==== osd_op_reply(240 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:241 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 51 ==== osd_op_reply(241 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:242 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a2c5d0 con 0x7f65880c9020 2024-09-12T17:11:49.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 52 ==== osd_op_reply(242 gc.12 [call out=1702b] v0'0 uv21 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 20 garbage collection: RGWGC::process iterating over entry tag='51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15037132847887650165', time=2024-09-12T17:11:48.600177+0000, chain.objs.size()=7 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__1 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:243 3.2cs0 3:35eaea70:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4b6c0 con 0x55dd59a16d50 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__2 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:244 3.3ds0 3:bcdb2a8e:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4e010 con 0x55dd59a16d50 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__3 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:245 3.9s0 3:922b1041:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a50950 con 0x55dd59a16d50 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__4 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:246 3.33s0 3:cd600e04:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a50950 con 0x7f6590019040 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__5 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:247 3.8s0 3:1086c35f:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a557d0 con 0x55dd59a16d50 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__6 2024-09-12T17:11:49.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:248 3.21s0 3:86470f9f:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a580e0 con 0x7f6590019040 2024-09-12T17:11:49.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__7 2024-09-12T17:11:49.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.243+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:249 3.1as0 3:595f12cc:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a5a950 con 0x55dd59a10b30 2024-09-12T17:11:49.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.247+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(249 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.251+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 60 ==== osd_op_reply(246 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__4 [call] v34'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.251+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 86 ==== osd_op_reply(245 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.251+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 87 ==== osd_op_reply(244 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.251+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 88 ==== osd_op_reply(243 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.251+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 89 ==== osd_op_reply(247 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.255+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 61 ==== osd_op_reply(248 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.1__shadow_.wgRXk94aRivfnOjt-LfP03esCiO90r__6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.255+0000 7f6597b319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:11:49.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.255+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.259+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 53 ==== osd_op_reply(250 gc.12 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.259+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.263+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 54 ==== osd_op_reply(251 gc.12 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.263+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-12T17:11:49.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.263+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:252 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f6590019040 2024-09-12T17:11:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 62 ==== osd_op_reply(252 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:253 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f6590019040 2024-09-12T17:11:49.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 63 ==== osd_op_reply(253 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:254 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4a6b0 con 0x7f6590019040 2024-09-12T17:11:49.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 64 ==== osd_op_reply(254 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:255 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f6590019040 2024-09-12T17:11:49.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 65 ==== osd_op_reply(255 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.267+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f6590019040 2024-09-12T17:11:49.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 66 ==== osd_op_reply(256 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f6590019040 2024-09-12T17:11:49.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 67 ==== osd_op_reply(257 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-12T17:11:49.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.271+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:258 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== osd_op_reply(258 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:259 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(259 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:260 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4a6b0 con 0x55dd59a10b30 2024-09-12T17:11:49.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 50 ==== osd_op_reply(260 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:261 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 51 ==== osd_op_reply(261 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 52 ==== osd_op_reply(262 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.275+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.279+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 53 ==== osd_op_reply(263 gc.14 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.279+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-12T17:11:49.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.279+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:264 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.279+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 90 ==== osd_op_reply(264 gc.15 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:265 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 91 ==== osd_op_reply(265 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:266 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4a6b0 con 0x55dd59a16d50 2024-09-12T17:11:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 92 ==== osd_op_reply(266 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:267 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 93 ==== osd_op_reply(267 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 94 ==== osd_op_reply(268 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.283+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 95 ==== osd_op_reply(269 gc.15 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-12T17:11:49.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:270 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 55 ==== osd_op_reply(270 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:271 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 56 ==== osd_op_reply(271 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:272 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 57 ==== osd_op_reply(272 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.287+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:273 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 58 ==== osd_op_reply(273 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 59 ==== osd_op_reply(274 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x7f65880c9020 2024-09-12T17:11:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 60 ==== osd_op_reply(275 gc.16 [call] v34'56 uv56 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-12T17:11:49.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.291+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:276 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 96 ==== osd_op_reply(276 gc.17 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:277 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 97 ==== osd_op_reply(277 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:278 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4a6b0 con 0x55dd59a16d50 2024-09-12T17:11:49.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 98 ==== osd_op_reply(278 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:279 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 99 ==== osd_op_reply(279 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:280 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 100 ==== osd_op_reply(280 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.295+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:281 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a16d50 2024-09-12T17:11:49.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.299+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 101 ==== osd_op_reply(281 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.299+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-12T17:11:49.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.299+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:282 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.299+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 54 ==== osd_op_reply(282 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.299+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:283 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 55 ==== osd_op_reply(283 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:284 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 56 ==== osd_op_reply(284 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:285 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 57 ==== osd_op_reply(285 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:286 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 58 ==== osd_op_reply(286 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:287 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 59 ==== osd_op_reply(287 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-12T17:11:49.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.303+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:288 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 60 ==== osd_op_reply(288 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:289 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 61 ==== osd_op_reply(289 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:290 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 62 ==== osd_op_reply(290 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:291 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 63 ==== osd_op_reply(291 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:11:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.307+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:292 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 64 ==== osd_op_reply(292 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f6597b319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:11:49.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:293 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a4ba60 con 0x55dd59a10b30 2024-09-12T17:11:49.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 65 ==== osd_op_reply(293 gc.19 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f644bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.311+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409179920544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a26f50 con 0x55dd59a10b30 2024-09-12T17:11:49.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94409179920544] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409179902336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1f8a0 con 0x7f65880c9020 2024-09-12T17:11:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94409179902336] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6597b319c0 20 remove_watcher() i=0 2024-09-12T17:11:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6597b319c0 2 removed watcher, disabling cache 2024-09-12T17:11:49.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.315+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409179906528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1b180 con 0x55dd59a10b30 2024-09-12T17:11:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.319+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94409179906528] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.319+0000 7f6597b319c0 20 remove_watcher() i=1 2024-09-12T17:11:49.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.319+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409179908096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1c1e0 con 0x55dd59a16d50 2024-09-12T17:11:49.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6594e36640 1 -- 172.21.15.193:0/1679310198 <== osd.3 v2:172.21.15.193:6816/1944991354 102 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94409179908096] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65880e3030 con 0x55dd59a16d50 2024-09-12T17:11:49.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6597b319c0 20 remove_watcher() i=2 2024-09-12T17:11:49.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409179914304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1c1e0 con 0x7f65880c9020 2024-09-12T17:11:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6595e38640 1 -- 172.21.15.193:0/1679310198 <== osd.2 v2:172.21.15.193:6800/1491583795 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94409179914304] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f659002f040 con 0x7f65880c9020 2024-09-12T17:11:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6597b319c0 20 remove_watcher() i=3 2024-09-12T17:11:49.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.323+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409179912800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1c1e0 con 0x55dd59a10b30 2024-09-12T17:11:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.1 v2:172.21.15.193:6808/1040547927 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94409179912800] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x55dd59a10b30 2024-09-12T17:11:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6597b319c0 20 remove_watcher() i=4 2024-09-12T17:11:49.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409179918704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1da60 con 0x7f6590019040 2024-09-12T17:11:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 68 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94409179918704] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6597b319c0 20 remove_watcher() i=5 2024-09-12T17:11:49.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.327+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409179922112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1c1e0 con 0x7f6590019040 2024-09-12T17:11:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.331+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 69 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94409179922112] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.331+0000 7f6597b319c0 20 remove_watcher() i=6 2024-09-12T17:11:49.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.331+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409179924640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dd59a1da60 con 0x7f6590019040 2024-09-12T17:11:49.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.331+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 <== osd.0 v2:172.21.15.62:6800/4046570222 70 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94409179924640] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f658002e070 con 0x7f6590019040 2024-09-12T17:11:49.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.331+0000 7f6597b319c0 20 remove_watcher() i=7 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6590019040 msgr2=0x7f6590019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6590019040 0x7f6590019930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd59a10b30 msgr2=0x55dd59a12fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd59a10b30 0x55dd59a12fc0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65880c9020 msgr2=0x7f65880eb7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65880c9020 0x7f65880eb7d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55dd59a16d50 msgr2=0x55dd59a19140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55dd59a16d50 0x55dd59a19140 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6460039a70 msgr2=0x7f646003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6460039a70 0x7f646003bf30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f659000f010 tx=0x7f659001b070 comp rx=0 tx=0).stop 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 msgr2=0x55dd59a057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/1679310198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599fe2e0 0x55dd59a057e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f65880aa6b0 tx=0x7f65880eb130 comp rx=0 tx=0).stop 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6595637640 1 -- 172.21.15.193:0/1679310198 reap_dead start 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 shutdown_connections 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 >> 172.21.15.193:0/1679310198 conn(0x55dd599fa710 msgr2=0x55dd599f8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 shutdown_connections 2024-09-12T17:11:49.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/1679310198 wait complete. 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 msgr2=0x7f646c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 0x7f646c03bf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55dd599e2500 tx=0x7f6590003070 comp rx=0 tx=0).stop 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 msgr2=0x55dd599f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6588000f90 tx=0x7f6588017e30 comp rx=0 tx=0).stop 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 shutdown_connections 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f646c039ac0 0x7f646c03bf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/2148447591 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd599f1ac0 0x55dd599f1ee0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 >> 172.21.15.193:0/2148447591 conn(0x55dd599e7470 msgr2=0x55dd599e7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 shutdown_connections 2024-09-12T17:11:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/2148447591 wait complete. 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 msgr2=0x55dd599e15d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 0x55dd599e15d0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 msgr2=0x7f647c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 0x7f647c03bf80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f65880ab000 tx=0x7f65880a5000 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 msgr2=0x55dd599da170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55dd599d3720 tx=0x7f6580000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 shutdown_connections 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55dd599df1e0 0x55dd599e15d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039ac0 0x7f647c03bf80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 --2- 172.21.15.193:0/292467055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55dd598eb320 0x55dd599da170 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 >> 172.21.15.193:0/292467055 conn(0x55dd598e18f0 msgr2=0x55dd599d3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 shutdown_connections 2024-09-12T17:11:49.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.335+0000 7f6597b319c0 1 -- 172.21.15.193:0/292467055 wait complete. 2024-09-12T17:11:49.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-12T17:11:49.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-12T17:11:49.357 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-12T17:11:49.434 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:49.435 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b965249c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56265c7bb200 0x56265c7bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b965249c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56265c66d9c0 con 0x56265c7be340 2024-09-12T17:11:49.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b965249c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56265c6bd6d0 con 0x56265c7bb200 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b9402a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56265c7bb200 0x56265c7bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b9402a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56265c7bb200 0x56265c7bb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33238/0 (socket says 172.21.15.193:33238) 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b93829640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56265c7be340 0x56265c7c0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47526/0 (socket says 172.21.15.193:47526) 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b9402a640 1 -- 172.21.15.193:0/3048353650 learned_addr learned my addr 172.21.15.193:0/3048353650 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b9402a640 1 -- 172.21.15.193:0/3048353650 >> v1:172.21.15.62:6789/0 conn(0x56265c7be340 legacy=0x56265c7c0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.431+0000 7f4b9402a640 1 -- 172.21.15.193:0/3048353650 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c661ca0 con 0x56265c7bb200 2024-09-12T17:11:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b9402a640 1 --2- 172.21.15.193:0/3048353650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c7bb5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400a5c0 tx=0x7f4b8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3799104965950e13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b93028640 1 -- 172.21.15.193:0/3048353650 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840a6070 con 0x56265c7bb200 2024-09-12T17:11:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b93028640 1 -- 172.21.15.193:0/3048353650 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b840af070 con 0x56265c7bb200 2024-09-12T17:11:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b93028640 1 -- 172.21.15.193:0/3048353650 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840aa5c0 con 0x56265c7bb200 2024-09-12T17:11:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 -- 172.21.15.193:0/3048353650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 msgr2=0x56265c7bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3048353650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c7bb5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b8400a5c0 tx=0x7f4b8401b340 comp rx=0 tx=0).stop 2024-09-12T17:11:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 -- 172.21.15.193:0/3048353650 shutdown_connections 2024-09-12T17:11:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3048353650 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c7bb5e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 -- 172.21.15.193:0/3048353650 >> 172.21.15.193:0/3048353650 conn(0x56265c72eb10 msgr2=0x56265c72ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 -- 172.21.15.193:0/3048353650 shutdown_connections 2024-09-12T17:11:49.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.435+0000 7f4b965249c0 1 -- 172.21.15.193:0/3048353650 wait complete. 2024-09-12T17:11:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.451+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.451+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.451+0000 7f4b965249c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.451+0000 7f4b965249c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56265c6c1680 con 0x56265c7bb200 2024-09-12T17:11:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.451+0000 7f4b9402a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33254/0 (socket says 172.21.15.193:33254) 2024-09-12T17:11:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 -- 172.21.15.193:0/78236992 learned_addr learned my addr 172.21.15.193:0/78236992 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 -- 172.21.15.193:0/78236992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c63cda0 con 0x56265c7bb200 2024-09-12T17:11:49.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 --2- 172.21.15.193:0/78236992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b840ac040 tx=0x7f4b84003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5fa0f1d903cd77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4a8260c640 1 -- 172.21.15.193:0/78236992 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840aa970 con 0x56265c7bb200 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4a8260c640 1 -- 172.21.15.193:0/78236992 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b840aab10 con 0x56265c7bb200 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4a8260c640 1 -- 172.21.15.193:0/78236992 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840aae30 con 0x56265c7bb200 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- 172.21.15.193:0/78236992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 msgr2=0x56265c8a6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 --2- 172.21.15.193:0/78236992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b840ac040 tx=0x7f4b84003030 comp rx=0 tx=0).stop 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- 172.21.15.193:0/78236992 shutdown_connections 2024-09-12T17:11:49.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 --2- 172.21.15.193:0/78236992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7bb200 0x56265c8a6870 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- 172.21.15.193:0/78236992 >> 172.21.15.193:0/78236992 conn(0x56265c72eb10 msgr2=0x56265c8a2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- 172.21.15.193:0/78236992 shutdown_connections 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- 172.21.15.193:0/78236992 wait complete. 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b965249c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56265c663a50 con 0x56265c7be340 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33270/0 (socket says 172.21.15.193:33270) 2024-09-12T17:11:49.461 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 -- 172.21.15.193:0/3800409613 learned_addr learned my addr 172.21.15.193:0/3800409613 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c8ae5e0 con 0x56265c7be340 2024-09-12T17:11:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.455+0000 7f4b9402a640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b8401b170 tx=0x7f4b840180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 -- 172.21.15.193:0/3800409613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840c6690 con 0x56265c7be340 2024-09-12T17:11:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56265c8ae870 con 0x56265c7be340 2024-09-12T17:11:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 -- 172.21.15.193:0/3800409613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b840cc070 con 0x56265c7be340 2024-09-12T17:11:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 -- 172.21.15.193:0/3800409613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b840c6830 con 0x56265c7be340 2024-09-12T17:11:49.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56265c8af180 con 0x56265c7be340 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 -- 172.21.15.193:0/3800409613 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4b840c6ae0 con 0x56265c7be340 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 0x7f4a7c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4a80e09640 1 -- 172.21.15.193:0/3800409613 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4b840ebeb0 con 0x56265c7be340 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b93829640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 0x7f4a7c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 0x56265c8b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8b5a70 con 0x56265c8b3140 2024-09-12T17:11:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b9482b640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 0x56265c8b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b93829640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 0x7f4a7c03bf80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b88001e40 tx=0x7f4b880013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b9482b640 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 0x56265c8b5530 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b9482b640 1 -- 172.21.15.193:0/3800409613 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b8c00a4d0 con 0x56265c8b3140 2024-09-12T17:11:49.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8b5ee0 con 0x56265c8b3140 2024-09-12T17:11:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b9482b640 1 -- 172.21.15.193:0/3800409613 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b8c00a4d0 con 0x56265c8b3140 2024-09-12T17:11:49.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8b77e0 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b9482b640 1 -- 172.21.15.193:0/3800409613 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b8c00a4d0 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.459+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8b6a10 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b9482b640 1 -- 172.21.15.193:0/3800409613 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b8c00a4d0 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8b6e60 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b9482b640 1 -- 172.21.15.193:0/3800409613 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b8c00a4d0 con 0x56265c8b3140 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56265c6ce450 con 0x56265c8c5ae0 2024-09-12T17:11:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33272/0 (socket says 172.21.15.193:33272) 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b93829640 1 -- 172.21.15.193:0/30669045 learned_addr learned my addr 172.21.15.193:0/30669045 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b93829640 1 -- 172.21.15.193:0/30669045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c8c6540 con 0x56265c8c5ae0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b93829640 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800e670 tx=0x7f4b8800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4a79ffb640 1 -- 172.21.15.193:0/30669045 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88022070 con 0x56265c8c5ae0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56265c8c6da0 con 0x56265c8c5ae0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4a79ffb640 1 -- 172.21.15.193:0/30669045 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8800d660 con 0x56265c8c5ae0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4a79ffb640 1 -- 172.21.15.193:0/30669045 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b88006070 con 0x56265c8c5ae0 2024-09-12T17:11:49.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.463+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56265c8c7310 con 0x56265c8c5ae0 2024-09-12T17:11:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a79ffb640 1 -- 172.21.15.193:0/30669045 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4b88025070 con 0x56265c8c5ae0 2024-09-12T17:11:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a79ffb640 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 0x7f4a6c03bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a79ffb640 1 -- 172.21.15.193:0/30669045 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4b88051ba0 con 0x56265c8c5ae0 2024-09-12T17:11:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b9482b640 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 0x7f4a6c03bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b9482b640 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 0x7f4a6c03bf70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56265c8b6530 tx=0x7f4b8c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56265c8a7000 con 0x56265c8d2440 2024-09-12T17:11:49.471 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33280/0 (socket says 172.21.15.193:33280) 2024-09-12T17:11:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b93829640 1 -- 172.21.15.193:0/2303360362 learned_addr learned my addr 172.21.15.193:0/2303360362 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b93829640 1 -- 172.21.15.193:0/2303360362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c8d2df0 con 0x56265c8d2440 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b93829640 1 --2- 172.21.15.193:0/2303360362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4b8804fe70 tx=0x7f4b88024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340e6f0f6f01c1ad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a737fe640 1 -- 172.21.15.193:0/2303360362 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b880263b0 con 0x56265c8d2440 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a737fe640 1 -- 172.21.15.193:0/2303360362 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8804d020 con 0x56265c8d2440 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4a737fe640 1 -- 172.21.15.193:0/2303360362 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8800dcc0 con 0x56265c8d2440 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- 172.21.15.193:0/2303360362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 msgr2=0x56265c8d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 --2- 172.21.15.193:0/2303360362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f4b8804fe70 tx=0x7f4b88024c90 comp rx=0 tx=0).stop 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- 172.21.15.193:0/2303360362 shutdown_connections 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 --2- 172.21.15.193:0/2303360362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d2820 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- 172.21.15.193:0/2303360362 >> 172.21.15.193:0/2303360362 conn(0x56265c8ce870 msgr2=0x56265c8ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- 172.21.15.193:0/2303360362 shutdown_connections 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 -- 172.21.15.193:0/2303360362 wait complete. 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.467+0000 7f4b965249c0 1 Processor -- start 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 -- start start 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56265c8d3450 con 0x56265c8d2440 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b93829640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33296/0 (socket says 172.21.15.193:33296) 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 learned_addr learned my addr 172.21.15.193:0/4185591068 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56265c8d9f40 con 0x56265c8d2440 2024-09-12T17:11:49.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b93829640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b88024d20 tx=0x7f4b8804fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 -- 172.21.15.193:0/4185591068 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8801a320 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56265c8da1d0 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 -- 172.21.15.193:0/4185591068 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b8801a4c0 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 -- 172.21.15.193:0/4185591068 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8801a7e0 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56265c8da1d0 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 -- 172.21.15.193:0/4185591068 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4b8801b8c0 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a64039a20 0x7f4a6403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4a71ffb640 1 -- 172.21.15.193:0/4185591068 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4b88047040 con 0x56265c8d2440 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b9482b640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a64039a20 0x7f4a6403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8e4b20 0x56265c8e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e76e0 con 0x56265c8e4b20 2024-09-12T17:11:49.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b9402a640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8e4b20 0x56265c8e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b9482b640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a64039a20 0x7f4a6403bee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56265c8af6a0 tx=0x7f4b8c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.471+0000 7f4b9402a640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8e4b20 0x56265c8e6f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 realm 2024-09-12T17:11:49.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e7af0 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e83c0 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8760 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:49.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 20 searching for the correct realm 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56265c8eab70 0x56265c8ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ed570 con 0x56265c8eab70 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b93829640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56265c8eab70 0x56265c8ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b93829640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56265c8eab70 0x56265c8ecf60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b93829640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4b88027060 0x7f4b88051410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ed570 con 0x7f4b88027060 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9482b640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4b88027060 0x7f4b88051410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9482b640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4b88027060 0x7f4b88051410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9482b640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4b8c031040 0x7f4b8c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ed570 con 0x7f4b8c031040 2024-09-12T17:11:49.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.475+0000 7f4b9402a640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4b8c031040 0x7f4b8c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4b8c031040 0x7f4b8c032430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b88027060 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.479+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b88027060 2024-09-12T17:11:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.490 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.483+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b88027060 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b88027060 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.487+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8eab70 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b8c031040 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x56265c8e4b20 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e8c00 con 0x7f4b88027060 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b8c01f070 con 0x7f4b88027060 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:49.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e94e0 con 0x56265c8e4b20 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e98d0 con 0x56265c8e4b20 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e98d0 con 0x56265c8e4b20 2024-09-12T17:11:49.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 zone default found 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 4 Realm: () 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 zonegroup default 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e9cf0 con 0x7f4b8c031040 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8e9cf0 con 0x56265c8eab70 2024-09-12T17:11:49.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ef3e0 con 0x56265c8eab70 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 started sync module instance, tier type = 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:49.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.491+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ee880 con 0x7f4b88027060 2024-09-12T17:11:49.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94722761616544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8efcc0 con 0x7f4b88027060 2024-09-12T17:11:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f0510 con 0x56265c8e4b20 2024-09-12T17:11:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94722761616544] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94722761619472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f01c0 con 0x56265c8e4b20 2024-09-12T17:11:49.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.495+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f0ce0 con 0x56265c8eab70 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94722761619472] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94722761623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f10d0 con 0x56265c8eab70 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f1a90 con 0x7f4b88027060 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94722761627376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f2160 con 0x7f4b88027060 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.499+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f2c60 con 0x56265c8e4b20 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94722761623472] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94722761627376] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94722761631568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f2c20 con 0x56265c8e4b20 2024-09-12T17:11:49.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f3080 con 0x7f4b8c031040 2024-09-12T17:11:49.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94722761631568] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94722761628592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8efc70 con 0x7f4b8c031040 2024-09-12T17:11:49.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.503+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f3980 con 0x7f4b8c031040 2024-09-12T17:11:49.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.507+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94722761628592] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.507+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.507+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94722761634928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f3940 con 0x7f4b8c031040 2024-09-12T17:11:49.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.507+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f4360 con 0x7f4b8c031040 2024-09-12T17:11:49.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94722761637456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f47d0 con 0x7f4b8c031040 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=0 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=1 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=2 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=3 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=4 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=5 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94722761634928] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=6 2024-09-12T17:11:49.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94722761637456] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 20 add_watcher() i=7 2024-09-12T17:11:49.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:49.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f2d30 con 0x56265c8e4b20 2024-09-12T17:11:49.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94722761633072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f4ce0 con 0x56265c8e4b20 2024-09-12T17:11:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94722761633072] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.511+0000 7f4a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.515+0000 7f4b965249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.515+0000 7f4b965249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:49.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.515+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f9b60 con 0x56265c8e4b20 2024-09-12T17:11:49.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.515+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.515+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c9002e0 con 0x7f4b8c031040 2024-09-12T17:11:49.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c9001a0 con 0x56265c8eab70 2024-09-12T17:11:49.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c900620 con 0x56265c8e4b20 2024-09-12T17:11:49.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.519+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c900820 con 0x7f4b88027060 2024-09-12T17:11:49.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'57 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901270 con 0x56265c8eab70 2024-09-12T17:11:49.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901610 con 0x56265c8e4b20 2024-09-12T17:11:49.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.523+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901610 con 0x7f4b8c031040 2024-09-12T17:11:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.527+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.527+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901610 con 0x7f4b88027060 2024-09-12T17:11:49.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901b80 con 0x56265c8eab70 2024-09-12T17:11:49.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c901f20 con 0x7f4b88027060 2024-09-12T17:11:49.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'58 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.531+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902490 con 0x7f4b8c031040 2024-09-12T17:11:49.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.535+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.535+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902490 con 0x7f4b88027060 2024-09-12T17:11:49.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.535+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.535+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b8c031040 2024-09-12T17:11:49.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.539+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.539+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8e4b20 2024-09-12T17:11:49.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.539+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.539+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b88027060 2024-09-12T17:11:49.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.543+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8e4b20 2024-09-12T17:11:49.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.547+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.547+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8e4b20 2024-09-12T17:11:49.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.547+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.547+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.551+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.551+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b88027060 2024-09-12T17:11:49.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.551+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.551+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.555+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.559+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.559+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b8c031040 2024-09-12T17:11:49.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.559+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.559+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.563+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.563+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b8c031040 2024-09-12T17:11:49.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.567+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.567+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x56265c8eab70 2024-09-12T17:11:49.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.567+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.567+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b8c031040 2024-09-12T17:11:49.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.571+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.571+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c902940 con 0x7f4b88027060 2024-09-12T17:11:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.571+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4a497e2640 20 reqs_thread_entry: start 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 20 Filter name: none 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f49baffd640 20 reqs_thread_entry: start 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.575+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.579+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv37 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv37 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.583+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.587+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.591+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.595+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.599+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.603+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8e4b20 2024-09-12T17:11:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.607+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.611+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.615+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.619+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8eab70 2024-09-12T17:11:49.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x56265c8eab70 2024-09-12T17:11:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.623+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b8c031040 2024-09-12T17:11:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b8c031040 2024-09-12T17:11:49.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x7f4b88027060 2024-09-12T17:11:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ffd10 con 0x7f4b88027060 2024-09-12T17:11:49.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.627+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.631+0000 7f4a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.631+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94722761633072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8ff1b0 con 0x56265c8e4b20 2024-09-12T17:11:49.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.631+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94722761633072] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.631+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94722761616544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f2d30 con 0x7f4b88027060 2024-09-12T17:11:49.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94722761616544] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b965249c0 20 remove_watcher() i=0 2024-09-12T17:11:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b965249c0 2 removed watcher, disabling cache 2024-09-12T17:11:49.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94722761619472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8eeca0 con 0x56265c8e4b20 2024-09-12T17:11:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94722761619472] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b965249c0 20 remove_watcher() i=1 2024-09-12T17:11:49.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.635+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94722761623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8eeca0 con 0x56265c8eab70 2024-09-12T17:11:49.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b93829640 1 -- 172.21.15.193:0/4185591068 <== osd.3 v2:172.21.15.193:6816/1944991354 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94722761623472] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b88031020 con 0x56265c8eab70 2024-09-12T17:11:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b965249c0 20 remove_watcher() i=2 2024-09-12T17:11:49.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94722761627376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8eeca0 con 0x7f4b88027060 2024-09-12T17:11:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b9482b640 1 -- 172.21.15.193:0/4185591068 <== osd.2 v2:172.21.15.193:6800/1491583795 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94722761627376] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b8c040040 con 0x7f4b88027060 2024-09-12T17:11:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b965249c0 20 remove_watcher() i=3 2024-09-12T17:11:49.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.639+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94722761631568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f16f0 con 0x56265c8e4b20 2024-09-12T17:11:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94722761631568] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x56265c8e4b20 2024-09-12T17:11:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b965249c0 20 remove_watcher() i=4 2024-09-12T17:11:49.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94722761628592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8eeca0 con 0x7f4b8c031040 2024-09-12T17:11:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94722761628592] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b965249c0 20 remove_watcher() i=5 2024-09-12T17:11:49.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.643+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94722761634928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8f16f0 con 0x7f4b8c031040 2024-09-12T17:11:49.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.647+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94722761634928] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.647+0000 7f4b965249c0 20 remove_watcher() i=6 2024-09-12T17:11:49.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.647+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94722761637456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56265c8eeca0 con 0x7f4b8c031040 2024-09-12T17:11:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94722761637456] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b840cf370 con 0x7f4b8c031040 2024-09-12T17:11:49.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 20 remove_watcher() i=7 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4b8c031040 msgr2=0x7f4b8c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f4b8c031040 0x7f4b8c032430 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8e4b20 msgr2=0x56265c8e6f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8e4b20 0x56265c8e6f90 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4b88027060 msgr2=0x7f4b88051410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f4b88027060 0x7f4b88051410 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56265c8eab70 msgr2=0x56265c8ecf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56265c8eab70 0x56265c8ecf60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a64039a20 msgr2=0x7f4a6403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a64039a20 0x7f4a6403bee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56265c8af6a0 tx=0x7f4b8c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b9402a640 1 -- 172.21.15.193:0/4185591068 reap_dead start 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 msgr2=0x56265c8d99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b88024d20 tx=0x7f4b8804fdd0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 shutdown_connections 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/4185591068 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8d2440 0x56265c8d99e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 >> 172.21.15.193:0/4185591068 conn(0x56265c8ce870 msgr2=0x56265c8cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 shutdown_connections 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/4185591068 wait complete. 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 msgr2=0x7f4a6c03bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 0x7f4a6c03bf70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56265c8b6530 tx=0x7f4b8c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 msgr2=0x56265c8c5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4b8800e670 tx=0x7f4b8800ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 shutdown_connections 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a6c039ab0 0x7f4a6c03bf70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/30669045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c8c5ae0 0x56265c8c5f00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 >> 172.21.15.193:0/30669045 conn(0x56265c8bb490 msgr2=0x56265c8bb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 shutdown_connections 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/30669045 wait complete. 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 msgr2=0x56265c8b5530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 0x56265c8b5530 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 msgr2=0x7f4a7c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 0x7f4a7c03bf80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b88001e40 tx=0x7f4b880013a0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 msgr2=0x56265c8ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b8401b170 tx=0x7f4b840180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 shutdown_connections 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56265c8b3140 0x56265c8b5530 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4a7c039ac0 0x7f4a7c03bf80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 --2- 172.21.15.193:0/3800409613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56265c7be340 0x56265c8ae080 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 >> 172.21.15.193:0/3800409613 conn(0x56265c72eb10 msgr2=0x56265c8a0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 shutdown_connections 2024-09-12T17:11:49.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.651+0000 7f4b965249c0 1 -- 172.21.15.193:0/3800409613 wait complete. 2024-09-12T17:11:49.674 INFO:teuthology.orchestra.run.smithi193.stdout:[] 2024-09-12T17:11:49.674 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T17:11:49.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:49.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:49.675 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:11:49.755 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:49.755 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:49.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a36b769c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f1def335e0 0x55f1defc7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a36b769c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1dee739c0 con 0x55f1def33200 2024-09-12T17:11:49.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a36b769c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f1deec36d0 con 0x55f1def335e0 2024-09-12T17:11:49.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a33e7b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f1def335e0 0x55f1defc7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a33e7b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f1def335e0 0x55f1defc7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33300/0 (socket says 172.21.15.193:33300) 2024-09-12T17:11:49.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a33e7b640 1 -- 172.21.15.193:0/2210681588 learned_addr learned my addr 172.21.15.193:0/2210681588 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a3467c640 1 --1- 172.21.15.193:0/2210681588 >> v1:172.21.15.62:6789/0 conn(0x55f1def33200 0x55f1defc4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47530/0 (socket says 172.21.15.193:47530) 2024-09-12T17:11:49.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a33e7b640 1 -- 172.21.15.193:0/2210681588 >> v1:172.21.15.62:6789/0 conn(0x55f1def33200 legacy=0x55f1defc4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.751+0000 7f6a33e7b640 1 -- 172.21.15.193:0/2210681588 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dee67ca0 con 0x55f1def335e0 2024-09-12T17:11:49.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/2210681588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def335e0 0x55f1defc7760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800a5c0 tx=0x7f6a2801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71db87363fa7b64a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a3367a640 1 -- 172.21.15.193:0/2210681588 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280a6070 con 0x55f1def335e0 2024-09-12T17:11:49.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a3367a640 1 -- 172.21.15.193:0/2210681588 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280af070 con 0x55f1def335e0 2024-09-12T17:11:49.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a3367a640 1 -- 172.21.15.193:0/2210681588 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280aa5c0 con 0x55f1def335e0 2024-09-12T17:11:49.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 -- 172.21.15.193:0/2210681588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def335e0 msgr2=0x55f1defc7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/2210681588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def335e0 0x55f1defc7760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800a5c0 tx=0x7f6a2801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:49.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 -- 172.21.15.193:0/2210681588 shutdown_connections 2024-09-12T17:11:49.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/2210681588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def335e0 0x55f1defc7760 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 -- 172.21.15.193:0/2210681588 >> 172.21.15.193:0/2210681588 conn(0x55f1defb9920 msgr2=0x55f1defbbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 -- 172.21.15.193:0/2210681588 shutdown_connections 2024-09-12T17:11:49.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.755+0000 7f6a36b769c0 1 -- 172.21.15.193:0/2210681588 wait complete. 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.771+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f1deec7680 con 0x55f1def33200 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33308/0 (socket says 172.21.15.193:33308) 2024-09-12T17:11:49.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 -- 172.21.15.193:0/32887593 learned_addr learned my addr 172.21.15.193:0/32887593 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 -- 172.21.15.193:0/32887593 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1dee42da0 con 0x55f1def33200 2024-09-12T17:11:49.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 --2- 172.21.15.193:0/32887593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0016f0 tx=0x7f6a2c001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4252758fddffb49b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f692260c640 1 -- 172.21.15.193:0/32887593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c003460 con 0x55f1def33200 2024-09-12T17:11:49.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f692260c640 1 -- 172.21.15.193:0/32887593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c003620 con 0x55f1def33200 2024-09-12T17:11:49.779 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f692260c640 1 -- 172.21.15.193:0/32887593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c003940 con 0x55f1def33200 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- 172.21.15.193:0/32887593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 msgr2=0x55f1df0ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/32887593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0016f0 tx=0x7f6a2c001bb0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- 172.21.15.193:0/32887593 shutdown_connections 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/32887593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0ac900 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- 172.21.15.193:0/32887593 >> 172.21.15.193:0/32887593 conn(0x55f1defb9920 msgr2=0x55f1df0a8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- 172.21.15.193:0/32887593 shutdown_connections 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- 172.21.15.193:0/32887593 wait complete. 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a36b769c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f1dee69a50 con 0x55f1def33200 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33322/0 (socket says 172.21.15.193:33322) 2024-09-12T17:11:49.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.775+0000 7f6a3467c640 1 -- 172.21.15.193:0/1148857708 learned_addr learned my addr 172.21.15.193:0/1148857708 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a3467c640 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1df0b4480 con 0x55f1def33200 2024-09-12T17:11:49.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a3467c640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55f1df0ad890 tx=0x7f6a2c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 -- 172.21.15.193:0/1148857708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c022020 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1df0b4710 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 -- 172.21.15.193:0/1148857708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a2c01e480 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1df0b5140 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 -- 172.21.15.193:0/1148857708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a2c01e760 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 -- 172.21.15.193:0/1148857708 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a2c025020 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 0x7f691c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6920e09640 1 -- 172.21.15.193:0/1148857708 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6a2c04fe90 con 0x55f1def33200 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 0x7f691c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 0x55f1df0bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0bb5d0 con 0x55f1def335e0 2024-09-12T17:11:49.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 0x55f1df0bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 0x7f691c03bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a280ae000 tx=0x7f6a280a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 0x55f1df0bb090 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a34e7d640 1 -- 172.21.15.193:0/1148857708 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a240083f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.779+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0bb9f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a34e7d640 1 -- 172.21.15.193:0/1148857708 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a240083f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0bd2f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a34e7d640 1 -- 172.21.15.193:0/1148857708 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a240083f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0bc520 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a34e7d640 1 -- 172.21.15.193:0/1148857708 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a240083f0 con 0x55f1def335e0 2024-09-12T17:11:49.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0bc940 con 0x55f1def335e0 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a34e7d640 1 -- 172.21.15.193:0/1148857708 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a240083f0 con 0x55f1def335e0 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f1deed4450 con 0x55f1df0cb650 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33334/0 (socket says 172.21.15.193:33334) 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a33e7b640 1 -- 172.21.15.193:0/1785763203 learned_addr learned my addr 172.21.15.193:0/1785763203 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a33e7b640 1 -- 172.21.15.193:0/1785763203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1df0cc0b0 con 0x55f1df0cb650 2024-09-12T17:11:49.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6a2801b380 tx=0x7f6a280180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6919ffb640 1 -- 172.21.15.193:0/1785763203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280b3b10 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1df0cc910 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6919ffb640 1 -- 172.21.15.193:0/1785763203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280b3cb0 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1df0cce20 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.783+0000 7f6919ffb640 1 -- 172.21.15.193:0/1785763203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280c8430 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6919ffb640 1 -- 172.21.15.193:0/1785763203 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a280c85d0 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6919ffb640 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 0x7f690c03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6919ffb640 1 -- 172.21.15.193:0/1785763203 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6a280edc70 con 0x55f1df0cb650 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 0x7f690c03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 0x7f690c03bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55f1df0bc8c0 tx=0x7f6a24003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f1df0ad0f0 con 0x55f1df0d8f00 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33338/0 (socket says 172.21.15.193:33338) 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a33e7b640 1 -- 172.21.15.193:0/3984954161 learned_addr learned my addr 172.21.15.193:0/3984954161 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a33e7b640 1 -- 172.21.15.193:0/3984954161 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1df0d98f0 con 0x55f1df0d8f00 2024-09-12T17:11:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/3984954161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6a280bdd60 tx=0x7f6a280bdae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68baaa8fcb3e6fa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f69137fe640 1 -- 172.21.15.193:0/3984954161 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280bde00 con 0x55f1df0d8f00 2024-09-12T17:11:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f69137fe640 1 -- 172.21.15.193:0/3984954161 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a280e0070 con 0x55f1df0d8f00 2024-09-12T17:11:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f69137fe640 1 -- 172.21.15.193:0/3984954161 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280bea60 con 0x55f1df0d8f00 2024-09-12T17:11:49.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- 172.21.15.193:0/3984954161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 msgr2=0x55f1df0d9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/3984954161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6a280bdd60 tx=0x7f6a280bdae0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- 172.21.15.193:0/3984954161 shutdown_connections 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/3984954161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0d9300 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- 172.21.15.193:0/3984954161 >> 172.21.15.193:0/3984954161 conn(0x55f1df0d4320 msgr2=0x55f1df0d2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.787+0000 7f6a36b769c0 1 -- 172.21.15.193:0/3984954161 shutdown_connections 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 -- 172.21.15.193:0/3984954161 wait complete. 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 Processor -- start 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 -- start start 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f1df0d7e50 con 0x55f1df0d8f00 2024-09-12T17:11:49.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a33e7b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33352/0 (socket says 172.21.15.193:33352) 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 learned_addr learned my addr 172.21.15.193:0/999881407 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1df0df960 con 0x55f1df0d8f00 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55f1df0d3270 tx=0x7f6a280ebf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 -- 172.21.15.193:0/999881407 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280067a0 con 0x55f1df0d8f00 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1df0dfbf0 con 0x55f1df0d8f00 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 -- 172.21.15.193:0/999881407 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a28006940 con 0x55f1df0d8f00 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1df0e05a0 con 0x55f1df0d8f00 2024-09-12T17:11:49.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 -- 172.21.15.193:0/999881407 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a280ff060 con 0x55f1df0d8f00 2024-09-12T17:11:49.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 -- 172.21.15.193:0/999881407 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6a280da070 con 0x55f1df0d8f00 2024-09-12T17:11:49.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6904039a70 0x7f690403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6911ffb640 1 -- 172.21.15.193:0/999881407 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6a280d7070 con 0x55f1df0d8f00 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6904039a70 0x7f690403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.791+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1df0ea6f0 0x55f1df0ecbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0ed300 con 0x55f1df0ea6f0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1df0ea6f0 0x55f1df0ecbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6904039a70 0x7f690403bf30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400f010 tx=0x7f6a2401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1df0ea6f0 0x55f1df0ecbb0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 realm 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0ed710 con 0x55f1df0ea6f0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0edfe0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0ee380 con 0x55f1df0ea6f0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0eebd0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 20 searching for the correct realm 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f1df0f0940 0x55f1df0f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f1df0f0940 0x55f1df0f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f1df0f0940 0x55f1df0f2d30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a33e7b640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6a28009040 0x7f6a280d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6a28009040 0x7f6a280d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6a28009040 0x7f6a280d3aa0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6a24019040 0x7f6a24019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.795+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6a24019040 0x7f6a24019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6a24019040 0x7f6a24019930 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.799+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.803+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0f0940 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a24019040 2024-09-12T17:11:49.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.807+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x55f1df0ea6f0 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3270 con 0x7f6a28009040 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:49.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0ef550 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0efdf0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f3610 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:49.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 zone default found 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 4 Realm: () 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 zonegroup default 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f36a0 con 0x7f6a24019040 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f54d0 con 0x55f1df0f0940 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f5920 con 0x55f1df0f0940 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 started sync module instance, tier type = 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:49.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.811+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f4970 con 0x7f6a28009040 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94497317801312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f45d0 con 0x7f6a28009040 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f6850 con 0x55f1df0ea6f0 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94497317801312] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94497317805440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f6850 con 0x55f1df0ea6f0 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.815+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f7210 con 0x55f1df0f0940 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94497317805440] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94497317807008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f67c0 con 0x55f1df0f0940 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f7f10 con 0x7f6a28009040 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94497317813136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f87e0 con 0x7f6a28009040 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f91e0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.819+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94497317807008] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94497317813136] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94497317811632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f8330 con 0x55f1df0ea6f0 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f9a80 con 0x7f6a24019040 2024-09-12T17:11:49.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94497317811632] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94497317817584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f8330 con 0x7f6a24019040 2024-09-12T17:11:49.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.823+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f9ed0 con 0x7f6a24019040 2024-09-12T17:11:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94497317820960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0fa2f0 con 0x7f6a24019040 2024-09-12T17:11:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0fae10 con 0x7f6a24019040 2024-09-12T17:11:49.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94497317817584] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94497317820960] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94497317824736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f9e40 con 0x7f6a24019040 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=0 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=1 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=2 2024-09-12T17:11:49.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=3 2024-09-12T17:11:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=4 2024-09-12T17:11:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=5 2024-09-12T17:11:49.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.827+0000 7f6a36b769c0 20 add_watcher() i=6 2024-09-12T17:11:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94497317824736] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 20 add_watcher() i=7 2024-09-12T17:11:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0fa2d0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94497317819312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0fa2d0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94497317819312] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f68ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:49.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.831+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df106620 con 0x55f1df0ea6f0 2024-09-12T17:11:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.835+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.835+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df106620 con 0x7f6a24019040 2024-09-12T17:11:49.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df106b60 con 0x55f1df0f0940 2024-09-12T17:11:49.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df106f50 con 0x55f1df0ea6f0 2024-09-12T17:11:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.839+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df107050 con 0x7f6a28009040 2024-09-12T17:11:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.843+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.843+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df1076b0 con 0x55f1df0f0940 2024-09-12T17:11:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.843+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.843+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df107a50 con 0x55f1df0ea6f0 2024-09-12T17:11:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.847+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.847+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df107ae0 con 0x7f6a24019040 2024-09-12T17:11:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.847+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.847+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df107ae0 con 0x7f6a28009040 2024-09-12T17:11:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.851+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.851+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df1080d0 con 0x55f1df0f0940 2024-09-12T17:11:49.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.851+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.851+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108500 con 0x7f6a28009040 2024-09-12T17:11:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'61 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108a70 con 0x7f6a24019040 2024-09-12T17:11:49.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108a70 con 0x7f6a28009040 2024-09-12T17:11:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.855+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108c10 con 0x7f6a24019040 2024-09-12T17:11:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.859+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.859+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108c10 con 0x55f1df0ea6f0 2024-09-12T17:11:49.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.859+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.859+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108c10 con 0x55f1df0f0940 2024-09-12T17:11:49.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.863+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.863+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108c10 con 0x7f6a28009040 2024-09-12T17:11:49.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.863+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'62 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.863+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108c10 con 0x55f1df0f0940 2024-09-12T17:11:49.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.867+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.867+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108de0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.867+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.867+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df108de0 con 0x55f1df0ea6f0 2024-09-12T17:11:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105c90 con 0x55f1df0f0940 2024-09-12T17:11:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105c90 con 0x7f6a28009040 2024-09-12T17:11:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.871+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df1058b0 con 0x55f1df0f0940 2024-09-12T17:11:49.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.875+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.875+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df1058b0 con 0x55f1df0f0940 2024-09-12T17:11:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.875+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.875+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x55f1df0f0940 2024-09-12T17:11:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.879+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.879+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x55f1df0f0940 2024-09-12T17:11:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.879+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.879+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x7f6a24019040 2024-09-12T17:11:49.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x55f1df0f0940 2024-09-12T17:11:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x7f6a24019040 2024-09-12T17:11:49.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.883+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x55f1df0f0940 2024-09-12T17:11:49.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.887+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.887+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x7f6a24019040 2024-09-12T17:11:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df105d60 con 0x7f6a28009040 2024-09-12T17:11:49.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f68e97e2640 20 reqs_thread_entry: start 2024-09-12T17:11:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 20 Filter name: none 2024-09-12T17:11:49.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f685affd640 20 reqs_thread_entry: start 2024-09-12T17:11:49.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:49.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:49.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df123c40 con 0x55f1df0ea6f0 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.891+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f1df123c10 con 0x7f6a28009040 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.895+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.898 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:11:49.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.895+0000 7f68ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:49.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.895+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94497317819312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df100a70 con 0x55f1df0ea6f0 2024-09-12T17:11:49.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.895+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94497317819312] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.895+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94497317801312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f93b0 con 0x7f6a28009040 2024-09-12T17:11:49.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94497317801312] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a36b769c0 20 remove_watcher() i=0 2024-09-12T17:11:49.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a36b769c0 2 removed watcher, disabling cache 2024-09-12T17:11:49.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94497317805440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f4d60 con 0x55f1df0ea6f0 2024-09-12T17:11:49.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94497317805440] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a36b769c0 20 remove_watcher() i=1 2024-09-12T17:11:49.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.899+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94497317807008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f4d60 con 0x55f1df0f0940 2024-09-12T17:11:49.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a33e7b640 1 -- 172.21.15.193:0/999881407 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94497317807008] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a280f4020 con 0x55f1df0f0940 2024-09-12T17:11:49.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a36b769c0 20 remove_watcher() i=2 2024-09-12T17:11:49.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94497317813136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f63a0 con 0x7f6a28009040 2024-09-12T17:11:49.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a34e7d640 1 -- 172.21.15.193:0/999881407 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94497317813136] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2402f040 con 0x7f6a28009040 2024-09-12T17:11:49.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a36b769c0 20 remove_watcher() i=3 2024-09-12T17:11:49.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.903+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94497317811632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f4d60 con 0x55f1df0ea6f0 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94497317811632] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x55f1df0ea6f0 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a36b769c0 20 remove_watcher() i=4 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94497317817584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f63a0 con 0x7f6a24019040 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94497317817584] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a36b769c0 20 remove_watcher() i=5 2024-09-12T17:11:49.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.907+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94497317820960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f75b0 con 0x7f6a24019040 2024-09-12T17:11:49.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94497317820960] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 20 remove_watcher() i=6 2024-09-12T17:11:49.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94497317824736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f1df0f4d60 con 0x7f6a24019040 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94497317824736] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a2c01b040 con 0x7f6a24019040 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 20 remove_watcher() i=7 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6a24019040 msgr2=0x7f6a24019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6a24019040 0x7f6a24019930 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1df0ea6f0 msgr2=0x55f1df0ecbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1df0ea6f0 0x55f1df0ecbb0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6a28009040 msgr2=0x7f6a280d3aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6a28009040 0x7f6a280d3aa0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f1df0f0940 msgr2=0x55f1df0f2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f1df0f0940 0x55f1df0f2d30 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6904039a70 msgr2=0x7f690403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6904039a70 0x7f690403bf30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400f010 tx=0x7f6a2401b070 comp rx=0 tx=0).stop 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 msgr2=0x55f1df0df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55f1df0d3270 tx=0x7f6a280ebf60 comp rx=0 tx=0).stop 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a3467c640 1 -- 172.21.15.193:0/999881407 reap_dead start 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 shutdown_connections 2024-09-12T17:11:49.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/999881407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0d8f00 0x55f1df0df400 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 >> 172.21.15.193:0/999881407 conn(0x55f1df0d4320 msgr2=0x55f1df0d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 shutdown_connections 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/999881407 wait complete. 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 msgr2=0x7f690c03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 0x7f690c03bf20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55f1df0bc8c0 tx=0x7f6a24003070 comp rx=0 tx=0).stop 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 msgr2=0x55f1df0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6a2801b380 tx=0x7f6a280180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 shutdown_connections 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f690c039a60 0x7f690c03bf20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1785763203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1df0cb650 0x55f1df0cba70 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 >> 172.21.15.193:0/1785763203 conn(0x55f1df0c1000 msgr2=0x55f1df0c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 shutdown_connections 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.911+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1785763203 wait complete. 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 msgr2=0x55f1df0bb090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 0x55f1df0bb090 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 msgr2=0x7f691c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 0x7f691c03bf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6a280ae000 tx=0x7f6a280a6000 comp rx=0 tx=0).stop 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 msgr2=0x55f1df0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55f1df0ad890 tx=0x7f6a2c001260 comp rx=0 tx=0).stop 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 shutdown_connections 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f1def335e0 0x55f1df0bb090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f691c039ac0 0x7f691c03bf80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 --2- 172.21.15.193:0/1148857708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f1def33200 0x55f1df0b3f20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:49.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 >> 172.21.15.193:0/1148857708 conn(0x55f1defb9920 msgr2=0x55f1df0a6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:49.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 shutdown_connections 2024-09-12T17:11:49.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:49.915+0000 7f6a36b769c0 1 -- 172.21.15.193:0/1148857708 wait complete. 2024-09-12T17:11:49.929 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:11:49.942 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-12T17:11:49.950 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:49.994 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:50.010 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:50.053 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T17:11:50.063 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:50.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:11:50.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:11:50.064 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:11:50.100 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:50.100 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:50.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.095+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.095+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.095+0000 7fd157c629c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f011cce1f0 0x55f011d5f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.095+0000 7fd157c629c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f011c0e9c0 con 0x55f011cce5d0 2024-09-12T17:11:50.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.095+0000 7fd157c629c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55f011c5e6d0 con 0x55f011cce1f0 2024-09-12T17:11:50.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd155768640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55f011cce1f0 0x55f011d5f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd154f67640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55f011cce5d0 0x55f011d61570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47542/0 (socket says 172.21.15.193:47542) 2024-09-12T17:11:50.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd154f67640 1 -- 172.21.15.193:0/1486366833 learned_addr learned my addr 172.21.15.193:0/1486366833 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:50.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd155768640 1 -- 172.21.15.193:0/1486366833 >> v1:172.21.15.62:6789/0 conn(0x55f011cce5d0 legacy=0x55f011d61570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd155768640 1 -- 172.21.15.193:0/1486366833 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011c02ca0 con 0x55f011cce1f0 2024-09-12T17:11:50.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd155768640 1 --2- 172.21.15.193:0/1486366833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011d5f020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a420 tx=0x7fd15001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d882190728767af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd147fff640 1 -- 172.21.15.193:0/1486366833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500af070 con 0x55f011cce1f0 2024-09-12T17:11:50.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd147fff640 1 -- 172.21.15.193:0/1486366833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1500aa530 con 0x55f011cce1f0 2024-09-12T17:11:50.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd147fff640 1 -- 172.21.15.193:0/1486366833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500aa850 con 0x55f011cce1f0 2024-09-12T17:11:50.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 -- 172.21.15.193:0/1486366833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 msgr2=0x55f011d5f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 --2- 172.21.15.193:0/1486366833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011d5f020 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd15000a420 tx=0x7fd15001afd0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 -- 172.21.15.193:0/1486366833 shutdown_connections 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 --2- 172.21.15.193:0/1486366833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011d5f020 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 -- 172.21.15.193:0/1486366833 >> 172.21.15.193:0/1486366833 conn(0x55f011d54910 msgr2=0x55f011d56d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 -- 172.21.15.193:0/1486366833 shutdown_connections 2024-09-12T17:11:50.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.099+0000 7fd157c629c0 1 -- 172.21.15.193:0/1486366833 wait complete. 2024-09-12T17:11:50.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd157c629c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd157c629c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f011c62680 con 0x55f011cce1f0 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd155768640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd155768640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33356/0 (socket says 172.21.15.193:33356) 2024-09-12T17:11:50.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd155768640 1 -- 172.21.15.193:0/4136283206 learned_addr learned my addr 172.21.15.193:0/4136283206 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd155768640 1 -- 172.21.15.193:0/4136283206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011bddda0 con 0x55f011cce1f0 2024-09-12T17:11:50.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd155768640 1 --2- 172.21.15.193:0/4136283206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd1500ad040 tx=0x7fd1500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282c7cc360b4c785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd043606640 1 -- 172.21.15.193:0/4136283206 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500af050 con 0x55f011cce1f0 2024-09-12T17:11:50.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd043606640 1 -- 172.21.15.193:0/4136283206 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1500b0040 con 0x55f011cce1f0 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.115+0000 7fd043606640 1 -- 172.21.15.193:0/4136283206 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500aaad0 con 0x55f011cce1f0 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/4136283206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 msgr2=0x55f011e47920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 --2- 172.21.15.193:0/4136283206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd1500ad040 tx=0x7fd1500033b0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/4136283206 shutdown_connections 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 --2- 172.21.15.193:0/4136283206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e47920 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/4136283206 >> 172.21.15.193:0/4136283206 conn(0x55f011d54910 msgr2=0x55f011e43560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/4136283206 shutdown_connections 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/4136283206 wait complete. 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f011c04a50 con 0x55f011cce1f0 2024-09-12T17:11:50.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd155768640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd155768640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33362/0 (socket says 172.21.15.193:33362) 2024-09-12T17:11:50.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd155768640 1 -- 172.21.15.193:0/3204627858 learned_addr learned my addr 172.21.15.193:0/3204627858 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd155768640 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011e4f3f0 con 0x55f011cce1f0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd155768640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd1500aa500 tx=0x7fd150017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 -- 172.21.15.193:0/3204627858 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500b6c40 con 0x55f011cce1f0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f011e4f680 con 0x55f011cce1f0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 -- 172.21.15.193:0/3204627858 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1500b6de0 con 0x55f011cce1f0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 -- 172.21.15.193:0/3204627858 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1500cd060 con 0x55f011cce1f0 2024-09-12T17:11:50.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f011e50030 con 0x55f011cce1f0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 -- 172.21.15.193:0/3204627858 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd1500bf590 con 0x55f011cce1f0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 0x7fd03c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd041e03640 1 -- 172.21.15.193:0/3204627858 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd1500bb070 con 0x55f011cce1f0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.119+0000 7fd154f67640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 0x7fd03c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 0x55f011e56000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e56540 con 0x55f011cce5d0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 0x55f011e56000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 0x7fd03c03bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd14c001d80 tx=0x7fd14c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 0x55f011e56000 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 -- 172.21.15.193:0/3204627858 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1480083f0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e50350 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 -- 172.21.15.193:0/3204627858 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1480083f0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e582a0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 -- 172.21.15.193:0/3204627858 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd1480083f0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e574d0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 -- 172.21.15.193:0/3204627858 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1480083f0 con 0x55f011cce5d0 2024-09-12T17:11:50.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e578f0 con 0x55f011cce5d0 2024-09-12T17:11:50.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd155f69640 1 -- 172.21.15.193:0/3204627858 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1480083f0 con 0x55f011cce5d0 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd157c629c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f011c6f450 con 0x55f011e66680 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33374/0 (socket says 172.21.15.193:33374) 2024-09-12T17:11:50.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 -- 172.21.15.193:0/2214562708 learned_addr learned my addr 172.21.15.193:0/2214562708 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 -- 172.21.15.193:0/2214562708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011e670e0 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.123+0000 7fd154f67640 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00d660 tx=0x7fd14c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 -- 172.21.15.193:0/2214562708 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c00c6b0 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f011e67940 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f011e67eb0 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 -- 172.21.15.193:0/2214562708 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c00c850 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 -- 172.21.15.193:0/2214562708 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c00cb30 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 -- 172.21.15.193:0/2214562708 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd14c023020 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 0x7fd02c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd03affd640 1 -- 172.21.15.193:0/2214562708 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd14c021020 con 0x55f011e66680 2024-09-12T17:11:50.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd155f69640 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 0x7fd02c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd157c629c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f011e480b0 con 0x55f011e73040 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd155f69640 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 0x7fd02c03bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f011e57870 tx=0x7fd148003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33380/0 (socket says 172.21.15.193:33380) 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd154f67640 1 -- 172.21.15.193:0/3346705213 learned_addr learned my addr 172.21.15.193:0/3346705213 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd154f67640 1 -- 172.21.15.193:0/3346705213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011e73a10 con 0x55f011e73040 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd154f67640 1 --2- 172.21.15.193:0/3346705213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd14c050f20 tx=0x7fd14c023310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cffbc4a3f48f99f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd038ff9640 1 -- 172.21.15.193:0/3346705213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c047070 con 0x55f011e73040 2024-09-12T17:11:50.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd038ff9640 1 -- 172.21.15.193:0/3346705213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c024710 con 0x55f011e73040 2024-09-12T17:11:50.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.127+0000 7fd038ff9640 1 -- 172.21.15.193:0/3346705213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c00ce00 con 0x55f011e73040 2024-09-12T17:11:50.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/3346705213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 msgr2=0x55f011e73420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3346705213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd14c050f20 tx=0x7fd14c023310 comp rx=0 tx=0).stop 2024-09-12T17:11:50.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/3346705213 shutdown_connections 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3346705213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e73420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/3346705213 >> 172.21.15.193:0/3346705213 conn(0x55f011e6f470 msgr2=0x55f011e6d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/3346705213 shutdown_connections 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/3346705213 wait complete. 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 Processor -- start 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- start start 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55f011e74050 con 0x55f011e73040 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd154f67640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33388/0 (socket says 172.21.15.193:33388) 2024-09-12T17:11:50.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 learned_addr learned my addr 172.21.15.193:0/535693373 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f011e7aae0 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd154f67640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd14c04c040 tx=0x7fd14c050eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 -- 172.21.15.193:0/535693373 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c034030 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f011e7ad70 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 -- 172.21.15.193:0/535693373 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c024710 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f011e7ad70 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 -- 172.21.15.193:0/535693373 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14c03e060 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 -- 172.21.15.193:0/535693373 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd14c037030 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd020039a70 0x7fd02003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd02affd640 1 -- 172.21.15.193:0/535693373 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd14c035070 con 0x55f011e73040 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.131+0000 7fd155f69640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd020039a70 0x7fd02003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011e85670 0x55f011e87b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e88280 con 0x55f011e85670 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011e85670 0x55f011e87b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155f69640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd020039a70 0x7fd02003bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd14800f010 tx=0x7fd14801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011e85670 0x55f011e87b30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 realm 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e88690 con 0x55f011e85670 2024-09-12T17:11:50.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e88f60 con 0x55f011e85670 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e89300 con 0x55f011e85670 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e89b50 con 0x55f011e85670 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 20 searching for the correct realm 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f011e8b8c0 0x55f011e8dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd154f67640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f011e8b8c0 0x55f011e8dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd154f67640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f011e8b8c0 0x55f011e8dcb0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd154f67640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd14c015a30 0x7fd14c051a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155f69640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd14c015a30 0x7fd14c051a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.135+0000 7fd155f69640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd14c015a30 0x7fd14c051a60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155f69640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd148019040 0x7fd148019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd148019040 0x7fd148019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd148019040 0x7fd148019930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.139+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.143+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e8b8c0 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.147+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x55f011e85670 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e1f0 con 0x7fd14c015a30 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8a500 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8ada0 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8e590 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 zone default found 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 4 Realm: () 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 zonegroup default 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8a9b0 con 0x7fd148019040 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e90480 con 0x55f011e8b8c0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e908c0 con 0x55f011e8b8c0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 started sync module instance, tier type = 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8f920 con 0x7fd14c015a30 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94489580993856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e8f580 con 0x7fd14c015a30 2024-09-12T17:11:50.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.151+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e917f0 con 0x55f011e85670 2024-09-12T17:11:50.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.155+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94489580993856] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.155+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.155+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94489580997920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e917f0 con 0x55f011e85670 2024-09-12T17:11:50.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.155+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e92200 con 0x55f011e8b8c0 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.155+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94489580997920] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94489580999488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e91760 con 0x55f011e8b8c0 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e92f00 con 0x7fd14c015a30 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94489581005696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e937a0 con 0x7fd14c015a30 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e941c0 con 0x55f011e85670 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94489580999488] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94489581005696] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94489581010096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e932f0 con 0x55f011e85670 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.159+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e94a60 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94489581010096] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94489581004192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e94780 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e94fd0 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94489581004192] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.163+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94489581011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e94ce0 con 0x7fd148019040 2024-09-12T17:11:50.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e95800 con 0x7fd148019040 2024-09-12T17:11:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94489581011664] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94489581015760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e957c0 con 0x7fd148019040 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=0 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=1 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=2 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=3 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=4 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=5 2024-09-12T17:11:50.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=6 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94489581015760] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 20 add_watcher() i=7 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.167+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011e98c20 con 0x55f011e85670 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94489581012784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011e96140 con 0x55f011e85670 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94489581012784] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd00bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 5 note: GC not initialized 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd00afe5640 20 reqs_thread_entry: start 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:50.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 Filter name: none 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd008fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011ebc4b0 con 0x7fd14c015a30 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 : miss 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.16 8:6dfcd5b2:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011ebdf90 con 0x55f011e8b8c0 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 info.flags=0x17 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 to cache LRU end 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 get_obj_state: octx=0x7fd1500a9460 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55f011ec0148 s->prefetch_data=0 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 3.3bs0 3:de915c96:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x55f011e8b8c0 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(64 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 10 manifest: total_size = 5 2024-09-12T17:11:50.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.171+0000 7fd157c629c0 20 get_obj_state: setting s->obj_tag to _kQgjDFsaD0r3WhX-kH-806f9w4znGbM 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd00bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94489581012784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x55f011e85670 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94489581012784] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94489580993856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x7fd14c015a30 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94489580993856] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd157c629c0 20 remove_watcher() i=0 2024-09-12T17:11:50.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd157c629c0 2 removed watcher, disabling cache 2024-09-12T17:11:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.175+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94489580997920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x55f011e85670 2024-09-12T17:11:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94489580997920] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd157c629c0 20 remove_watcher() i=1 2024-09-12T17:11:50.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94489580999488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x55f011e8b8c0 2024-09-12T17:11:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd154f67640 1 -- 172.21.15.193:0/535693373 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94489580999488] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14c049070 con 0x55f011e8b8c0 2024-09-12T17:11:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd157c629c0 20 remove_watcher() i=2 2024-09-12T17:11:50.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.179+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94489581005696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x7fd14c015a30 2024-09-12T17:11:50.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd155f69640 1 -- 172.21.15.193:0/535693373 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94489581005696] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd14802f040 con 0x7fd14c015a30 2024-09-12T17:11:50.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 20 remove_watcher() i=3 2024-09-12T17:11:50.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94489581010096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x55f011e85670 2024-09-12T17:11:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94489581010096] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x55f011e85670 2024-09-12T17:11:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 20 remove_watcher() i=4 2024-09-12T17:11:50.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94489581004192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x7fd148019040 2024-09-12T17:11:50.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94489581004192] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 20 remove_watcher() i=5 2024-09-12T17:11:50.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.183+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94489581011664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x7fd148019040 2024-09-12T17:11:50.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94489581011664] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 20 remove_watcher() i=6 2024-09-12T17:11:50.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94489581015760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f011ec12a0 con 0x7fd148019040 2024-09-12T17:11:50.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94489581015760] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1500b2070 con 0x7fd148019040 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 20 remove_watcher() i=7 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd148019040 msgr2=0x7fd148019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fd148019040 0x7fd148019930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011e85670 msgr2=0x55f011e87b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011e85670 0x55f011e87b30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd14c015a30 msgr2=0x7fd14c051a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fd14c015a30 0x7fd14c051a60 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f011e8b8c0 msgr2=0x55f011e8dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55f011e8b8c0 0x55f011e8dcb0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd020039a70 msgr2=0x7fd02003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd020039a70 0x7fd02003bf30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd14800f010 tx=0x7fd14801b070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 msgr2=0x55f011e7a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd155768640 1 -- 172.21.15.193:0/535693373 reap_dead start 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd14c04c040 tx=0x7fd14c050eb0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 shutdown_connections 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/535693373 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e73040 0x55f011e7a580 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 >> 172.21.15.193:0/535693373 conn(0x55f011e6f470 msgr2=0x55f011e6d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 shutdown_connections 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/535693373 wait complete. 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 msgr2=0x7fd02c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.187+0000 7fd157c629c0 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 0x7fd02c03bf30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55f011e57870 tx=0x7fd148003070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 msgr2=0x55f011e66aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00d660 tx=0x7fd14c00da60 comp rx=0 tx=0).stop 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 shutdown_connections 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd02c039a70 0x7fd02c03bf30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/2214562708 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011e66680 0x55f011e66aa0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 >> 172.21.15.193:0/2214562708 conn(0x55f011e5c030 msgr2=0x55f011e5c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 shutdown_connections 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/2214562708 wait complete. 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 msgr2=0x55f011e56000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 0x55f011e56000 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 msgr2=0x7fd03c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 0x7fd03c03bf30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd14c001d80 tx=0x7fd14c0012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 msgr2=0x55f011e4ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd1500aa500 tx=0x7fd150017d70 comp rx=0 tx=0).stop 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 shutdown_connections 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55f011cce5d0 0x55f011e56000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd03c039a70 0x7fd03c03bf30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 --2- 172.21.15.193:0/3204627858 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55f011cce1f0 0x55f011e4ee90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 >> 172.21.15.193:0/3204627858 conn(0x55f011d54910 msgr2=0x55f011e41ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 shutdown_connections 2024-09-12T17:11:50.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.191+0000 7fd157c629c0 1 -- 172.21.15.193:0/3204627858 wait complete. 2024-09-12T17:11:50.204 INFO:teuthology.orchestra.run.smithi193.stdout:fooFoofooFooFULL_CONTROL 2024-09-12T17:11:50.204 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-12T17:11:50.207 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-12T17:11:50.214 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:50.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:11:50.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-12T17:11:50.214 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:11:50.277 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:50.277 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:50.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d95c4e9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e66bc17270 0x55e66bc17650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d95c4e9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e66bb559c0 con 0x55e66bc15c60 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d95c4e9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e66bba56d0 con 0x55e66bc17270 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d93754640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e66bc17270 0x55e66bc17650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d8af53640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e66bc15c60 0x55e66bc16070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47556/0 (socket says 172.21.15.193:47556) 2024-09-12T17:11:50.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d8af53640 1 -- 172.21.15.193:0/3573832132 learned_addr learned my addr 172.21.15.193:0/3573832132 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:11:50.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d93754640 1 -- 172.21.15.193:0/3573832132 >> v1:172.21.15.62:6789/0 conn(0x55e66bc15c60 legacy=0x55e66bc16070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d93754640 1 -- 172.21.15.193:0/3573832132 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bb49ca0 con 0x55e66bc17270 2024-09-12T17:11:50.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.275+0000 7f1d93754640 1 --2- 172.21.15.193:0/3573832132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc17270 0x55e66bc17650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400a480 tx=0x7f1d8401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1b11f1f803c02a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d92f53640 1 -- 172.21.15.193:0/3573832132 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840b0070 con 0x55e66bc17270 2024-09-12T17:11:50.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d92f53640 1 -- 172.21.15.193:0/3573832132 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d840ab540 con 0x55e66bc17270 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d92f53640 1 -- 172.21.15.193:0/3573832132 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840ab840 con 0x55e66bc17270 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3573832132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc17270 msgr2=0x55e66bc17650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/3573832132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc17270 0x55e66bc17650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400a480 tx=0x7f1d8401b280 comp rx=0 tx=0).stop 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3573832132 shutdown_connections 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/3573832132 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc17270 0x55e66bc17650 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3573832132 >> 172.21.15.193:0/3573832132 conn(0x55e66bc9ca90 msgr2=0x55e66bc9eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3573832132 shutdown_connections 2024-09-12T17:11:50.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.279+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3573832132 wait complete. 2024-09-12T17:11:50.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d95c4e9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d95c4e9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66bba9680 con 0x55e66bc15c60 2024-09-12T17:11:50.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d93754640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d93754640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33392/0 (socket says 172.21.15.193:33392) 2024-09-12T17:11:50.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d93754640 1 -- 172.21.15.193:0/508401046 learned_addr learned my addr 172.21.15.193:0/508401046 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d93754640 1 -- 172.21.15.193:0/508401046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bb24da0 con 0x55e66bc15c60 2024-09-12T17:11:50.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.291+0000 7f1d93754640 1 --2- 172.21.15.193:0/508401046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1d84018eb0 tx=0x7f1d84003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7f1b19479e4df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c8160a640 1 -- 172.21.15.193:0/508401046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840b0040 con 0x55e66bc15c60 2024-09-12T17:11:50.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c8160a640 1 -- 172.21.15.193:0/508401046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d840bb070 con 0x55e66bc15c60 2024-09-12T17:11:50.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c8160a640 1 -- 172.21.15.193:0/508401046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840ab6f0 con 0x55e66bc15c60 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/508401046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 msgr2=0x55e66bd8ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/508401046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1d84018eb0 tx=0x7f1d84003030 comp rx=0 tx=0).stop 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/508401046 shutdown_connections 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/508401046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd8ebe0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/508401046 >> 172.21.15.193:0/508401046 conn(0x55e66bc9ca90 msgr2=0x55e66bd8a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/508401046 shutdown_connections 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/508401046 wait complete. 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66bb4ba50 con 0x55e66bc15c60 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d93754640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d93754640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33408/0 (socket says 172.21.15.193:33408) 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d93754640 1 -- 172.21.15.193:0/883725146 learned_addr learned my addr 172.21.15.193:0/883725146 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d93754640 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bd966b0 con 0x55e66bc15c60 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d93754640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1d840b8040 tx=0x7f1d84018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c7fe07640 1 -- 172.21.15.193:0/883725146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840b0030 con 0x55e66bc15c60 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66bd96940 con 0x55e66bc15c60 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c7fe07640 1 -- 172.21.15.193:0/883725146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d840bb070 con 0x55e66bc15c60 2024-09-12T17:11:50.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1c7fe07640 1 -- 172.21.15.193:0/883725146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d840b66d0 con 0x55e66bc15c60 2024-09-12T17:11:50.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.295+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66bd972f0 con 0x55e66bc15c60 2024-09-12T17:11:50.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1c7fe07640 1 -- 172.21.15.193:0/883725146 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d840b6870 con 0x55e66bc15c60 2024-09-12T17:11:50.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1c7fe07640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1c7fe07640 1 -- 172.21.15.193:0/883725146 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d840a8070 con 0x55e66bc15c60 2024-09-12T17:11:50.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 0x55e66bd9d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d8af53640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bd9d800 con 0x55e66bc17270 2024-09-12T17:11:50.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 0x55e66bd9d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d8af53640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 0x7f1c7803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c001d80 tx=0x7f1d7c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 0x55e66bd9d2c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 -- 172.21.15.193:0/883725146 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x55e66bc17270 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bd97700 con 0x55e66bc17270 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 -- 172.21.15.193:0/883725146 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x55e66bc17270 2024-09-12T17:11:50.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bd9f590 con 0x55e66bc17270 2024-09-12T17:11:50.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 -- 172.21.15.193:0/883725146 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x55e66bc17270 2024-09-12T17:11:50.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bd9e7c0 con 0x55e66bc17270 2024-09-12T17:11:50.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 -- 172.21.15.193:0/883725146 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x55e66bc17270 2024-09-12T17:11:50.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bd9ec10 con 0x55e66bc17270 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d93f55640 1 -- 172.21.15.193:0/883725146 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1d8c00a4d0 con 0x55e66bc17270 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.299+0000 7f1d95c4e9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66bbb6450 con 0x55e66bdad870 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33420/0 (socket says 172.21.15.193:33420) 2024-09-12T17:11:50.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 -- 172.21.15.193:0/2451461789 learned_addr learned my addr 172.21.15.193:0/2451461789 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 -- 172.21.15.193:0/2451461789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bdae2d0 con 0x55e66bdad870 2024-09-12T17:11:50.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00d660 tx=0x7f1d7c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 -- 172.21.15.193:0/2451461789 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c00c6b0 con 0x55e66bdad870 2024-09-12T17:11:50.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66bdaeb30 con 0x55e66bdad870 2024-09-12T17:11:50.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 -- 172.21.15.193:0/2451461789 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00c850 con 0x55e66bdad870 2024-09-12T17:11:50.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66bdaf0a0 con 0x55e66bdad870 2024-09-12T17:11:50.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 -- 172.21.15.193:0/2451461789 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c00cb30 con 0x55e66bdad870 2024-09-12T17:11:50.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 -- 172.21.15.193:0/2451461789 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d7c023020 con 0x55e66bdad870 2024-09-12T17:11:50.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 0x7f1c6c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1c7d602640 1 -- 172.21.15.193:0/2451461789 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d7c021020 con 0x55e66bdad870 2024-09-12T17:11:50.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 0x7f1c6c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 0x7f1c6c03bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55e66bd9e2e0 tx=0x7f1d8c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d95c4e9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66bd8f370 con 0x55e66bdbb1e0 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.303+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33422/0 (socket says 172.21.15.193:33422) 2024-09-12T17:11:50.310 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 -- 172.21.15.193:0/3418960891 learned_addr learned my addr 172.21.15.193:0/3418960891 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 -- 172.21.15.193:0/3418960891 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bdbbbd0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 --2- 172.21.15.193:0/3418960891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c050f00 tx=0x7f1d7c0233d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3db50b137b2ed7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c76ffd640 1 -- 172.21.15.193:0/3418960891 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c024710 con 0x55e66bdbb1e0 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c76ffd640 1 -- 172.21.15.193:0/3418960891 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00ccd0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c76ffd640 1 -- 172.21.15.193:0/3418960891 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c01bcc0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3418960891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 msgr2=0x55e66bdbb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/3418960891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c050f00 tx=0x7f1d7c0233d0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3418960891 shutdown_connections 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/3418960891 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdbb5e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3418960891 >> 172.21.15.193:0/3418960891 conn(0x55e66bdb6600 msgr2=0x55e66bdb4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3418960891 shutdown_connections 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/3418960891 wait complete. 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 Processor -- start 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- start start 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66bdba130 con 0x55e66bdbb1e0 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33430/0 (socket says 172.21.15.193:33430) 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 learned_addr learned my addr 172.21.15.193:0/2897936657 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66bdc1c50 con 0x55e66bdbb1e0 2024-09-12T17:11:50.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d8af53640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c024900 tx=0x7f1d7c050e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c757fa640 1 -- 172.21.15.193:0/2897936657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c0236e0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66bdc1ee0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c757fa640 1 -- 172.21.15.193:0/2897936657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d7c01b420 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1c757fa640 1 -- 172.21.15.193:0/2897936657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d7c023880 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.307+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66bdc1ee0 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1c757fa640 1 -- 172.21.15.193:0/2897936657 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1d7c01b740 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1c757fa640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c5c039a70 0x7f1c5c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1c757fa640 1 -- 172.21.15.193:0/2897936657 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1d7c005030 con 0x55e66bdbb1e0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c5c039a70 0x7f1c5c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bdcc7f0 0x55e66bdcec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdcf3d0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bdcc7f0 0x55e66bdcec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c5c039a70 0x7f1c5c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55e66bd97660 tx=0x7f1d8c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bdcc7f0 0x55e66bdcec80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 realm 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdcf7e0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd00b0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd0450 con 0x55e66bdcc7f0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd0ca0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 20 searching for the correct realm 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66bdd2a10 0x55e66bdd4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5340 con 0x55e66bdd2a10 2024-09-12T17:11:50.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d8af53640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66bdd2a10 0x55e66bdd4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d8af53640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66bdd2a10 0x55e66bdd4e00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d8af53640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1d7c01e9f0 0x7f1d7c019770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.311+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5340 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1d7c01e9f0 0x7f1d7c019770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1d7c01e9f0 0x7f1d7c019770 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1d8c031040 0x7f1d8c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5340 con 0x7f1d8c031040 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1d8c031040 0x7f1d8c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1d8c031040 0x7f1d8c032430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5340 con 0x55e66bdcc7f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.315+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.319+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdd2a10 2024-09-12T17:11:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d8c031040 2024-09-12T17:11:50.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.323+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1d840dc040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1d8c01f070 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd15f0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd1e90 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd1e90 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 zone default found 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 4 Realm: () 2024-09-12T17:11:50.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 zonegroup default 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5340 con 0x7f1d8c031040 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd6e30 con 0x55e66bdd2a10 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd72b0 con 0x55e66bdd2a10 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 started sync module instance, tier type = 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd61d0 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94448140510656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd5e30 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.327+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd81e0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.331+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94448140510656] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.331+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.331+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94448140515088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd81e0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.331+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd8bf0 con 0x55e66bdd2a10 2024-09-12T17:11:50.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94448140515088] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94448140516656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd8150 con 0x55e66bdd2a10 2024-09-12T17:11:50.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd98f0 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94448140522864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdda190 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddabb0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94448140516656] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.335+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94448140522864] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94448140527264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd9ce0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddb450 con 0x7f1d8c031040 2024-09-12T17:11:50.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94448140529104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bdd9ce0 con 0x7f1d8c031040 2024-09-12T17:11:50.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddbe20 con 0x7f1d8c031040 2024-09-12T17:11:50.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94448140527264] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.339+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94448140529104] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94448140531952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddb1f0 con 0x7f1d8c031040 2024-09-12T17:11:50.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddc290 con 0x7f1d8c031040 2024-09-12T17:11:50.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94448140531952] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94448140521360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddc290 con 0x7f1d8c031040 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=0 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=1 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=2 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=3 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=4 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=5 2024-09-12T17:11:50.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=6 2024-09-12T17:11:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94448140521360] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 20 add_watcher() i=7 2024-09-12T17:11:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.343+0000 7f1d95c4e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:50.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddf6c0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.350 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94448140533680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66bddcc10 con 0x55e66bdcc7f0 2024-09-12T17:11:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94448140533680] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:50.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 5 note: GC not initialized 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1c48fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 Filter name: none 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1bc27fc640 20 reqs_thread_entry: start 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66be02f50 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 : miss 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.16 8:6dfcd5b2:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66be04a10 con 0x55e66bdd2a10 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 info.flags=0x17 2024-09-12T17:11:50.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 to cache LRU end 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 get_obj_state: octx=0x7f1d840d1f10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e66be07108 s->prefetch_data=0 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 3.3bs0 3:de915c96:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x55e66bdd2a10 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(64 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 10 manifest: total_size = 5 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.347+0000 7f1d95c4e9c0 20 get_obj_state: setting s->obj_tag to _rG1udYC_PgheORifBTjuldbiPtqA4fg 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94448140533680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94448140533680] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94448140510656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94448140510656] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d95c4e9c0 20 remove_watcher() i=0 2024-09-12T17:11:50.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d95c4e9c0 2 removed watcher, disabling cache 2024-09-12T17:11:50.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.351+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94448140515088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94448140515088] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 20 remove_watcher() i=1 2024-09-12T17:11:50.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94448140516656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x55e66bdd2a10 2024-09-12T17:11:50.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d8af53640 1 -- 172.21.15.193:0/2897936657 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94448140516656] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d7c042390 con 0x55e66bdd2a10 2024-09-12T17:11:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 20 remove_watcher() i=2 2024-09-12T17:11:50.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94448140522864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d93f55640 1 -- 172.21.15.193:0/2897936657 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94448140522864] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d8c040040 con 0x7f1d7c01e9f0 2024-09-12T17:11:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 20 remove_watcher() i=3 2024-09-12T17:11:50.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.355+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94448140527264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x55e66bdcc7f0 2024-09-12T17:11:50.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94448140527264] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x55e66bdcc7f0 2024-09-12T17:11:50.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d95c4e9c0 20 remove_watcher() i=4 2024-09-12T17:11:50.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94448140529104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x7f1d8c031040 2024-09-12T17:11:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94448140529104] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d95c4e9c0 20 remove_watcher() i=5 2024-09-12T17:11:50.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.359+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94448140531952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x7f1d8c031040 2024-09-12T17:11:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94448140531952] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 20 remove_watcher() i=6 2024-09-12T17:11:50.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94448140521360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66be080b0 con 0x7f1d8c031040 2024-09-12T17:11:50.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94448140521360] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1d840b3040 con 0x7f1d8c031040 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 20 remove_watcher() i=7 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1d8c031040 msgr2=0x7f1d8c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1d8c031040 0x7f1d8c032430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bdcc7f0 msgr2=0x55e66bdcec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bdcc7f0 0x55e66bdcec80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1d7c01e9f0 msgr2=0x7f1d7c019770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1d7c01e9f0 0x7f1d7c019770 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66bdd2a10 msgr2=0x55e66bdd4e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66bdd2a10 0x55e66bdd4e00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c5c039a70 msgr2=0x7f1c5c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c5c039a70 0x7f1c5c03bf30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55e66bd97660 tx=0x7f1d8c01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:50.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d93754640 1 -- 172.21.15.193:0/2897936657 reap_dead start 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 msgr2=0x55e66bdc16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c024900 tx=0x7f1d7c050e60 comp rx=0 tx=0).stop 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 shutdown_connections 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2897936657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdbb1e0 0x55e66bdc16f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 >> 172.21.15.193:0/2897936657 conn(0x55e66bdb6600 msgr2=0x55e66bdb4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 shutdown_connections 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2897936657 wait complete. 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 msgr2=0x7f1c6c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 0x7f1c6c03bf80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55e66bd9e2e0 tx=0x7f1d8c005850 comp rx=0 tx=0).stop 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 msgr2=0x55e66bdadc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00d660 tx=0x7f1d7c00da60 comp rx=0 tx=0).stop 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 shutdown_connections 2024-09-12T17:11:50.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c6c039ac0 0x7f1c6c03bf80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/2451461789 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bdad870 0x55e66bdadc90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.363+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 >> 172.21.15.193:0/2451461789 conn(0x55e66bda3220 msgr2=0x55e66bda3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 shutdown_connections 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/2451461789 wait complete. 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 msgr2=0x55e66bd9d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 0x55e66bd9d2c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 msgr2=0x7f1c7803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 0x7f1c7803bf30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c001d80 tx=0x7f1d7c0012e0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 msgr2=0x55e66bd96150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1d840b8040 tx=0x7f1d84018020 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 shutdown_connections 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66bc17270 0x55e66bd9d2c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1c78039a70 0x7f1c7803bf30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 --2- 172.21.15.193:0/883725146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66bc15c60 0x55e66bd96150 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 >> 172.21.15.193:0/883725146 conn(0x55e66bc9ca90 msgr2=0x55e66bd892b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 shutdown_connections 2024-09-12T17:11:50.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.367+0000 7f1d95c4e9c0 1 -- 172.21.15.193:0/883725146 wait complete. 2024-09-12T17:11:50.379 INFO:teuthology.orchestra.run.smithi193.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T17:11:50.379 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-12T17:11:50.381 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-12T17:11:50.400 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:50.513 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-12T17:11:50.513 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-12T17:11:50.514 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-12T17:11:50.514 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T17:11:50.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T17:11:50.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-12T17:11:50.514 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-12T17:11:50.552 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:50.552 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:50.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.547+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.547+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73b1a239c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5653dfd711f0 0x5653dfd715d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73b1a239c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5653dfc239c0 con 0x5653dfd74330 2024-09-12T17:11:50.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73b1a239c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5653dfc736d0 con 0x5653dfd711f0 2024-09-12T17:11:50.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5653dfd711f0 0x5653dfd715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5653dfd711f0 0x5653dfd715d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33446/0 (socket says 172.21.15.193:33446) 2024-09-12T17:11:50.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 -- 172.21.15.193:0/2865847526 learned_addr learned my addr 172.21.15.193:0/2865847526 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73aed28640 1 --1- 172.21.15.193:0/2865847526 >> v1:172.21.15.62:6789/0 conn(0x5653dfd74330 0x5653dfd76720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47560/0 (socket says 172.21.15.193:47560) 2024-09-12T17:11:50.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 -- 172.21.15.193:0/2865847526 >> v1:172.21.15.62:6789/0 conn(0x5653dfd74330 legacy=0x5653dfd76720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 -- 172.21.15.193:0/2865847526 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfc17ca0 con 0x5653dfd711f0 2024-09-12T17:11:50.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73af529640 1 --2- 172.21.15.193:0/2865847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfd715d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a5c0 tx=0x7f73a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1c31d719a81ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.551+0000 7f73ae527640 1 -- 172.21.15.193:0/2865847526 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00a6070 con 0x5653dfd711f0 2024-09-12T17:11:50.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73ae527640 1 -- 172.21.15.193:0/2865847526 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00af070 con 0x5653dfd711f0 2024-09-12T17:11:50.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73ae527640 1 -- 172.21.15.193:0/2865847526 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00aa5c0 con 0x5653dfd711f0 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2865847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 msgr2=0x5653dfd715d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2865847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfd715d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f73a000a5c0 tx=0x7f73a001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2865847526 shutdown_connections 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2865847526 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfd715d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2865847526 >> 172.21.15.193:0/2865847526 conn(0x5653dfce4b00 msgr2=0x5653dfce4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2865847526 shutdown_connections 2024-09-12T17:11:50.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.555+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2865847526 wait complete. 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73b1a239c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73b1a239c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5653dfc77680 con 0x5653dfd711f0 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73af529640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73af529640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33448/0 (socket says 172.21.15.193:33448) 2024-09-12T17:11:50.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.567+0000 7f73af529640 1 -- 172.21.15.193:0/2757874329 learned_addr learned my addr 172.21.15.193:0/2757874329 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 -- 172.21.15.193:0/2757874329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfbf2da0 con 0x5653dfd711f0 2024-09-12T17:11:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 --2- 172.21.15.193:0/2757874329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73a0018f70 tx=0x7f73a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18a958edc9a7db4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f729d60a640 1 -- 172.21.15.193:0/2757874329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00aa8b0 con 0x5653dfd711f0 2024-09-12T17:11:50.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f729d60a640 1 -- 172.21.15.193:0/2757874329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00aaa50 con 0x5653dfd711f0 2024-09-12T17:11:50.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f729d60a640 1 -- 172.21.15.193:0/2757874329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00aad30 con 0x5653dfd711f0 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2757874329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 msgr2=0x5653dfe5c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2757874329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f73a0018f70 tx=0x7f73a0003030 comp rx=0 tx=0).stop 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2757874329 shutdown_connections 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2757874329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe5c820 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2757874329 >> 172.21.15.193:0/2757874329 conn(0x5653dfce4b00 msgr2=0x5653dfe584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2757874329 shutdown_connections 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2757874329 wait complete. 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73b1a239c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5653dfc19a50 con 0x5653dfd711f0 2024-09-12T17:11:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33464/0 (socket says 172.21.15.193:33464) 2024-09-12T17:11:50.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 -- 172.21.15.193:0/819056387 learned_addr learned my addr 172.21.15.193:0/819056387 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfe642e0 con 0x5653dfd711f0 2024-09-12T17:11:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.571+0000 7f73af529640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f73a0018f70 tx=0x7f73a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 -- 172.21.15.193:0/819056387 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00c6690 con 0x5653dfd711f0 2024-09-12T17:11:50.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dfe64570 con 0x5653dfd711f0 2024-09-12T17:11:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 -- 172.21.15.193:0/819056387 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a00c6830 con 0x5653dfd711f0 2024-09-12T17:11:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dfe64f20 con 0x5653dfd711f0 2024-09-12T17:11:50.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 -- 172.21.15.193:0/819056387 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73a00c6b10 con 0x5653dfd711f0 2024-09-12T17:11:50.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 -- 172.21.15.193:0/819056387 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f73a00ce030 con 0x5653dfd711f0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 0x7f729403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f729be07640 1 -- 172.21.15.193:0/819056387 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f73a00cc020 con 0x5653dfd711f0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73aed28640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 0x7f729403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 0x5653dfe6aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe6b430 con 0x5653dfd74330 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73afd2a640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 0x5653dfe6aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73aed28640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 0x7f729403bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7398001640 tx=0x7f73980066a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73afd2a640 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 0x5653dfe6aef0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73afd2a640 1 -- 172.21.15.193:0/819056387 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a80083f0 con 0x5653dfd74330 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe6b880 con 0x5653dfd74330 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73afd2a640 1 -- 172.21.15.193:0/819056387 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73a80083f0 con 0x5653dfd74330 2024-09-12T17:11:50.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe6d180 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73afd2a640 1 -- 172.21.15.193:0/819056387 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73a80083f0 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.575+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe6c3b0 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73afd2a640 1 -- 172.21.15.193:0/819056387 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73a80083f0 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe6c7d0 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73afd2a640 1 -- 172.21.15.193:0/819056387 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73a80083f0 con 0x5653dfd74330 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5653dfc84450 con 0x5653dfe7b4e0 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33468/0 (socket says 172.21.15.193:33468) 2024-09-12T17:11:50.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73aed28640 1 -- 172.21.15.193:0/4044519778 learned_addr learned my addr 172.21.15.193:0/4044519778 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73aed28640 1 -- 172.21.15.193:0/4044519778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfe7bf40 con 0x5653dfe7b4e0 2024-09-12T17:11:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73aed28640 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7398004fd0 tx=0x7f7398015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f7299602640 1 -- 172.21.15.193:0/4044519778 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398011440 con 0x5653dfe7b4e0 2024-09-12T17:11:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f7299602640 1 -- 172.21.15.193:0/4044519778 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7398011600 con 0x5653dfe7b4e0 2024-09-12T17:11:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dfe7c7a0 con 0x5653dfe7b4e0 2024-09-12T17:11:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f7299602640 1 -- 172.21.15.193:0/4044519778 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398011920 con 0x5653dfe7b4e0 2024-09-12T17:11:50.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dfe7cd10 con 0x5653dfe7b4e0 2024-09-12T17:11:50.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.579+0000 7f7299602640 1 -- 172.21.15.193:0/4044519778 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7398011ac0 con 0x5653dfe7b4e0 2024-09-12T17:11:50.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f7299602640 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 0x7f728803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f7299602640 1 -- 172.21.15.193:0/4044519778 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f739801b030 con 0x5653dfe7b4e0 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73afd2a640 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 0x7f728803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73afd2a640 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 0x7f728803bf20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5653dfe6c750 tx=0x7f73a8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5653dfe5cfb0 con 0x5653dfe87e40 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33472/0 (socket says 172.21.15.193:33472) 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 -- 172.21.15.193:0/1386832987 learned_addr learned my addr 172.21.15.193:0/1386832987 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 -- 172.21.15.193:0/1386832987 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfe887f0 con 0x5653dfe87e40 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 --2- 172.21.15.193:0/1386832987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7398050230 tx=0x7f739801d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deeb288fc5bedec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f7292ffd640 1 -- 172.21.15.193:0/1386832987 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398043070 con 0x5653dfe87e40 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f7292ffd640 1 -- 172.21.15.193:0/1386832987 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739801dd30 con 0x5653dfe87e40 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f7292ffd640 1 -- 172.21.15.193:0/1386832987 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398013cd0 con 0x5653dfe87e40 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- 172.21.15.193:0/1386832987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 msgr2=0x5653dfe88220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/1386832987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7398050230 tx=0x7f739801d3e0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- 172.21.15.193:0/1386832987 shutdown_connections 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/1386832987 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe88220 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- 172.21.15.193:0/1386832987 >> 172.21.15.193:0/1386832987 conn(0x5653dfe84270 msgr2=0x5653dfe824b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- 172.21.15.193:0/1386832987 shutdown_connections 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- 172.21.15.193:0/1386832987 wait complete. 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 Processor -- start 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- start start 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73b1a239c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5653dfe88e50 con 0x5653dfe87e40 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33476/0 (socket says 172.21.15.193:33476) 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.583+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 learned_addr learned my addr 172.21.15.193:0/2994367055 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653dfe8f920 con 0x5653dfe87e40 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73aed28640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f739801da40 tx=0x7f7398050190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 -- 172.21.15.193:0/2994367055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f739801eb40 con 0x5653dfe87e40 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 -- 172.21.15.193:0/2994367055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739801ece0 con 0x5653dfe87e40 2024-09-12T17:11:50.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5653dfe8fbb0 con 0x5653dfe87e40 2024-09-12T17:11:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 -- 172.21.15.193:0/2994367055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f739801e330 con 0x5653dfe87e40 2024-09-12T17:11:50.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653dfe90560 con 0x5653dfe87e40 2024-09-12T17:11:50.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 -- 172.21.15.193:0/2994367055 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7398039060 con 0x5653dfe87e40 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7278039a70 0x7f727803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f72917fa640 1 -- 172.21.15.193:0/2994367055 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f739803ccf0 con 0x5653dfe87e40 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73afd2a640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7278039a70 0x7f727803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfe9a6a0 0x5653dfe9cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9d280 con 0x5653dfe9a6a0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73af529640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfe9a6a0 0x5653dfe9cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73afd2a640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7278039a70 0x7f727803bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73a800f010 tx=0x7f73a801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73af529640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfe9a6a0 0x5653dfe9cb30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 realm 2024-09-12T17:11:50.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9d690 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9df60 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.587+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9e300 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9eb50 con 0x5653dfe9a6a0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 20 searching for the correct realm 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653dfea08c0 0x5653dfea2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73aed28640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653dfea08c0 0x5653dfea2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73aed28640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653dfea08c0 0x5653dfea2cb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73aed28640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f739803f050 0x7f73980449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73afd2a640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f739803f050 0x7f73980449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73afd2a640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f739803f050 0x7f73980449b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73afd2a640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f73a8019040 0x7f73a8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f73a8019040 0x7f73a8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f73a8019040 0x7f73a8019930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.591+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.595+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.599+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfea08c0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f73a8019040 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea31f0 con 0x7f739803f050 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9f530 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9fdd0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea3590 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 zone default found 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 4 Realm: () 2024-09-12T17:11:50.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 zonegroup default 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfe9fa20 con 0x7f73a8019040 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.603+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea5980 con 0x5653dfea08c0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea5d50 con 0x5653dfea08c0 2024-09-12T17:11:50.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 20 started sync module instance, tier type = 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea4e10 con 0x7f739803f050 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94918238949888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea4a70 con 0x7f739803f050 2024-09-12T17:11:50.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94918238949888] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94918238953904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.607+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea7640 con 0x5653dfea08c0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94918238953904] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94918238955472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea6bf0 con 0x5653dfea08c0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea8340 con 0x7f739803f050 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94918238961600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea8be0 con 0x7f739803f050 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.611+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea95e0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94918238955472] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94918238961600] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94918238960096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea8730 con 0x5653dfe9a6a0 2024-09-12T17:11:50.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea9eb0 con 0x7f73a8019040 2024-09-12T17:11:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94918238960096] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94918238966000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfea8730 con 0x7f73a8019040 2024-09-12T17:11:50.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.615+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeaa350 con 0x7f73a8019040 2024-09-12T17:11:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94918238969376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeaa7c0 con 0x7f73a8019040 2024-09-12T17:11:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeab290 con 0x7f73a8019040 2024-09-12T17:11:50.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94918238966000] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94918238969376] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.619+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94918238973312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeaa310 con 0x7f73a8019040 2024-09-12T17:11:50.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=0 2024-09-12T17:11:50.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=1 2024-09-12T17:11:50.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=2 2024-09-12T17:11:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=3 2024-09-12T17:11:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=4 2024-09-12T17:11:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=5 2024-09-12T17:11:50.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=6 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94918238973312] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 add_watcher() i=7 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeae390 con 0x5653dfe9a6a0 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94918238967728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeab810 con 0x5653dfe9a6a0 2024-09-12T17:11:50.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94918238967728] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f72667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:50.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.623+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb6940 con 0x5653dfe9a6a0 2024-09-12T17:11:50.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.627+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.627+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb6f00 con 0x7f73a8019040 2024-09-12T17:11:50.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.627+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.627+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb6f00 con 0x5653dfea08c0 2024-09-12T17:11:50.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb72a0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb72a0 con 0x7f739803f050 2024-09-12T17:11:50.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb7810 con 0x5653dfea08c0 2024-09-12T17:11:50.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.631+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb7c40 con 0x5653dfe9a6a0 2024-09-12T17:11:50.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.635+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.635+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb7c40 con 0x7f73a8019040 2024-09-12T17:11:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb7c40 con 0x7f739803f050 2024-09-12T17:11:50.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb81b0 con 0x5653dfea08c0 2024-09-12T17:11:50.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.639+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8550 con 0x7f739803f050 2024-09-12T17:11:50.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.643+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.643+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ac0 con 0x7f73a8019040 2024-09-12T17:11:50.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.643+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.643+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ac0 con 0x7f739803f050 2024-09-12T17:11:50.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ca0 con 0x7f73a8019040 2024-09-12T17:11:50.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ca0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.647+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ca0 con 0x5653dfea08c0 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.651+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.651+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ca0 con 0x7f739803f050 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.651+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.651+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8d70 con 0x5653dfea08c0 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb9130 con 0x5653dfe9a6a0 2024-09-12T17:11:50.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8f40 con 0x5653dfe9a6a0 2024-09-12T17:11:50.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.655+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8d70 con 0x5653dfea08c0 2024-09-12T17:11:50.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8d70 con 0x7f739803f050 2024-09-12T17:11:50.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8e80 con 0x5653dfea08c0 2024-09-12T17:11:50.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.659+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8e40 con 0x5653dfea08c0 2024-09-12T17:11:50.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8e80 con 0x5653dfea08c0 2024-09-12T17:11:50.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8e80 con 0x5653dfea08c0 2024-09-12T17:11:50.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.663+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb8ea0 con 0x7f73a8019040 2024-09-12T17:11:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.667+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.667+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb9510 con 0x5653dfea08c0 2024-09-12T17:11:50.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.667+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.667+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb94f0 con 0x7f73a8019040 2024-09-12T17:11:50.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.671+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.671+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb94f0 con 0x5653dfea08c0 2024-09-12T17:11:50.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.671+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.671+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb94f0 con 0x7f73a8019040 2024-09-12T17:11:50.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.675+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.675+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb94f0 con 0x7f739803f050 2024-09-12T17:11:50.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f72657e2640 20 reqs_thread_entry: start 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 Filter name: none 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f725e7fc640 20 reqs_thread_entry: start 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:11:50.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfed4520 con 0x7f739803f050 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 : miss 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:95 8.16 8:6dfcd5b2:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfed5cb0 con 0x5653dfea08c0 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(95 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:11:50.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 info.flags=0x17 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 to cache LRU end 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 4.2 4:4001b976:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff531f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(96 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 4.3d 4:bc571a61:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff531f0 con 0x5653dfea08c0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(97 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff53230 con 0x5653dfe9a6a0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(98 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 4.c 4:317d90e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537c0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(99 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:100 4.3a 4:5e7081f9:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537c0 con 0x5653dfea08c0 2024-09-12T17:11:50.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(100 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.679+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:101 4.a 4:51e3f733:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537c0 con 0x7f739803f050 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(101 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:102 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537c0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(102 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [call out=430b] v0'0 uv4 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 4.4 4:2084a7c2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537a0 con 0x7f73a8019040 2024-09-12T17:11:50.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(103 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:104 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537a0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(104 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [call out=430b] v0'0 uv3 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:105 4.30 4:0e82fbe5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537a0 con 0x5653dfea08c0 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(105 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:106 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff537a0 con 0x7f73a8019040 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(106 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [call out=702b] v0'0 uv17 ondisk = 0) ==== 195+0+702 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.683+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:107 3.25s0 3:a52491ba:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50be0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(107 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 10 manifest: total_size = 6 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.3795589176757612681 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 prepare_atomic_modification: state is not atomic. state=0x5653dff526e8 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:108 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedae20 con 0x5653dfe9a6a0 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(108 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:109 3.25s0 3:a52491ba:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedae20 con 0x5653dfe9a6a0 2024-09-12T17:11:50.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(109 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:110 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedb8b0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:111 3.1cs0 3:38436925:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedb8b0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(111 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 10 manifest: total_size = 3 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.16452270766217649477 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 prepare_atomic_modification: state is not atomic. state=0x5653dff526e8 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.687+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:112 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee0560 con 0x5653dfe9a6a0 2024-09-12T17:11:50.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(110 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f7292ffd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-12T17:11:50.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(112 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:113 3.1cs0 3:38436925:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedb990 con 0x5653dfe9a6a0 2024-09-12T17:11:50.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(113 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:114 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedc070 con 0x5653dfe9a6a0 2024-09-12T17:11:50.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.691+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:115 3.1ds0 3:b92f5fce:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedc800 con 0x5653dfea08c0 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(115 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 10 manifest: total_size = 4 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15691459584238319913 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 20 prepare_atomic_modification: state is not atomic. state=0x5653dff526e8 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 2024-09-12T17:11:50.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:116 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee0c40 con 0x5653dfe9a6a0 2024-09-12T17:11:50.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(114 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f72927fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-12T17:11:50.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(116 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:117 3.1ds0 3:b92f5fce:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedc070 con 0x5653dfea08c0 2024-09-12T17:11:50.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(117 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:118 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedcc00 con 0x5653dfe9a6a0 2024-09-12T17:11:50.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.695+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:119 3.fs0 3:f05c0315:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedcc00 con 0x7f739803f050 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(119 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 10 manifest: total_size = 5 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15521160820457066174 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 20 prepare_atomic_modification: state is not atomic. state=0x5653dff526e8 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 2024-09-12T17:11:50.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:120 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedcc00 con 0x7f73a8019040 2024-09-12T17:11:50.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(118 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f7292ffd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-12T17:11:50.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(120 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [stat,call,call] v34'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.699+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:121 3.fs0 3:f05c0315:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedcb50 con 0x7f739803f050 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(121 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:122 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedcb50 con 0x7f73a8019040 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:123 3.3bs0 3:de915c96:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeddb40 con 0x5653dfea08c0 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(123 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 10 manifest: total_size = 5 2024-09-12T17:11:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 20 get_obj_state: setting s->obj_tag to _rG1udYC_PgheORifBTjuldbiPtqA4fg 2024-09-12T17:11:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 20 get_obj_state: octx=0x7f73a00057d0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5653dff526e8 s->prefetch_data=0 2024-09-12T17:11:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 20 prepare_atomic_modification: state is not atomic. state=0x5653dff526e8 2024-09-12T17:11:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 2024-09-12T17:11:50.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:124 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee0b70 con 0x7f73a8019040 2024-09-12T17:11:50.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(122 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f72927fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-12T17:11:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(124 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [stat,call,call] v34'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.703+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:125 3.3bs0 3:de915c96:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfed6b30 con 0x5653dfea08c0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(125 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:126 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedda60 con 0x7f73a8019040 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:127 4.2 4:4001b976:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedda60 con 0x5653dfe9a6a0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:128 4.3d 4:bc571a61:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff529b0 con 0x5653dfea08c0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:129 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee05f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:130 4.c 4:317d90e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee7260 con 0x5653dfe9a6a0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:131 4.3a 4:5e7081f9:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff529b0 con 0x5653dfea08c0 2024-09-12T17:11:50.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:132 4.a 4:51e3f733:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee7260 con 0x7f739803f050 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:133 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeee4f0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:134 4.4 4:2084a7c2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef1210 con 0x7f73a8019040 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:135 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef4060 con 0x5653dfe9a6a0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:136 4.30 4:0e82fbe5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef6a30 con 0x5653dfea08c0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:137 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfee7260 con 0x7f73a8019040 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(128 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(132 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(127 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(136 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== osd_op_reply(129 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(131 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f739800f070 con 0x5653dfea08c0 2024-09-12T17:11:50.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(130 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(133 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== osd_op_reply(135 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.707+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(134 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(126 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [stat,call,call] v34'21 uv21 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f7292ffd640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(137 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [call out=128b] v0'0 uv21 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5])"; uploads.size()=0; is_truncated=0 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:138 4.2 4:4001b976:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef4060 con 0x5653dfe9a6a0 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:139 4.3d 4:bc571a61:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef6a30 con 0x5653dfea08c0 2024-09-12T17:11:50.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:140 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef38d0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:141 4.c 4:317d90e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff52500 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:142 4.3a 4:5e7081f9:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef0a00 con 0x5653dfea08c0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:143 4.a 4:51e3f733:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef38d0 con 0x7f739803f050 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:144 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef6a30 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:145 4.4 4:2084a7c2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef3c70 con 0x7f73a8019040 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:146 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff52500 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 4.30 4:0e82fbe5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfef38d0 con 0x5653dfea08c0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:148 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeec4d0 con 0x7f73a8019040 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(139 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(146 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 50 ==== osd_op_reply(141 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(143 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 51 ==== osd_op_reply(138 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 52 ==== osd_op_reply(140 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 53 ==== osd_op_reply(144 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(142 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(147 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(145 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(148 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [call out=128b] v0'0 uv21 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.711+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f739803f050 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73b1a239c0 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-12T17:11:50.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f739803f050 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73b1a239c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73b1a239c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94918239193696 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f73a8019040 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== watch-notify(notify (1) cookie 94918238969376 notify 146028888076 ret 0) ==== 191+0+0 (crc 0 0 0) 0x5653dfeb87f0 con 0x7f73a8019040 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f7292ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94918238969376 notifier 4650 bl.length()=149 2024-09-12T17:11:50.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f7292ffd640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f7274003d70 con 0x7f73a8019040 2024-09-12T17:11:50.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.715+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(151 notify.6 [notify cookie 94918239193696 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== watch-notify(notify_complete (2) cookie 94918239193696 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f73a00e4040 con 0x7f73a8019040 2024-09-12T17:11:50.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:153 8.16 8:6dfcd5b2:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfea08c0 2024-09-12T17:11:50.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(153 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 from cache 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5, ofs0, ns] 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:154 7.0 7:05bf5b68:::notify.1:head [notify cookie 94918239193696 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfe9a6a0 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 54 ==== watch-notify(notify (1) cookie 94918238953904 notify 146028888097 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f73a00e4040 con 0x5653dfe9a6a0 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f72927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94918238953904 notifier 4650 bl.length()=206 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f72927fc640 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:155 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f71d80032d0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 55 ==== osd_op_reply(154 notify.1 [notify cookie 94918239193696 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 56 ==== watch-notify(notify_complete (2) cookie 94918239193696 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5653dfe64f20 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 57 ==== osd_op_reply(155 notify.1 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:156 4.2 4:4001b976:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:157 4.3d 4:bc571a61:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfedd5b0 con 0x5653dfea08c0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:158 4.22 4:445f9084:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff529b0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:159 4.c 4:317d90e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfed49d0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:160 4.3a 4:5e7081f9:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x5653dfea08c0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:161 4.a 4:51e3f733:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb5710 con 0x7f739803f050 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:162 4.2 4:41c2a568:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfe9a6a0 2024-09-12T17:11:50.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:163 4.4 4:2084a7c2:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb5af0 con 0x7f73a8019040 2024-09-12T17:11:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:164 4.9 4:93ca1cfb:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfed49d0 con 0x5653dfe9a6a0 2024-09-12T17:11:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:165 4.30 4:0e82fbe5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x5653dfea08c0 2024-09-12T17:11:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.719+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:166 4.7 4:e1563032:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f73a8019040 2024-09-12T17:11:50.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(161 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(165 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(160 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.4 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 58 ==== osd_op_reply(159 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.3 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 59 ==== osd_op_reply(156 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.0 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 60 ==== osd_op_reply(158 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(163 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(157 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.1 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 61 ==== osd_op_reply(162 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(166 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.10 [delete] v34'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 62 ==== osd_op_reply(164 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 : miss 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:167 6.a 6:56fccca0:::pubsub..bucket.myfoo%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x7f739803f050 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(167 pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 info.flags=0x0 2024-09-12T17:11:50.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 10 adding default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 to cache LRU end 2024-09-12T17:11:50.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:168 6.a 6:56fccca0:::pubsub..bucket.myfoo%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f739803f050 2024-09-12T17:11:50.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(168 pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.5 [delete] v34'35 uv31 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.723+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x7f739803f050 2024-09-12T17:11:50.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.727+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.727+0000 7f72667e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.727+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94918238967728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfe9a6a0 2024-09-12T17:11:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.727+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 63 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94918238967728] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.727+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94918238949888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x7f739803f050 2024-09-12T17:11:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94918238949888] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73b1a239c0 20 remove_watcher() i=0 2024-09-12T17:11:50.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73b1a239c0 2 removed watcher, disabling cache 2024-09-12T17:11:50.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94918238953904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x5653dfe9a6a0 2024-09-12T17:11:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 64 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94918238953904] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73b1a239c0 20 remove_watcher() i=1 2024-09-12T17:11:50.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.731+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94918238955472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x5653dfea08c0 2024-09-12T17:11:50.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73aed28640 1 -- 172.21.15.193:0/2994367055 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94918238955472] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398071070 con 0x5653dfea08c0 2024-09-12T17:11:50.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73b1a239c0 20 remove_watcher() i=2 2024-09-12T17:11:50.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94918238961600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f739803f050 2024-09-12T17:11:50.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73afd2a640 1 -- 172.21.15.193:0/2994367055 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94918238961600] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a802f040 con 0x7f739803f050 2024-09-12T17:11:50.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73b1a239c0 20 remove_watcher() i=3 2024-09-12T17:11:50.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.735+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94918238960096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x5653dfe9a6a0 2024-09-12T17:11:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.1 v2:172.21.15.193:6808/1040547927 65 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94918238960096] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x5653dfe9a6a0 2024-09-12T17:11:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73b1a239c0 20 remove_watcher() i=4 2024-09-12T17:11:50.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94918238966000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f73a8019040 2024-09-12T17:11:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94918238966000] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73b1a239c0 20 remove_watcher() i=5 2024-09-12T17:11:50.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.739+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94918238969376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dfeb4e40 con 0x7f73a8019040 2024-09-12T17:11:50.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94918238969376] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 20 remove_watcher() i=6 2024-09-12T17:11:50.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94918238973312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5653dff50c10 con 0x7f73a8019040 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94918238973312] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a00a6c80 con 0x7f73a8019040 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 20 remove_watcher() i=7 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f73a8019040 msgr2=0x7f73a8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f73a8019040 0x7f73a8019930 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfe9a6a0 msgr2=0x5653dfe9cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfe9a6a0 0x5653dfe9cb30 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f739803f050 msgr2=0x7f73980449b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f739803f050 0x7f73980449b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653dfea08c0 msgr2=0x5653dfea2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5653dfea08c0 0x5653dfea2cb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7278039a70 msgr2=0x7f727803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7278039a70 0x7f727803bf30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f73a800f010 tx=0x7f73a801b070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73af529640 1 -- 172.21.15.193:0/2994367055 reap_dead start 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 msgr2=0x5653dfe8f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f739801da40 tx=0x7f7398050190 comp rx=0 tx=0).stop 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 shutdown_connections 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/2994367055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe87e40 0x5653dfe8f3c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 >> 172.21.15.193:0/2994367055 conn(0x5653dfe84270 msgr2=0x5653dfe82480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 shutdown_connections 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/2994367055 wait complete. 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 msgr2=0x7f728803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 0x7f728803bf20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x5653dfe6c750 tx=0x7f73a8003070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 msgr2=0x5653dfe7b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7398004fd0 tx=0x7f7398015820 comp rx=0 tx=0).stop 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 shutdown_connections 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7288039a60 0x7f728803bf20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/4044519778 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfe7b4e0 0x5653dfe7b900 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 >> 172.21.15.193:0/4044519778 conn(0x5653dfe70e90 msgr2=0x5653dfe71270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 shutdown_connections 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.743+0000 7f73b1a239c0 1 -- 172.21.15.193:0/4044519778 wait complete. 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 msgr2=0x5653dfe6aef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 0x5653dfe6aef0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 msgr2=0x7f729403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 0x7f729403bf80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7398001640 tx=0x7f73980066a0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 msgr2=0x5653dfe63d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f73a0018f70 tx=0x7f73a00180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 shutdown_connections 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5653dfd74330 0x5653dfe6aef0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7294039ac0 0x7f729403bf80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 --2- 172.21.15.193:0/819056387 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5653dfd711f0 0x5653dfe63d80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 >> 172.21.15.193:0/819056387 conn(0x5653dfce4b00 msgr2=0x5653dfe56f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 shutdown_connections 2024-09-12T17:11:50.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.747+0000 7f73b1a239c0 1 -- 172.21.15.193:0/819056387 wait complete. 2024-09-12T17:11:50.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:11:50.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:11:50.760 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-12T17:11:50.836 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:50.836 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:50.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.831+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.831+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bda319c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e6c34da7a0 0x55e6c34d9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bda319c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6c34189c0 con 0x55e6c34da270 2024-09-12T17:11:50.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bda319c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e6c34686d0 con 0x55e6c34da7a0 2024-09-12T17:11:50.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e6c34da7a0 0x55e6c34d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e6c34da7a0 0x55e6c34d9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33482/0 (socket says 172.21.15.193:33482) 2024-09-12T17:11:50.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 -- 172.21.15.193:0/1876607975 learned_addr learned my addr 172.21.15.193:0/1876607975 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 -- 172.21.15.193:0/1876607975 >> v1:172.21.15.62:6789/0 conn(0x55e6c34da270 legacy=0x55e6c34d8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 -- 172.21.15.193:0/1876607975 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c340cca0 con 0x55e6c34da7a0 2024-09-12T17:11:50.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50bad36640 1 --2- 172.21.15.193:0/1876607975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da7a0 0x55e6c34d9370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50b400a4e0 tx=0x7f50b401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4d4708afb2f0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50ba535640 1 -- 172.21.15.193:0/1876607975 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40aa540 con 0x55e6c34da7a0 2024-09-12T17:11:50.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50ba535640 1 -- 172.21.15.193:0/1876607975 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40aa6e0 con 0x55e6c34da7a0 2024-09-12T17:11:50.841 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.835+0000 7f50ba535640 1 -- 172.21.15.193:0/1876607975 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40aaa40 con 0x55e6c34da7a0 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 -- 172.21.15.193:0/1876607975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da7a0 msgr2=0x55e6c34d9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1876607975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da7a0 0x55e6c34d9370 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f50b400a4e0 tx=0x7f50b401afd0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 -- 172.21.15.193:0/1876607975 shutdown_connections 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1876607975 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da7a0 0x55e6c34d9370 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 -- 172.21.15.193:0/1876607975 >> 172.21.15.193:0/1876607975 conn(0x55e6c355fa90 msgr2=0x55e6c3561eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 -- 172.21.15.193:0/1876607975 shutdown_connections 2024-09-12T17:11:50.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.839+0000 7f50bda319c0 1 -- 172.21.15.193:0/1876607975 wait complete. 2024-09-12T17:11:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bda319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bda319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e6c346c680 con 0x55e6c34da270 2024-09-12T17:11:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bb537640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bb537640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33492/0 (socket says 172.21.15.193:33492) 2024-09-12T17:11:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bb537640 1 -- 172.21.15.193:0/59250456 learned_addr learned my addr 172.21.15.193:0/59250456 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bb537640 1 -- 172.21.15.193:0/59250456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c33e7da0 con 0x55e6c34da270 2024-09-12T17:11:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f50bb537640 1 --2- 172.21.15.193:0/59250456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50a400b2d0 tx=0x7f50a400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b028f3e3e0ad156 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f4fa8618640 1 -- 172.21.15.193:0/59250456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a400a040 con 0x55e6c34da270 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f4fa8618640 1 -- 172.21.15.193:0/59250456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a400f750 con 0x55e6c34da270 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.851+0000 7f4fa8618640 1 -- 172.21.15.193:0/59250456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a400fa70 con 0x55e6c34da270 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/59250456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 msgr2=0x55e6c3651bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 --2- 172.21.15.193:0/59250456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f50a400b2d0 tx=0x7f50a400b790 comp rx=0 tx=0).stop 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/59250456 shutdown_connections 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 --2- 172.21.15.193:0/59250456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3651bb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/59250456 >> 172.21.15.193:0/59250456 conn(0x55e6c355fa90 msgr2=0x55e6c364d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/59250456 shutdown_connections 2024-09-12T17:11:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/59250456 wait complete. 2024-09-12T17:11:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e6c340ea50 con 0x55e6c34da270 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bb537640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bb537640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33500/0 (socket says 172.21.15.193:33500) 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bb537640 1 -- 172.21.15.193:0/2304708346 learned_addr learned my addr 172.21.15.193:0/2304708346 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bb537640 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c36597e0 con 0x55e6c34da270 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bb537640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c10 tx=0x7f50a4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f4fa6e15640 1 -- 172.21.15.193:0/2304708346 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a401c9f0 con 0x55e6c34da270 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c3659a70 con 0x55e6c34da270 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f4fa6e15640 1 -- 172.21.15.193:0/2304708346 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a401cb90 con 0x55e6c34da270 2024-09-12T17:11:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f4fa6e15640 1 -- 172.21.15.193:0/2304708346 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50a401a480 con 0x55e6c34da270 2024-09-12T17:11:50.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.855+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c365a420 con 0x55e6c34da270 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f4fa6e15640 1 -- 172.21.15.193:0/2304708346 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50a4017050 con 0x55e6c34da270 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f4fa6e15640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 0x7f4fa003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f4fa6e15640 1 -- 172.21.15.193:0/2304708346 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f50a4015020 con 0x55e6c34da270 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bad36640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 0x7f4fa003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 0x55e6c36603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3660930 con 0x55e6c34da7a0 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 0x55e6c36603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bad36640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 0x7f4fa003bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50b40ab000 tx=0x7f50b40a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 0x55e6c36603f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 -- 172.21.15.193:0/2304708346 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50ac0083f0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3660d80 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 -- 172.21.15.193:0/2304708346 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50ac0083f0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3662680 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 -- 172.21.15.193:0/2304708346 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50ac0083f0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36618b0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 -- 172.21.15.193:0/2304708346 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50ac0083f0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3661cd0 con 0x55e6c34da7a0 2024-09-12T17:11:50.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bbd38640 1 -- 172.21.15.193:0/2304708346 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50ac0083f0 con 0x55e6c34da7a0 2024-09-12T17:11:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bda319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e6c3479450 con 0x55e6c36709e0 2024-09-12T17:11:50.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33510/0 (socket says 172.21.15.193:33510) 2024-09-12T17:11:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.859+0000 7f50bad36640 1 -- 172.21.15.193:0/1694061594 learned_addr learned my addr 172.21.15.193:0/1694061594 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bad36640 1 -- 172.21.15.193:0/1694061594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c3671440 con 0x55e6c36709e0 2024-09-12T17:11:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bad36640 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f50b400a190 tx=0x7f50b4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 -- 172.21.15.193:0/1694061594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40c2070 con 0x55e6c36709e0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 -- 172.21.15.193:0/1694061594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40b5be0 con 0x55e6c36709e0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c3671ca0 con 0x55e6c36709e0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 -- 172.21.15.193:0/1694061594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40b9040 con 0x55e6c36709e0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c36721b0 con 0x55e6c36709e0 2024-09-12T17:11:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 -- 172.21.15.193:0/1694061594 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50b40c5070 con 0x55e6c36709e0 2024-09-12T17:11:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 0x7f4f9403bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f4f9ffff640 1 -- 172.21.15.193:0/1694061594 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f50b40ece10 con 0x55e6c36709e0 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bbd38640 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 0x7f4f9403bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bbd38640 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 0x7f4f9403bf20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6c3661c50 tx=0x7f50ac003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bda319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e6c3652400 con 0x55e6c367e2f0 2024-09-12T17:11:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33524/0 (socket says 172.21.15.193:33524) 2024-09-12T17:11:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.863+0000 7f50bad36640 1 -- 172.21.15.193:0/2091921935 learned_addr learned my addr 172.21.15.193:0/2091921935 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 -- 172.21.15.193:0/2091921935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c367ecc0 con 0x55e6c367e2f0 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 --2- 172.21.15.193:0/2091921935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f50b40beb10 tx=0x7f50b40bde20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38048d7c85b8583f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f9dffb640 1 -- 172.21.15.193:0/2091921935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40d5020 con 0x55e6c367e2f0 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f9dffb640 1 -- 172.21.15.193:0/2091921935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40c58e0 con 0x55e6c367e2f0 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f9dffb640 1 -- 172.21.15.193:0/2091921935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40becd0 con 0x55e6c367e2f0 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2091921935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 msgr2=0x55e6c367e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2091921935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f50b40beb10 tx=0x7f50b40bde20 comp rx=0 tx=0).stop 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2091921935 shutdown_connections 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2091921935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c367e6d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2091921935 >> 172.21.15.193:0/2091921935 conn(0x55e6c36796b0 msgr2=0x55e6c36778f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2091921935 shutdown_connections 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2091921935 wait complete. 2024-09-12T17:11:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 Processor -- start 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- start start 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e6c367d1e0 con 0x55e6c367e2f0 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33530/0 (socket says 172.21.15.193:33530) 2024-09-12T17:11:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 learned_addr learned my addr 172.21.15.193:0/2462045194 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c3684d80 con 0x55e6c367e2f0 2024-09-12T17:11:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bad36640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50b40beb10 tx=0x7f50b40eb100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f8bfff640 1 -- 172.21.15.193:0/2462045194 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40cf480 con 0x55e6c367e2f0 2024-09-12T17:11:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c3685010 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c36859c0 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f8bfff640 1 -- 172.21.15.193:0/2462045194 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b40a9750 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.867+0000 7f4f8bfff640 1 -- 172.21.15.193:0/2462045194 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b40a9a30 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f4f8bfff640 1 -- 172.21.15.193:0/2462045194 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f50b40d8020 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f4f8bfff640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f84039a70 0x7f4f8403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f4f8bfff640 1 -- 172.21.15.193:0/2462045194 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f50b40f3d00 con 0x55e6c367e2f0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f84039a70 0x7f4f8403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c368fb30 0x55e6c3691fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3692710 con 0x55e6c368fb30 2024-09-12T17:11:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c368fb30 0x55e6c3691fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f84039a70 0x7f4f8403bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00f010 tx=0x7f50ac01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c368fb30 0x55e6c3691fc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 realm 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3692b20 con 0x55e6c368fb30 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36933f0 con 0x55e6c368fb30 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3693790 con 0x55e6c368fb30 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3693fe0 con 0x55e6c368fb30 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 20 searching for the correct realm 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e6c3695d50 0x55e6c3698140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bad36640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e6c3695d50 0x55e6c3698140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bad36640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e6c3695d50 0x55e6c3698140 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bad36640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50b40da050 0x7f50b40bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50b40da050 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.871+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50b40da050 0x7f50b40bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50b40da050 0x7f50b40bc2d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50ac019040 0x7f50ac019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50ac019040 0x7f50ac019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50ac019040 0x7f50ac019930 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50b40da050 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.875+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50b40da050 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50ac019040 2024-09-12T17:11:50.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.879+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c3695d50 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x7f50b40da050 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3698680 con 0x55e6c368fb30 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x7f50ac019040 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x55e6c3695d50 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x7f50ac019040 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x7f50b40da050 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x55e6c3695d50 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x7f50ac019040 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x55e6c368fb30 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f50a404d040 con 0x7f50b40da050 2024-09-12T17:11:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.883+0000 7f50bda319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3694830 con 0x55e6c368fb30 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3694bd0 con 0x55e6c368fb30 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3694bd0 con 0x55e6c368fb30 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 zone default found 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 4 Realm: () 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 zonegroup default 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36943d0 con 0x7f50ac019040 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369a4a0 con 0x55e6c3695d50 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369a840 con 0x55e6c3695d50 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 started sync module instance, tier type = 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c3699940 con 0x7f50b40da050 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449609317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36995a0 con 0x7f50b40da050 2024-09-12T17:11:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.887+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369b5a0 con 0x55e6c368fb30 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94449609317680] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449609321440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369b560 con 0x55e6c368fb30 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369bfb0 con 0x55e6c3695d50 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94449609321440] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449609325312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369c350 con 0x55e6c3695d50 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.891+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369cd10 con 0x7f50b40da050 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449609329008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369d400 con 0x7f50b40da050 2024-09-12T17:11:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369df00 con 0x55e6c368fb30 2024-09-12T17:11:50.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94449609325312] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94449609329008] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449609333232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369dec0 con 0x55e6c368fb30 2024-09-12T17:11:50.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.895+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369e7d0 con 0x7f50ac019040 2024-09-12T17:11:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94449609333232] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449609322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369dec0 con 0x7f50ac019040 2024-09-12T17:11:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369ec70 con 0x7f50ac019040 2024-09-12T17:11:50.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94449609322496] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449609335504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369eba0 con 0x7f50ac019040 2024-09-12T17:11:50.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.899+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369f670 con 0x7f50ac019040 2024-09-12T17:11:50.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94449609335504] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449609336560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369eb10 con 0x7f50ac019040 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=0 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=1 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=2 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=3 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=4 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=5 2024-09-12T17:11:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=6 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94449609336560] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x7f50ac019040 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 20 add_watcher() i=7 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36a2b10 con 0x55e6c368fb30 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.903+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449609340464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369ffd0 con 0x55e6c368fb30 2024-09-12T17:11:50.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94449609340464] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 5 note: GC not initialized 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f6b7fe640 20 reqs_thread_entry: start 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 Filter name: none 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f697fa640 20 reqs_thread_entry: start 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:50.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c5d60 con 0x55e6c368fb30 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36cbe40 con 0x55e6c368fb30 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f50a402e070 con 0x55e6c368fb30 2024-09-12T17:11:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94449609521344 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c77e0 con 0x55e6c368fb30 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94449609333232 notify 146028888098 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f50a4048040 con 0x55e6c368fb30 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f9dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94449609333232 notifier 4657 bl.length()=579 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f9dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f9dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f4f9dffb640 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f4f80003eb0 con 0x55e6c368fb30 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94449609521344 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f50a405c040 con 0x55e6c368fb30 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x55e6c368fb30 2024-09-12T17:11:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.907+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94449609521344 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f50a4038040 con 0x55e6c368fb30 2024-09-12T17:11:50.915 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:50.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f4f717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:50.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449609340464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c3b70 con 0x55e6c368fb30 2024-09-12T17:11:50.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94449609340464] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x55e6c368fb30 2024-09-12T17:11:50.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449609317680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c3b70 con 0x7f50b40da050 2024-09-12T17:11:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94449609317680] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bda319c0 20 remove_watcher() i=0 2024-09-12T17:11:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bda319c0 2 removed watcher, disabling cache 2024-09-12T17:11:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.911+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449609321440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c3b70 con 0x55e6c368fb30 2024-09-12T17:11:50.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94449609321440] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x55e6c368fb30 2024-09-12T17:11:50.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 20 remove_watcher() i=1 2024-09-12T17:11:50.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449609325312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c36c3b70 con 0x55e6c3695d50 2024-09-12T17:11:50.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bad36640 1 -- 172.21.15.193:0/2462045194 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94449609325312] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b40ce070 con 0x55e6c3695d50 2024-09-12T17:11:50.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 20 remove_watcher() i=2 2024-09-12T17:11:50.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449609329008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369bb00 con 0x7f50b40da050 2024-09-12T17:11:50.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bbd38640 1 -- 172.21.15.193:0/2462045194 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94449609329008] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50ac02f040 con 0x7f50b40da050 2024-09-12T17:11:50.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 20 remove_watcher() i=3 2024-09-12T17:11:50.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.915+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449609333232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369c970 con 0x55e6c368fb30 2024-09-12T17:11:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94449609333232] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x55e6c368fb30 2024-09-12T17:11:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bda319c0 20 remove_watcher() i=4 2024-09-12T17:11:50.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449609322496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369bb00 con 0x7f50ac019040 2024-09-12T17:11:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94449609322496] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x7f50ac019040 2024-09-12T17:11:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bda319c0 20 remove_watcher() i=5 2024-09-12T17:11:50.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.919+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449609335504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369bb00 con 0x7f50ac019040 2024-09-12T17:11:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94449609335504] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x7f50ac019040 2024-09-12T17:11:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 20 remove_watcher() i=6 2024-09-12T17:11:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449609336560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6c369b090 con 0x7f50ac019040 2024-09-12T17:11:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94449609336560] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50a405c040 con 0x7f50ac019040 2024-09-12T17:11:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 20 remove_watcher() i=7 2024-09-12T17:11:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50ac019040 msgr2=0x7f50ac019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f50ac019040 0x7f50ac019930 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c368fb30 msgr2=0x55e6c3691fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c368fb30 0x55e6c3691fc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50b40da050 msgr2=0x7f50b40bc2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f50b40da050 0x7f50b40bc2d0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e6c3695d50 msgr2=0x55e6c3698140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e6c3695d50 0x55e6c3698140 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f84039a70 msgr2=0x7f4f8403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f84039a70 0x7f4f8403bf30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00f010 tx=0x7f50ac01b070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bb537640 1 -- 172.21.15.193:0/2462045194 reap_dead start 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 msgr2=0x55e6c3684820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.923+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f50b40beb10 tx=0x7f50b40eb100 comp rx=0 tx=0).stop 2024-09-12T17:11:50.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 shutdown_connections 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2462045194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c367e2f0 0x55e6c3684820 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 >> 172.21.15.193:0/2462045194 conn(0x55e6c36796b0 msgr2=0x55e6c36778c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 shutdown_connections 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2462045194 wait complete. 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 msgr2=0x7f4f9403bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 0x7f4f9403bf20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6c3661c50 tx=0x7f50ac003070 comp rx=0 tx=0).stop 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 msgr2=0x55e6c3670e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f50b400a190 tx=0x7f50b4017d70 comp rx=0 tx=0).stop 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 shutdown_connections 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4f94039a60 0x7f4f9403bf20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/1694061594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c36709e0 0x55e6c3670e00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 >> 172.21.15.193:0/1694061594 conn(0x55e6c3666390 msgr2=0x55e6c3666770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 shutdown_connections 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/1694061594 wait complete. 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 msgr2=0x55e6c36603f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 0x55e6c36603f0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 msgr2=0x7f4fa003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 0x7f4fa003bf30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50b40ab000 tx=0x7f50b40a5000 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 msgr2=0x55e6c3659280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f50a4000c10 tx=0x7f50a4000ee0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 shutdown_connections 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e6c34da7a0 0x55e6c36603f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4fa0039a70 0x7f4fa003bf30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 --2- 172.21.15.193:0/2304708346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e6c34da270 0x55e6c3659280 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 >> 172.21.15.193:0/2304708346 conn(0x55e6c355fa90 msgr2=0x55e6c364c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 shutdown_connections 2024-09-12T17:11:50.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:50.927+0000 7f50bda319c0 1 -- 172.21.15.193:0/2304708346 wait complete. 2024-09-12T17:11:50.939 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:50.939 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:11:50.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-12T17:11:50.940 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-12T17:11:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9ab017d9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5643b88d81f0 0x5643b8969020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9ab017d9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643b88189c0 con 0x5643b88d85d0 2024-09-12T17:11:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9ab017d9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5643b88686d0 con 0x5643b88d81f0 2024-09-12T17:11:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aadc83640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5643b88d81f0 0x5643b8969020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aadc83640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5643b88d81f0 0x5643b8969020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33538/0 (socket says 172.21.15.193:33538) 2024-09-12T17:11:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aadc83640 1 -- 172.21.15.193:0/2327474196 learned_addr learned my addr 172.21.15.193:0/2327474196 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aad482640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5643b88d85d0 0x5643b896b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47576/0 (socket says 172.21.15.193:47576) 2024-09-12T17:11:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aadc83640 1 -- 172.21.15.193:0/2327474196 >> v1:172.21.15.62:6789/0 conn(0x5643b88d85d0 legacy=0x5643b896b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.015+0000 7f9aadc83640 1 -- 172.21.15.193:0/2327474196 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b880cca0 con 0x5643b88d81f0 2024-09-12T17:11:51.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2327474196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8969020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000a5c0 tx=0x7f9aa001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e36cc5a066d7a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9aacc81640 1 -- 172.21.15.193:0/2327474196 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00a6070 con 0x5643b88d81f0 2024-09-12T17:11:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9aacc81640 1 -- 172.21.15.193:0/2327474196 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa00af070 con 0x5643b88d81f0 2024-09-12T17:11:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9aacc81640 1 -- 172.21.15.193:0/2327474196 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00aa5c0 con 0x5643b88d81f0 2024-09-12T17:11:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2327474196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 msgr2=0x5643b8969020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2327474196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8969020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000a5c0 tx=0x7f9aa001b340 comp rx=0 tx=0).stop 2024-09-12T17:11:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2327474196 shutdown_connections 2024-09-12T17:11:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2327474196 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8969020 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2327474196 >> 172.21.15.193:0/2327474196 conn(0x5643b895e910 msgr2=0x5643b8960d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2327474196 shutdown_connections 2024-09-12T17:11:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.019+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2327474196 wait complete. 2024-09-12T17:11:51.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.031+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.031+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.031+0000 7f9ab017d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.031+0000 7f9ab017d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5643b886c680 con 0x5643b88d81f0 2024-09-12T17:11:51.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33548/0 (socket says 172.21.15.193:33548) 2024-09-12T17:11:51.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 -- 172.21.15.193:0/2345671388 learned_addr learned my addr 172.21.15.193:0/2345671388 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 -- 172.21.15.193:0/2345671388 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b87e7da0 con 0x5643b88d81f0 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2345671388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00ac040 tx=0x7f9aa0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4c671db0dca5fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f999be07640 1 -- 172.21.15.193:0/2345671388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00aa970 con 0x5643b88d81f0 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f999be07640 1 -- 172.21.15.193:0/2345671388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa00aab10 con 0x5643b88d81f0 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f999be07640 1 -- 172.21.15.193:0/2345671388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00aae30 con 0x5643b88d81f0 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2345671388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 msgr2=0x5643b8a518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2345671388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00ac040 tx=0x7f9aa0003030 comp rx=0 tx=0).stop 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2345671388 shutdown_connections 2024-09-12T17:11:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2345671388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a518c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2345671388 >> 172.21.15.193:0/2345671388 conn(0x5643b895e910 msgr2=0x5643b8a4d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2345671388 shutdown_connections 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2345671388 wait complete. 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9ab017d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5643b880ea50 con 0x5643b88d81f0 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33554/0 (socket says 172.21.15.193:33554) 2024-09-12T17:11:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 -- 172.21.15.193:0/1249303459 learned_addr learned my addr 172.21.15.193:0/1249303459 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b8a59390 con 0x5643b88d81f0 2024-09-12T17:11:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.035+0000 7f9aadc83640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9aa001b170 tx=0x7f9aa00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 -- 172.21.15.193:0/1249303459 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00c6690 con 0x5643b88d81f0 2024-09-12T17:11:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b8a59620 con 0x5643b88d81f0 2024-09-12T17:11:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 -- 172.21.15.193:0/1249303459 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa00cc070 con 0x5643b88d81f0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 -- 172.21.15.193:0/1249303459 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa00c69a0 con 0x5643b88d81f0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b8a59f80 con 0x5643b88d81f0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 -- 172.21.15.193:0/1249303459 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9aa00c6c10 con 0x5643b88d81f0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 0x7f999403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f999a604640 1 -- 172.21.15.193:0/1249303459 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9aa00ebe90 con 0x5643b88d81f0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aad482640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 0x7f999403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 0x5643b8a5ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a60490 con 0x5643b88d85d0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 0x5643b8a5ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aad482640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 0x7f999403bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001e90 tx=0x7f9aa40013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 0x5643b8a5ff50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 -- 172.21.15.193:0/1249303459 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa800a4d0 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a60870 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 -- 172.21.15.193:0/1249303459 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9aa800a4d0 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a62170 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 -- 172.21.15.193:0/1249303459 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9aa800a4d0 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a613a0 con 0x5643b88d85d0 2024-09-12T17:11:51.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 -- 172.21.15.193:0/1249303459 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9aa800a4d0 con 0x5643b88d85d0 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a617c0 con 0x5643b88d85d0 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.039+0000 7f9aae484640 1 -- 172.21.15.193:0/1249303459 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9aa800a4d0 con 0x5643b88d85d0 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5643b8879450 con 0x5643b8a704c0 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33570/0 (socket says 172.21.15.193:33570) 2024-09-12T17:11:51.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aad482640 1 -- 172.21.15.193:0/216920042 learned_addr learned my addr 172.21.15.193:0/216920042 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aad482640 1 -- 172.21.15.193:0/216920042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b8a70f20 con 0x5643b8a704c0 2024-09-12T17:11:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aad482640 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400e670 tx=0x7f9aa400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 -- 172.21.15.193:0/216920042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa4022070 con 0x5643b8a704c0 2024-09-12T17:11:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 -- 172.21.15.193:0/216920042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa400d660 con 0x5643b8a704c0 2024-09-12T17:11:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b8a71780 con 0x5643b8a704c0 2024-09-12T17:11:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 -- 172.21.15.193:0/216920042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa4006070 con 0x5643b8a704c0 2024-09-12T17:11:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b8a71cf0 con 0x5643b8a704c0 2024-09-12T17:11:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 -- 172.21.15.193:0/216920042 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9aa4025070 con 0x5643b8a704c0 2024-09-12T17:11:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 0x7f998803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f99937fe640 1 -- 172.21.15.193:0/216920042 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9aa4051ca0 con 0x5643b8a704c0 2024-09-12T17:11:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.043+0000 7f9aae484640 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 0x7f998803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aae484640 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 0x7f998803bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5643b8a61740 tx=0x7f9aa8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5643b8a52050 con 0x5643b8a7de90 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33576/0 (socket says 172.21.15.193:33576) 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 -- 172.21.15.193:0/3586119276 learned_addr learned my addr 172.21.15.193:0/3586119276 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 -- 172.21.15.193:0/3586119276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b8a7e860 con 0x5643b8a7de90 2024-09-12T17:11:51.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 --2- 172.21.15.193:0/3586119276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4050030 tx=0x7f9aa400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae35d41c671ca5a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f99917fa640 1 -- 172.21.15.193:0/3586119276 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa404e030 con 0x5643b8a7de90 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f99917fa640 1 -- 172.21.15.193:0/3586119276 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa401a320 con 0x5643b8a7de90 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f99917fa640 1 -- 172.21.15.193:0/3586119276 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa40268d0 con 0x5643b8a7de90 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/3586119276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 msgr2=0x5643b8a7e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/3586119276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4050030 tx=0x7f9aa400df30 comp rx=0 tx=0).stop 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/3586119276 shutdown_connections 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/3586119276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a7e270 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/3586119276 >> 172.21.15.193:0/3586119276 conn(0x5643b8a79250 msgr2=0x5643b8a77490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/3586119276 shutdown_connections 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/3586119276 wait complete. 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 Processor -- start 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- start start 2024-09-12T17:11:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9ab017d9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5643b8a7cd80 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33592/0 (socket says 172.21.15.193:33592) 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 learned_addr learned my addr 172.21.15.193:0/2376720414 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.047+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643b8a848f0 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aad482640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9aa401bfd0 tx=0x7f9aa404ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 -- 172.21.15.193:0/2376720414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa4036070 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643b8a848f0 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 -- 172.21.15.193:0/2376720414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa401a540 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 -- 172.21.15.193:0/2376720414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa401a820 con 0x5643b8a7de90 2024-09-12T17:11:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643b8a848f0 con 0x5643b8a7de90 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 -- 172.21.15.193:0/2376720414 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9aa401a9c0 con 0x5643b8a7de90 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9978039a70 0x7f997803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f997f7fe640 1 -- 172.21.15.193:0/2376720414 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9aa403bce0 con 0x5643b8a7de90 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aae484640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9978039a70 0x7f997803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b8a8f370 0x5643b8a91800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a91f50 con 0x5643b8a8f370 2024-09-12T17:11:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b8a8f370 0x5643b8a91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aae484640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9978039a70 0x7f997803bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5643b8a60ec0 tx=0x7f9aa801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b8a8f370 0x5643b8a91800 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 realm 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a92360 con 0x5643b8a8f370 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a92c30 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a92fd0 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a93820 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 20 searching for the correct realm 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5643b8a95590 0x5643b8a97980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.051+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aad482640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5643b8a95590 0x5643b8a97980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aad482640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5643b8a95590 0x5643b8a97980 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aad482640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9aa4027060 0x7f9aa4033a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa4027060 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aae484640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9aa4027060 0x7f9aa4033a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aae484640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9aa4027060 0x7f9aa4033a80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aae484640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa8031040 0x7f9aa8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa8031040 0x7f9aa8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa8031040 0x7f9aa8032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.055+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa4027060 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa4027060 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.059+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa4027060 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a8f370 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa4027060 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x5643b8a95590 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.063+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a97ec0 con 0x7f9aa8031040 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9aa0103040 con 0x5643b8a8f370 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f9aa0103040 con 0x7f9aa4027060 2024-09-12T17:11:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa801f070 con 0x7f9aa4027060 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a94070 con 0x5643b8a8f370 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a94410 con 0x5643b8a8f370 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a94410 con 0x5643b8a8f370 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 zone default found 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 4 Realm: () 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 zonegroup default 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a94930 con 0x7f9aa8031040 2024-09-12T17:11:51.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a99ce0 con 0x5643b8a95590 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9a080 con 0x5643b8a95590 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 started sync module instance, tier type = 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:51.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.067+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a99180 con 0x7f9aa4027060 2024-09-12T17:11:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94848860919152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9a8d0 con 0x7f9aa4027060 2024-09-12T17:11:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9b120 con 0x5643b8a8f370 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94848860919152] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94848860922912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9acf0 con 0x5643b8a8f370 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.071+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9b770 con 0x5643b8a95590 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94848860922912] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94848860923968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9ac60 con 0x5643b8a95590 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9c4e0 con 0x7f9aa4027060 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94848860930064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9cd80 con 0x7f9aa4027060 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9d780 con 0x5643b8a8f370 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.075+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94848860923968] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94848860930064] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94848860928864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9c8d0 con 0x5643b8a8f370 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9e020 con 0x7f9aa8031040 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94848860928864] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94848860934800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9c8d0 con 0x7f9aa8031040 2024-09-12T17:11:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.079+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9e4f0 con 0x7f9aa8031040 2024-09-12T17:11:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94848860934800] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94848860938176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9e4b0 con 0x7f9aa8031040 2024-09-12T17:11:51.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9eeb0 con 0x7f9aa8031040 2024-09-12T17:11:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94848860940736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9f2d0 con 0x7f9aa8031040 2024-09-12T17:11:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=0 2024-09-12T17:11:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=1 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=2 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=3 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=4 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=5 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94848860938176] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.083+0000 7f9ab017d9c0 20 add_watcher() i=6 2024-09-12T17:11:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94848860940736] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 add_watcher() i=7 2024-09-12T17:11:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9d9a0 con 0x5643b8a8f370 2024-09-12T17:11:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94848860936608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9f810 con 0x5643b8a8f370 2024-09-12T17:11:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94848860936608] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9963fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 5 note: GC not initialized 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9962fe5640 20 reqs_thread_entry: start 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 Filter name: none 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9960fe1640 20 reqs_thread_entry: start 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac5520 con 0x5643b8a8f370 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 20 rados_obj.operate() r=0 bl.length=403 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.087+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8acb660 con 0x5643b8a8f370 2024-09-12T17:11:51.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94848861122832 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac6fa0 con 0x5643b8a8f370 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== watch-notify(notify (1) cookie 94848860928864 notify 146028888099 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5643b8a59f80 con 0x5643b8a8f370 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f99917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94848860928864 notifier 4664 bl.length()=567 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f99917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f99917fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(64 notify.4 [notify cookie 94848861122832 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f99917fa640 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9970003eb0 con 0x5643b8a8f370 2024-09-12T17:11:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== watch-notify(notify_complete (2) cookie 94848861122832 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5643b8a59620 con 0x5643b8a8f370 2024-09-12T17:11:51.097 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-12T17:11:24.179563Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:11:24.179549Z","tags":[],"group_ids":[]} 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9963fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94848860936608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac3300 con 0x5643b8a8f370 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94848860936608] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.091+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94848860919152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac3300 con 0x7f9aa4027060 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94848860919152] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9ab017d9c0 20 remove_watcher() i=0 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9ab017d9c0 2 removed watcher, disabling cache 2024-09-12T17:11:51.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94848860922912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac3300 con 0x5643b8a8f370 2024-09-12T17:11:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94848860922912] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9ab017d9c0 20 remove_watcher() i=1 2024-09-12T17:11:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.095+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94848860923968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9a420 con 0x5643b8a95590 2024-09-12T17:11:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9aad482640 1 -- 172.21.15.193:0/2376720414 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94848860923968] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa4024030 con 0x5643b8a95590 2024-09-12T17:11:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 20 remove_watcher() i=2 2024-09-12T17:11:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94848860930064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac3300 con 0x7f9aa4027060 2024-09-12T17:11:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9aae484640 1 -- 172.21.15.193:0/2376720414 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94848860930064] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa8040040 con 0x7f9aa4027060 2024-09-12T17:11:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 20 remove_watcher() i=3 2024-09-12T17:11:51.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94848860928864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9c010 con 0x5643b8a8f370 2024-09-12T17:11:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94848860928864] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x5643b8a8f370 2024-09-12T17:11:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 20 remove_watcher() i=4 2024-09-12T17:11:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.099+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94848860934800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8ac3300 con 0x7f9aa8031040 2024-09-12T17:11:51.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.103+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94848860934800] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.103+0000 7f9ab017d9c0 20 remove_watcher() i=5 2024-09-12T17:11:51.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.103+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94848860938176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9bb60 con 0x7f9aa8031040 2024-09-12T17:11:51.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94848860938176] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 20 remove_watcher() i=6 2024-09-12T17:11:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94848860940736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5643b8a9c010 con 0x7f9aa8031040 2024-09-12T17:11:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94848860940736] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa00c5d00 con 0x7f9aa8031040 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 20 remove_watcher() i=7 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa8031040 msgr2=0x7f9aa8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa8031040 0x7f9aa8032940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b8a8f370 msgr2=0x5643b8a91800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b8a8f370 0x5643b8a91800 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9aa4027060 msgr2=0x7f9aa4033a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9aa4027060 0x7f9aa4033a80 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5643b8a95590 msgr2=0x5643b8a97980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5643b8a95590 0x5643b8a97980 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9978039a70 msgr2=0x7f997803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9978039a70 0x7f997803bf30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5643b8a60ec0 tx=0x7f9aa801f000 comp rx=0 tx=0).stop 2024-09-12T17:11:51.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9aadc83640 1 -- 172.21.15.193:0/2376720414 reap_dead start 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 msgr2=0x5643b8a84390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9aa401bfd0 tx=0x7f9aa404ff90 comp rx=0 tx=0).stop 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 shutdown_connections 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/2376720414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a7de90 0x5643b8a84390 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 >> 172.21.15.193:0/2376720414 conn(0x5643b8a79250 msgr2=0x5643b8a77460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 shutdown_connections 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/2376720414 wait complete. 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 msgr2=0x7f998803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 0x7f998803bf30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5643b8a61740 tx=0x7f9aa8005850 comp rx=0 tx=0).stop 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 msgr2=0x5643b8a708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400e670 tx=0x7f9aa400ea70 comp rx=0 tx=0).stop 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 shutdown_connections 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9988039a70 0x7f998803bf30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/216920042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b8a704c0 0x5643b8a708e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 >> 172.21.15.193:0/216920042 conn(0x5643b8a65e70 msgr2=0x5643b8a66250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 shutdown_connections 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/216920042 wait complete. 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 msgr2=0x5643b8a5ff50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 0x5643b8a5ff50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 msgr2=0x7f999403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 0x7f999403bf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4001e90 tx=0x7f9aa40013f0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 msgr2=0x5643b8a58e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9aa001b170 tx=0x7f9aa00180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 shutdown_connections 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5643b88d85d0 0x5643b8a5ff50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9994039a70 0x7f999403bf30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 --2- 172.21.15.193:0/1249303459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5643b88d81f0 0x5643b8a58e30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 >> 172.21.15.193:0/1249303459 conn(0x5643b895e910 msgr2=0x5643b8a4bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 shutdown_connections 2024-09-12T17:11:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.107+0000 7f9ab017d9c0 1 -- 172.21.15.193:0/1249303459 wait complete. 2024-09-12T17:11:51.122 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-12T17:11:24.179563Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:11:24.179549Z', 'tags': [], 'group_ids': []} 2024-09-12T17:11:51.139 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:51.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:51.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-12T17:11:51.140 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-12T17:11:51.191 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:11:51.191 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:11:51.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b40869c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558afe5fee50 0x558afe5ff230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b40869c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558afe4b49c0 con 0x558afe602030 2024-09-12T17:11:51.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b40869c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558afe5046d0 con 0x558afe5fee50 2024-09-12T17:11:51.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b1b8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558afe5fee50 0x558afe5ff230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b1b8c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558afe5fee50 0x558afe5ff230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33596/0 (socket says 172.21.15.193:33596) 2024-09-12T17:11:51.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b1b8c640 1 -- 172.21.15.193:0/985194792 learned_addr learned my addr 172.21.15.193:0/985194792 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.187+0000 7f65b138b640 1 --1- 172.21.15.193:0/985194792 >> v1:172.21.15.62:6789/0 conn(0x558afe602030 0x558afe604420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:47584/0 (socket says 172.21.15.193:47584) 2024-09-12T17:11:51.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b1b8c640 1 -- 172.21.15.193:0/985194792 >> v1:172.21.15.62:6789/0 conn(0x558afe602030 legacy=0x558afe604420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b1b8c640 1 -- 172.21.15.193:0/985194792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe4a8ca0 con 0x558afe5fee50 2024-09-12T17:11:51.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/985194792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe5ff230 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f65a800a5c0 tx=0x7f65a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a811878b8d704a69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b0b8a640 1 -- 172.21.15.193:0/985194792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80af070 con 0x558afe5fee50 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b0b8a640 1 -- 172.21.15.193:0/985194792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80aa530 con 0x558afe5fee50 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b0b8a640 1 -- 172.21.15.193:0/985194792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80aa830 con 0x558afe5fee50 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 -- 172.21.15.193:0/985194792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 msgr2=0x558afe5ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 --2- 172.21.15.193:0/985194792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe5ff230 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f65a800a5c0 tx=0x7f65a801b340 comp rx=0 tx=0).stop 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 -- 172.21.15.193:0/985194792 shutdown_connections 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 --2- 172.21.15.193:0/985194792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe5ff230 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 -- 172.21.15.193:0/985194792 >> 172.21.15.193:0/985194792 conn(0x558afe5fa970 msgr2=0x558afe5fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 -- 172.21.15.193:0/985194792 shutdown_connections 2024-09-12T17:11:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.191+0000 7f65b40869c0 1 -- 172.21.15.193:0/985194792 wait complete. 2024-09-12T17:11:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.203+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.203+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.203+0000 7f65b40869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.203+0000 7f65b40869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558afe508680 con 0x558afe5fee50 2024-09-12T17:11:51.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33612/0 (socket says 172.21.15.193:33612) 2024-09-12T17:11:51.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 -- 172.21.15.193:0/3603425004 learned_addr learned my addr 172.21.15.193:0/3603425004 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 -- 172.21.15.193:0/3603425004 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe483da0 con 0x558afe5fee50 2024-09-12T17:11:51.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/3603425004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f65a80ad040 tx=0x7f65a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4bf0d8a8336df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f649fe07640 1 -- 172.21.15.193:0/3603425004 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80af040 con 0x558afe5fee50 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f649fe07640 1 -- 172.21.15.193:0/3603425004 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80aab30 con 0x558afe5fee50 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f649fe07640 1 -- 172.21.15.193:0/3603425004 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80aae10 con 0x558afe5fee50 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- 172.21.15.193:0/3603425004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 msgr2=0x558afe6e9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 --2- 172.21.15.193:0/3603425004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f65a80ad040 tx=0x7f65a8003030 comp rx=0 tx=0).stop 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- 172.21.15.193:0/3603425004 shutdown_connections 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 --2- 172.21.15.193:0/3603425004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6e9590 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- 172.21.15.193:0/3603425004 >> 172.21.15.193:0/3603425004 conn(0x558afe5fa970 msgr2=0x558afe6e5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- 172.21.15.193:0/3603425004 shutdown_connections 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- 172.21.15.193:0/3603425004 wait complete. 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b40869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558afe4aaa50 con 0x558afe5fee50 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33628/0 (socket says 172.21.15.193:33628) 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1806893497 learned_addr learned my addr 172.21.15.193:0/1806893497 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.207+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe6f1080 con 0x558afe5fee50 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65a801bbe0 tx=0x7f65a80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 -- 172.21.15.193:0/1806893497 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80c2070 con 0x558afe5fee50 2024-09-12T17:11:51.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558afe6f1310 con 0x558afe5fee50 2024-09-12T17:11:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 -- 172.21.15.193:0/1806893497 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80b5b80 con 0x558afe5fee50 2024-09-12T17:11:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 -- 172.21.15.193:0/1806893497 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a80cc060 con 0x558afe5fee50 2024-09-12T17:11:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afe6f1cc0 con 0x558afe5fee50 2024-09-12T17:11:51.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 -- 172.21.15.193:0/1806893497 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65a80c5070 con 0x558afe5fee50 2024-09-12T17:11:51.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 0x7f649803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f649e604640 1 -- 172.21.15.193:0/1806893497 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f65a80ba070 con 0x558afe5fee50 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b138b640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 0x7f649803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 0x558afe6f7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe6f81d0 con 0x558afe602030 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 0x558afe6f7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b138b640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 0x7f649803bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f65a400d450 tx=0x7f65a4008550 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 0x558afe6f7c90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 -- 172.21.15.193:0/1806893497 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65ac00a4d0 con 0x558afe602030 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe6f85b0 con 0x558afe602030 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 -- 172.21.15.193:0/1806893497 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65ac00a4d0 con 0x558afe602030 2024-09-12T17:11:51.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe6f9eb0 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 -- 172.21.15.193:0/1806893497 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65ac00a4d0 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe6f90e0 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b238d640 1 -- 172.21.15.193:0/1806893497 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65ac00a4d0 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.211+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe6f9500 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b238d640 1 -- 172.21.15.193:0/1806893497 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65ac00a4d0 con 0x558afe602030 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558afe515450 con 0x558afe708200 2024-09-12T17:11:51.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33634/0 (socket says 172.21.15.193:33634) 2024-09-12T17:11:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b138b640 1 -- 172.21.15.193:0/991245523 learned_addr learned my addr 172.21.15.193:0/991245523 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b138b640 1 -- 172.21.15.193:0/991245523 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe708c60 con 0x558afe708200 2024-09-12T17:11:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b138b640 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f65a4008790 tx=0x7f65a4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 -- 172.21.15.193:0/991245523 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a400be50 con 0x558afe708200 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558afe7094c0 con 0x558afe708200 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afe709a30 con 0x558afe708200 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 -- 172.21.15.193:0/991245523 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4015860 con 0x558afe708200 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 -- 172.21.15.193:0/991245523 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4015b40 con 0x558afe708200 2024-09-12T17:11:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 -- 172.21.15.193:0/991245523 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65a4015ce0 con 0x558afe708200 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 0x7f648c03c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f64977fe640 1 -- 172.21.15.193:0/991245523 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f65a401e070 con 0x558afe708200 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b238d640 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 0x7f648c03c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.215+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b238d640 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 0x7f648c03c0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x558afe6f9480 tx=0x7f65ac005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558afe6e9d20 con 0x558afe715b70 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33646/0 (socket says 172.21.15.193:33646) 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 -- 172.21.15.193:0/3106806240 learned_addr learned my addr 172.21.15.193:0/3106806240 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 -- 172.21.15.193:0/3106806240 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe716560 con 0x558afe715b70 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- 172.21.15.193:0/3106806240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f65a4052c00 tx=0x7f65a402ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530a9832ecf37385 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f64957fa640 1 -- 172.21.15.193:0/3106806240 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a404a070 con 0x558afe715b70 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f64957fa640 1 -- 172.21.15.193:0/3106806240 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4021cc0 con 0x558afe715b70 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f64957fa640 1 -- 172.21.15.193:0/3106806240 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4006a80 con 0x558afe715b70 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- 172.21.15.193:0/3106806240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 msgr2=0x558afe715f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 --2- 172.21.15.193:0/3106806240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f65a4052c00 tx=0x7f65a402ad70 comp rx=0 tx=0).stop 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- 172.21.15.193:0/3106806240 shutdown_connections 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 --2- 172.21.15.193:0/3106806240 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe715f70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- 172.21.15.193:0/3106806240 >> 172.21.15.193:0/3106806240 conn(0x558afe710f90 msgr2=0x558afe70f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- 172.21.15.193:0/3106806240 shutdown_connections 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- 172.21.15.193:0/3106806240 wait complete. 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 Processor -- start 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- start start 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe71c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b40869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558afe714ac0 con 0x558afe715b70 2024-09-12T17:11:51.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe71c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe71c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33660/0 (socket says 172.21.15.193:33660) 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 learned_addr learned my addr 172.21.15.193:0/1896345267 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afe71c600 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.219+0000 7f65b138b640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe71c0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f65a4042040 tx=0x7f65a4052b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 -- 172.21.15.193:0/1896345267 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a404a040 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558afe71c890 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afe71d240 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 -- 172.21.15.193:0/1896345267 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4051780 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 -- 172.21.15.193:0/1896345267 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65a4054b70 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 -- 172.21.15.193:0/1896345267 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f65a403a020 con 0x558afe715b70 2024-09-12T17:11:51.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039a70 0x7f647c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f64837fe640 1 -- 172.21.15.193:0/1896345267 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f65a4038020 con 0x558afe715b70 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b238d640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039a70 0x7f647c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe7273e0 0x558afe729870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe729fc0 con 0x558afe7273e0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe7273e0 0x558afe729870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b238d640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039a70 0x7f647c03bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x558afe6f8c00 tx=0x7f65ac01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe7273e0 0x558afe729870 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 realm 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72a3d0 con 0x558afe7273e0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72aca0 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72b040 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72b890 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 20 searching for the correct realm 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558afe72d600 0x558afe72f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.223+0000 7f65b138b640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558afe72d600 0x558afe72f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b138b640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558afe72d600 0x558afe72f9f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b138b640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65a4033070 0x7f65a40215e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b238d640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65a4033070 0x7f65a40215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b238d640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65a4033070 0x7f65a40215e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b238d640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f65ac031040 0x7f65ac032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:11:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f65ac031040 0x7f65ac032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:11:51.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f65ac031040 0x7f65ac032940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.227+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.231+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.244 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe72d600 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.235+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65ac031040 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x558afe7273e0 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ff30 con 0x7f65a4033070 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac01f070 con 0x7f65a4033070 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:11:51.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72c1e0 con 0x558afe7273e0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ca80 con 0x558afe7273e0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe72ca80 con 0x558afe7273e0 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 zone default found 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 4 Realm: () 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 zonegroup default 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe7302d0 con 0x7f65ac031040 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe731dc0 con 0x558afe72d600 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe7322a0 con 0x558afe72d600 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 started sync module instance, tier type = 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:11:51.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe731160 con 0x7f65a4033070 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94055462802768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe730dc0 con 0x7f65a4033070 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.239+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7331d0 con 0x558afe7273e0 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.243+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94055462802768] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.243+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.243+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94055462807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7331d0 con 0x558afe7273e0 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.243+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe733b90 con 0x558afe72d600 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.243+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94055462807296] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94055462808864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe733140 con 0x558afe72d600 2024-09-12T17:11:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7348d0 con 0x7f65a4033070 2024-09-12T17:11:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94055462814688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe735170 con 0x7f65a4033070 2024-09-12T17:11:51.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe735b90 con 0x558afe7273e0 2024-09-12T17:11:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94055462814688] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94055462808864] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94055462819456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe734cc0 con 0x558afe7273e0 2024-09-12T17:11:51.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.247+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe736430 con 0x7f65ac031040 2024-09-12T17:11:51.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.251+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94055462819456] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.251+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.251+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94055462813488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe734cc0 con 0x7f65ac031040 2024-09-12T17:11:51.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.251+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7368a0 con 0x7f65ac031040 2024-09-12T17:11:51.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.251+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94055462813488] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94055462821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe736860 con 0x7f65ac031040 2024-09-12T17:11:51.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe737260 con 0x7f65ac031040 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94055462825328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe737680 con 0x7f65ac031040 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=0 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=1 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=2 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=3 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=4 2024-09-12T17:11:51.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=5 2024-09-12T17:11:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94055462821264] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.255+0000 7f65b40869c0 20 add_watcher() i=6 2024-09-12T17:11:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94055462825328] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 20 add_watcher() i=7 2024-09-12T17:11:51.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:11:51.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe7363b0 con 0x558afe7273e0 2024-09-12T17:11:51.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94055462822832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe737c00 con 0x558afe7273e0 2024-09-12T17:11:51.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94055462822832] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f64637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:11:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:11:51.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe742fe0 con 0x558afe7273e0 2024-09-12T17:11:51.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.259+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe742fe0 con 0x7f65ac031040 2024-09-12T17:11:51.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.263+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.263+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe743490 con 0x558afe72d600 2024-09-12T17:11:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.263+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.263+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe743a60 con 0x558afe7273e0 2024-09-12T17:11:51.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7438e0 con 0x7f65a4033070 2024-09-12T17:11:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'66 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe743f10 con 0x558afe72d600 2024-09-12T17:11:51.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.267+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7443a0 con 0x558afe7273e0 2024-09-12T17:11:51.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.271+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.271+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7443a0 con 0x7f65ac031040 2024-09-12T17:11:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.271+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.271+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7443a0 con 0x7f65a4033070 2024-09-12T17:11:51.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741640 con 0x558afe72d600 2024-09-12T17:11:51.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741640 con 0x7f65a4033070 2024-09-12T17:11:51.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'67 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.275+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741640 con 0x7f65ac031040 2024-09-12T17:11:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741640 con 0x7f65a4033070 2024-09-12T17:11:51.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe744f00 con 0x7f65ac031040 2024-09-12T17:11:51.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.279+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe744f00 con 0x558afe7273e0 2024-09-12T17:11:51.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe744f00 con 0x558afe72d600 2024-09-12T17:11:51.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe744f00 con 0x7f65a4033070 2024-09-12T17:11:51.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'68 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.283+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe744f00 con 0x558afe72d600 2024-09-12T17:11:51.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7450d0 con 0x558afe7273e0 2024-09-12T17:11:51.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7450d0 con 0x558afe7273e0 2024-09-12T17:11:51.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.287+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7450d0 con 0x558afe72d600 2024-09-12T17:11:51.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7450d0 con 0x7f65a4033070 2024-09-12T17:11:51.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741470 con 0x558afe72d600 2024-09-12T17:11:51.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.291+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741470 con 0x558afe72d600 2024-09-12T17:11:51.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741470 con 0x558afe72d600 2024-09-12T17:11:51.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe741470 con 0x558afe72d600 2024-09-12T17:11:51.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.295+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x7f65ac031040 2024-09-12T17:11:51.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.299+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.299+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x558afe72d600 2024-09-12T17:11:51.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.299+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.299+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x7f65ac031040 2024-09-12T17:11:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x558afe72d600 2024-09-12T17:11:51.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x7f65ac031040 2024-09-12T17:11:51.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.303+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7453d0 con 0x7f65a4033070 2024-09-12T17:11:51.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.311 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f64627fc640 20 reqs_thread_entry: start 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 20 init_complete bucket index max shards: 11 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 20 Filter name: none 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f63d3fff640 20 reqs_thread_entry: start 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 20 rados->read ofs=0 len=0 2024-09-12T17:11:51.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe73fa30 con 0x558afe7273e0 2024-09-12T17:11:51.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:11:51.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:11:51.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558afe73f630 con 0x7f65a4033070 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.307+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f64637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:11:51.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94055462822832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe740630 con 0x558afe7273e0 2024-09-12T17:11:51.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94055462822832] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94055462802768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe7363b0 con 0x7f65a4033070 2024-09-12T17:11:51.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94055462802768] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b40869c0 20 remove_watcher() i=0 2024-09-12T17:11:51.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b40869c0 2 removed watcher, disabling cache 2024-09-12T17:11:51.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.311+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94055462807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe731550 con 0x558afe7273e0 2024-09-12T17:11:51.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94055462807296] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b40869c0 20 remove_watcher() i=1 2024-09-12T17:11:51.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94055462808864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe731550 con 0x558afe72d600 2024-09-12T17:11:51.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b138b640 1 -- 172.21.15.193:0/1896345267 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94055462808864] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a4028020 con 0x558afe72d600 2024-09-12T17:11:51.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b40869c0 20 remove_watcher() i=2 2024-09-12T17:11:51.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.315+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94055462814688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe731550 con 0x7f65a4033070 2024-09-12T17:11:51.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b238d640 1 -- 172.21.15.193:0/1896345267 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94055462814688] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac040040 con 0x7f65a4033070 2024-09-12T17:11:51.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b40869c0 20 remove_watcher() i=3 2024-09-12T17:11:51.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94055462819456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe731550 con 0x558afe7273e0 2024-09-12T17:11:51.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94055462819456] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x558afe7273e0 2024-09-12T17:11:51.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b40869c0 20 remove_watcher() i=4 2024-09-12T17:11:51.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.319+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94055462813488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe735680 con 0x7f65ac031040 2024-09-12T17:11:51.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94055462813488] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b40869c0 20 remove_watcher() i=5 2024-09-12T17:11:51.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94055462821264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe733f30 con 0x7f65ac031040 2024-09-12T17:11:51.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94055462821264] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b40869c0 20 remove_watcher() i=6 2024-09-12T17:11:51.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.323+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94055462825328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558afe735d90 con 0x7f65ac031040 2024-09-12T17:11:51.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94055462825328] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65a80c4030 con 0x7f65ac031040 2024-09-12T17:11:51.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 20 remove_watcher() i=7 2024-09-12T17:11:51.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f65ac031040 msgr2=0x7f65ac032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f65ac031040 0x7f65ac032940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe7273e0 msgr2=0x558afe729870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe7273e0 0x558afe729870 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65a4033070 msgr2=0x7f65a40215e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f65a4033070 0x7f65a40215e0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558afe72d600 msgr2=0x558afe72f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558afe72d600 0x558afe72f9f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039a70 msgr2=0x7f647c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f647c039a70 0x7f647c03bf30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x558afe6f8c00 tx=0x7f65ac01f000 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 msgr2=0x558afe71c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1896345267 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe715b70 0x558afe71c0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f65a4042040 tx=0x7f65a4052b90 comp rx=0 tx=0).stop 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 reap_dead start 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b1b8c640 1 -- 172.21.15.193:0/1896345267 reap_dead start 2024-09-12T17:11:51.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 shutdown_connections 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 >> 172.21.15.193:0/1896345267 conn(0x558afe710f90 msgr2=0x558afe70f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 shutdown_connections 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1896345267 wait complete. 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 msgr2=0x7f648c03c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 0x7f648c03c0d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x558afe6f9480 tx=0x7f65ac005850 comp rx=0 tx=0).stop 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 msgr2=0x558afe708620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f65a4008790 tx=0x7f65a4000bd0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 shutdown_connections 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f648c039c10 0x7f648c03c0d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/991245523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe708200 0x558afe708620 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 >> 172.21.15.193:0/991245523 conn(0x558afe6fdbb0 msgr2=0x558afe6fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 shutdown_connections 2024-09-12T17:11:51.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/991245523 wait complete. 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 msgr2=0x558afe6f7c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 0x558afe6f7c90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 msgr2=0x7f649803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 0x7f649803bf80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f65a400d450 tx=0x7f65a4008550 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 msgr2=0x558afe6f0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f65a801bbe0 tx=0x7f65a80180e0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 shutdown_connections 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558afe602030 0x558afe6f7c90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6498039ac0 0x7f649803bf80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 --2- 172.21.15.193:0/1806893497 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558afe5fee50 0x558afe6f0b20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 >> 172.21.15.193:0/1806893497 conn(0x558afe5fa970 msgr2=0x558afe6e3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 shutdown_connections 2024-09-12T17:11:51.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:11:51.327+0000 7f65b40869c0 1 -- 172.21.15.193:0/1806893497 wait complete. 2024-09-12T17:11:51.342 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:11:51.360 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:11:51.367 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-12T17:12:26.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-12T17:12:26.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-12T17:12:26.369 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-12T17:12:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:26.409 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:26.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263e2d19c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5586255be7b0 0x5586255bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263e2d19c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586254fc9c0 con 0x5586255be280 2024-09-12T17:12:26.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263e2d19c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55862554c6d0 con 0x5586255be7b0 2024-09-12T17:12:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263b5d6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5586255be7b0 0x5586255bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263bdd7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5586255be280 0x5586255bcc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:40196/0 (socket says 172.21.15.193:40196) 2024-09-12T17:12:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263bdd7640 1 -- 172.21.15.193:0/3573935774 learned_addr learned my addr 172.21.15.193:0/3573935774 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:12:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263b5d6640 1 -- 172.21.15.193:0/3573935774 >> v1:172.21.15.62:6789/0 conn(0x5586255be280 legacy=0x5586255bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263b5d6640 1 -- 172.21.15.193:0/3573935774 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586254f0ca0 con 0x5586255be7b0 2024-09-12T17:12:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.410+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3573935774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be7b0 0x5586255bd380 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f263000a480 tx=0x7f263001b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6420d3abbe07052 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263add5640 1 -- 172.21.15.193:0/3573935774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300af070 con 0x5586255be7b0 2024-09-12T17:12:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263add5640 1 -- 172.21.15.193:0/3573935774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300aa530 con 0x5586255be7b0 2024-09-12T17:12:26.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263add5640 1 -- 172.21.15.193:0/3573935774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300aa830 con 0x5586255be7b0 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3573935774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be7b0 msgr2=0x5586255bd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3573935774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be7b0 0x5586255bd380 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f263000a480 tx=0x7f263001b1c0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3573935774 shutdown_connections 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3573935774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be7b0 0x5586255bd380 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3573935774 >> 172.21.15.193:0/3573935774 conn(0x558625643aa0 msgr2=0x558625645ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3573935774 shutdown_connections 2024-09-12T17:12:26.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.414+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3573935774 wait complete. 2024-09-12T17:12:26.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558625550680 con 0x5586255be280 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263bdd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263bdd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33088/0 (socket says 172.21.15.193:33088) 2024-09-12T17:12:26.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263bdd7640 1 -- 172.21.15.193:0/3711685410 learned_addr learned my addr 172.21.15.193:0/3711685410 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263bdd7640 1 -- 172.21.15.193:0/3711685410 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586254cbda0 con 0x5586255be280 2024-09-12T17:12:26.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3711685410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2634001810 tx=0x7f2634001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6b66fa76c16785 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f2529e0b640 1 -- 172.21.15.193:0/3711685410 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634004530 con 0x5586255be280 2024-09-12T17:12:26.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f2529e0b640 1 -- 172.21.15.193:0/3711685410 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340046d0 con 0x5586255be280 2024-09-12T17:12:26.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f2529e0b640 1 -- 172.21.15.193:0/3711685410 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26340049f0 con 0x5586255be280 2024-09-12T17:12:26.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3711685410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 msgr2=0x558625735c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3711685410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2634001810 tx=0x7f2634001cd0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3711685410 shutdown_connections 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3711685410 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x558625735c50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.430+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3711685410 >> 172.21.15.193:0/3711685410 conn(0x558625643aa0 msgr2=0x558625731890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3711685410 shutdown_connections 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3711685410 wait complete. 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5586254f2a50 con 0x5586255be280 2024-09-12T17:12:26.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263bdd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263bdd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33104/0 (socket says 172.21.15.193:33104) 2024-09-12T17:12:26.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263bdd7640 1 -- 172.21.15.193:0/3288182938 learned_addr learned my addr 172.21.15.193:0/3288182938 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263bdd7640 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55862573d850 con 0x5586255be280 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2634000f90 tx=0x7f2634001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f2523fff640 1 -- 172.21.15.193:0/3288182938 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634013820 con 0x5586255be280 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55862573dae0 con 0x5586255be280 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f2523fff640 1 -- 172.21.15.193:0/3288182938 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26340139c0 con 0x5586255be280 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f2523fff640 1 -- 172.21.15.193:0/3288182938 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2634013ce0 con 0x5586255be280 2024-09-12T17:12:26.437 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55862573e490 con 0x5586255be280 2024-09-12T17:12:26.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f2523fff640 1 -- 172.21.15.193:0/3288182938 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2634010070 con 0x5586255be280 2024-09-12T17:12:26.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.434+0000 7f2523fff640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 0x7f252403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.438 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f2523fff640 1 -- 172.21.15.193:0/3288182938 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2634018070 con 0x5586255be280 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 0x7f252403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 0x558625744460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257449a0 con 0x5586255be7b0 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 0x558625744460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 0x7f252403bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26300ac000 tx=0x7f26300a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 0x558625744460 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 -- 172.21.15.193:0/3288182938 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f262c0083f0 con 0x5586255be7b0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625744dd0 con 0x5586255be7b0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 -- 172.21.15.193:0/3288182938 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f262c0083f0 con 0x5586255be7b0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257466d0 con 0x5586255be7b0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 -- 172.21.15.193:0/3288182938 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f262c0083f0 con 0x5586255be7b0 2024-09-12T17:12:26.440 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625745900 con 0x5586255be7b0 2024-09-12T17:12:26.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 -- 172.21.15.193:0/3288182938 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f262c0083f0 con 0x5586255be7b0 2024-09-12T17:12:26.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625745d50 con 0x5586255be7b0 2024-09-12T17:12:26.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263c5d8640 1 -- 172.21.15.193:0/3288182938 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f262c0083f0 con 0x5586255be7b0 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263e2d19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55862555d450 con 0x5586257549e0 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33114/0 (socket says 172.21.15.193:33114) 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.438+0000 7f263b5d6640 1 -- 172.21.15.193:0/2607079112 learned_addr learned my addr 172.21.15.193:0/2607079112 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263b5d6640 1 -- 172.21.15.193:0/2607079112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558625755440 con 0x5586257549e0 2024-09-12T17:12:26.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263b5d6640 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f26300ad040 tx=0x7f2630017f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 -- 172.21.15.193:0/2607079112 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300c6070 con 0x5586257549e0 2024-09-12T17:12:26.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558625755ca0 con 0x5586257549e0 2024-09-12T17:12:26.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 -- 172.21.15.193:0/2607079112 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300b6820 con 0x5586257549e0 2024-09-12T17:12:26.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586257561b0 con 0x5586257549e0 2024-09-12T17:12:26.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 -- 172.21.15.193:0/2607079112 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300af040 con 0x5586257549e0 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 -- 172.21.15.193:0/2607079112 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26300b6b00 con 0x5586257549e0 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 0x7f251403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f25217fa640 1 -- 172.21.15.193:0/2607079112 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f26300ec3e0 con 0x5586257549e0 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263c5d8640 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 0x7f251403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263c5d8640 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 0x7f251403bf30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x558625745420 tx=0x7f262c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263e2d19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5586257364a0 con 0x558625761260 2024-09-12T17:12:26.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33126/0 (socket says 172.21.15.193:33126) 2024-09-12T17:12:26.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.442+0000 7f263b5d6640 1 -- 172.21.15.193:0/2360175959 learned_addr learned my addr 172.21.15.193:0/2360175959 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 -- 172.21.15.193:0/2360175959 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558625761c10 con 0x558625761260 2024-09-12T17:12:26.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 --2- 172.21.15.193:0/2360175959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26300a93a0 tx=0x7f26300a9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5903a9271a9f3c2d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f251affd640 1 -- 172.21.15.193:0/2360175959 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300e3270 con 0x558625761260 2024-09-12T17:12:26.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f251affd640 1 -- 172.21.15.193:0/2360175959 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300e2070 con 0x558625761260 2024-09-12T17:12:26.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f251affd640 1 -- 172.21.15.193:0/2360175959 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300e3410 con 0x558625761260 2024-09-12T17:12:26.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2360175959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 msgr2=0x558625761640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2360175959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f26300a93a0 tx=0x7f26300a9490 comp rx=0 tx=0).stop 2024-09-12T17:12:26.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2360175959 shutdown_connections 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2360175959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625761640 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2360175959 >> 172.21.15.193:0/2360175959 conn(0x55862575d690 msgr2=0x55862575b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2360175959 shutdown_connections 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2360175959 wait complete. 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 Processor -- start 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- start start 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558625762270 con 0x558625761260 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33140/0 (socket says 172.21.15.193:33140) 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 learned_addr learned my addr 172.21.15.193:0/3538901184 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558625768d90 con 0x558625761260 2024-09-12T17:12:26.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f26300ec0a0 tx=0x7f26300ea6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f25197fa640 1 -- 172.21.15.193:0/3538901184 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300da070 con 0x558625761260 2024-09-12T17:12:26.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f25197fa640 1 -- 172.21.15.193:0/3538901184 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300e2040 con 0x558625761260 2024-09-12T17:12:26.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558625769020 con 0x558625761260 2024-09-12T17:12:26.450 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f25197fa640 1 -- 172.21.15.193:0/3538901184 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26300a9e20 con 0x558625761260 2024-09-12T17:12:26.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.446+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586257699d0 con 0x558625761260 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f25197fa640 1 -- 172.21.15.193:0/3538901184 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f26300dd070 con 0x558625761260 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f25197fa640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2504039ac0 0x7f250403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f25197fa640 1 -- 172.21.15.193:0/3538901184 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f26300073f0 con 0x558625761260 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2504039ac0 0x7f250403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558625773a50 0x558625775ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257765f0 con 0x558625773a50 2024-09-12T17:12:26.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558625773a50 0x558625775ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2504039ac0 0x7f250403bf80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f262c00f010 tx=0x7f262c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558625773a50 0x558625775ea0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 realm 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625776a00 con 0x558625773a50 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.456 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257772d0 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625777b10 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 20 searching for the correct realm 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558625779910 0x55862577bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55862577c240 con 0x558625779910 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.450+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558625779910 0x55862577bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558625779910 0x55862577bd00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263b5d6640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2630009040 0x7f26300f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55862577c240 con 0x7f2630009040 2024-09-12T17:12:26.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2630009040 0x7f26300f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2630009040 0x7f26300f5a10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263c5d8640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f262c019040 0x7f262c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55862577c240 con 0x7f262c019040 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f262c019040 0x7f262c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f262c019040 0x7f262c019930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.454+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f2630009040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f2630009040 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.458+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.466 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.472 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f2630009040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.462+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f2630009040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.473 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625779910 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f262c019040 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x558625773a50 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558625777670 con 0x7f2630009040 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:26.474 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257784f0 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.466+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625778130 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625778e10 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:26.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 zone default found 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 4 Realm: () 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 zonegroup default 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625778e10 con 0x7f262c019040 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55862577dc30 con 0x558625779910 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55862577dfd0 con 0x558625779910 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 started sync module instance, tier type = 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:26.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577d0d0 con 0x7f2630009040 2024-09-12T17:12:26.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94034642588912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577e870 con 0x7f2630009040 2024-09-12T17:12:26.478 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.470+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f0c0 con 0x558625773a50 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.474+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94034642588912] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.474+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.474+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94034642592704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577ed10 con 0x558625773a50 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.474+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f810 con 0x558625779910 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.474+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94034642592704] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94034642596608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577fc30 con 0x558625779910 2024-09-12T17:12:26.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257805f0 con 0x7f2630009040 2024-09-12T17:12:26.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94034642600528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558625780d20 con 0x7f2630009040 2024-09-12T17:12:26.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558625781820 con 0x558625773a50 2024-09-12T17:12:26.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94034642596608] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94034642600528] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94034642604816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257817e0 con 0x558625773a50 2024-09-12T17:12:26.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.478+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257820f0 con 0x7f262c019040 2024-09-12T17:12:26.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.482+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94034642604816] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.482+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.482+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94034642593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257817e0 con 0x7f262c019040 2024-09-12T17:12:26.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.482+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558625782550 con 0x7f262c019040 2024-09-12T17:12:26.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.486+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.486+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94034642593760] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.486+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94034642607088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257824c0 con 0x7f262c019040 2024-09-12T17:12:26.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.486+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558625782f30 con 0x7f262c019040 2024-09-12T17:12:26.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.486+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94034642607088] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94034642610688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257824c0 con 0x7f262c019040 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=0 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=1 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=2 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=3 2024-09-12T17:12:26.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=4 2024-09-12T17:12:26.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=5 2024-09-12T17:12:26.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.490+0000 7f263e2d19c0 20 add_watcher() i=6 2024-09-12T17:12:26.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94034642610688] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 20 add_watcher() i=7 2024-09-12T17:12:26.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:26.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558625786350 con 0x558625773a50 2024-09-12T17:12:26.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94034642608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558625783850 con 0x558625773a50 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94034642608656] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f24f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 5 note: GC not initialized 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f24f17e2640 20 reqs_thread_entry: start 2024-09-12T17:12:26.497 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:26.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 20 Filter name: none 2024-09-12T17:12:26.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f24eaffd640 20 reqs_thread_entry: start 2024-09-12T17:12:26.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257a9c40 con 0x558625773a50 2024-09-12T17:12:26.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257a9c40 con 0x7f2630009040 2024-09-12T17:12:26.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257a9c40 con 0x558625773a50 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.494+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257a9c00 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa180 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa180 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa180 con 0x558625773a50 2024-09-12T17:12:26.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa180 con 0x558625773a50 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa130 con 0x558625779910 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa130 con 0x558625779910 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257aa130 con 0x7f262c019040 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab6d0 con 0x558625773a50 2024-09-12T17:12:26.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab6d0 con 0x7f2630009040 2024-09-12T17:12:26.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.498+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab6d0 con 0x558625779910 2024-09-12T17:12:26.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab610 con 0x7f262c019040 2024-09-12T17:12:26.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab5a0 con 0x7f262c019040 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab5a0 con 0x558625779910 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x7f262c019040 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625773a50 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625779910 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.502+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x7f262c019040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x7f2630009040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x7f262c019040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625773a50 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625773a50 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625779910 2024-09-12T17:12:26.509 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625773a50 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625773a50 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625779910 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625779910 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.510 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x558625779910 2024-09-12T17:12:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.506+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5586257ab520 con 0x7f262c019040 2024-09-12T17:12:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f24f27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94034642608656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862576e080 con 0x558625773a50 2024-09-12T17:12:26.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94034642608656] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94034642588912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5586257821e0 con 0x7f2630009040 2024-09-12T17:12:26.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94034642588912] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.510+0000 7f263e2d19c0 20 remove_watcher() i=0 2024-09-12T17:12:26.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.514+0000 7f263e2d19c0 2 removed watcher, disabling cache 2024-09-12T17:12:26.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.514+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94034642592704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577d4f0 con 0x558625773a50 2024-09-12T17:12:26.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.514+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94034642592704] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.514+0000 7f263e2d19c0 20 remove_watcher() i=1 2024-09-12T17:12:26.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.514+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94034642596608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577d4f0 con 0x558625779910 2024-09-12T17:12:26.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263b5d6640 1 -- 172.21.15.193:0/3538901184 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94034642596608] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26300dc030 con 0x558625779910 2024-09-12T17:12:26.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 20 remove_watcher() i=2 2024-09-12T17:12:26.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94034642600528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f300 con 0x7f2630009040 2024-09-12T17:12:26.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263c5d8640 1 -- 172.21.15.193:0/3538901184 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94034642600528] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f262c02f040 con 0x7f2630009040 2024-09-12T17:12:26.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 20 remove_watcher() i=3 2024-09-12T17:12:26.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94034642604816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577d4f0 con 0x558625773a50 2024-09-12T17:12:26.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94034642604816] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x558625773a50 2024-09-12T17:12:26.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 20 remove_watcher() i=4 2024-09-12T17:12:26.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.518+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94034642593760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f300 con 0x7f262c019040 2024-09-12T17:12:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.522+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94034642593760] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.522+0000 7f263e2d19c0 20 remove_watcher() i=5 2024-09-12T17:12:26.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.522+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94034642607088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f300 con 0x7f262c019040 2024-09-12T17:12:26.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94034642607088] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 20 remove_watcher() i=6 2024-09-12T17:12:26.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94034642610688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55862577f300 con 0x7f262c019040 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94034642610688] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f263401b030 con 0x7f262c019040 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 20 remove_watcher() i=7 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f262c019040 msgr2=0x7f262c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f262c019040 0x7f262c019930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558625773a50 msgr2=0x558625775ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558625773a50 0x558625775ea0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2630009040 msgr2=0x7f26300f5a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2630009040 0x7f26300f5a10 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558625779910 msgr2=0x55862577bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558625779910 0x55862577bd00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2504039ac0 msgr2=0x7f250403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2504039ac0 0x7f250403bf80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f262c00f010 tx=0x7f262c01b070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263bdd7640 1 -- 172.21.15.193:0/3538901184 reap_dead start 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 msgr2=0x558625768830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f26300ec0a0 tx=0x7f26300ea6d0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 shutdown_connections 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3538901184 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558625761260 0x558625768830 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 >> 172.21.15.193:0/3538901184 conn(0x55862575d690 msgr2=0x55862575b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 shutdown_connections 2024-09-12T17:12:26.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3538901184 wait complete. 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 msgr2=0x7f251403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 0x7f251403bf30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x558625745420 tx=0x7f262c003070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 msgr2=0x558625754e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f26300ad040 tx=0x7f2630017f60 comp rx=0 tx=0).stop 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 shutdown_connections 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2514039a70 0x7f251403bf30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/2607079112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586257549e0 0x558625754e00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 >> 172.21.15.193:0/2607079112 conn(0x55862574a390 msgr2=0x55862574a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 shutdown_connections 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.526+0000 7f263e2d19c0 1 -- 172.21.15.193:0/2607079112 wait complete. 2024-09-12T17:12:26.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 msgr2=0x558625744460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 0x558625744460 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 msgr2=0x7f252403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 0x7f252403bf30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26300ac000 tx=0x7f26300a5000 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 msgr2=0x55862573d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2634000f90 tx=0x7f2634001260 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 shutdown_connections 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5586255be7b0 0x558625744460 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2524039a70 0x7f252403bf30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 --2- 172.21.15.193:0/3288182938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5586255be280 0x55862573d2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 >> 172.21.15.193:0/3288182938 conn(0x558625643aa0 msgr2=0x558625730320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 shutdown_connections 2024-09-12T17:12:26.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.530+0000 7f263e2d19c0 1 -- 172.21.15.193:0/3288182938 wait complete. 2024-09-12T17:12:26.541 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:26.542 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:26.542 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-12T17:12:26.542 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-12T17:12:26.542 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-12T17:12:26.617 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:26.617 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:26.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.614+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.614+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5b4899c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559aaaf120a0 0x559aaaf14490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5b4899c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559aaadc29c0 con 0x559aaaf0df50 2024-09-12T17:12:26.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5b4899c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559aaae126d0 con 0x559aaaf120a0 2024-09-12T17:12:26.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5878e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559aaaf120a0 0x559aaaf14490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a58f8f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559aaaf0df50 0x559aaaf0e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:40204/0 (socket says 172.21.15.193:40204) 2024-09-12T17:12:26.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a58f8f640 1 -- 172.21.15.193:0/2860674634 learned_addr learned my addr 172.21.15.193:0/2860674634 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:12:26.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5878e640 1 -- 172.21.15.193:0/2860674634 >> v1:172.21.15.62:6789/0 conn(0x559aaaf0df50 legacy=0x559aaaf0e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5878e640 1 -- 172.21.15.193:0/2860674634 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aaadb6ca0 con 0x559aaaf120a0 2024-09-12T17:12:26.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a5878e640 1 --2- 172.21.15.193:0/2860674634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf120a0 0x559aaaf14490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000a480 tx=0x7f2a4001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70993cb4765da56b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a57f8d640 1 -- 172.21.15.193:0/2860674634 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400aa570 con 0x559aaaf120a0 2024-09-12T17:12:26.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.618+0000 7f2a57f8d640 1 -- 172.21.15.193:0/2860674634 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400af070 con 0x559aaaf120a0 2024-09-12T17:12:26.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a57f8d640 1 -- 172.21.15.193:0/2860674634 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400aa860 con 0x559aaaf120a0 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2860674634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf120a0 msgr2=0x559aaaf14490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/2860674634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf120a0 0x559aaaf14490 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000a480 tx=0x7f2a4001b310 comp rx=0 tx=0).stop 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2860674634 shutdown_connections 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/2860674634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf120a0 0x559aaaf14490 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2860674634 >> 172.21.15.193:0/2860674634 conn(0x559aaaf09a70 msgr2=0x559aaaf0be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2860674634 shutdown_connections 2024-09-12T17:12:26.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.622+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2860674634 wait complete. 2024-09-12T17:12:26.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559aaae16680 con 0x559aaaf0df50 2024-09-12T17:12:26.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a58f8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a58f8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33158/0 (socket says 172.21.15.193:33158) 2024-09-12T17:12:26.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a58f8f640 1 -- 172.21.15.193:0/444679903 learned_addr learned my addr 172.21.15.193:0/444679903 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a58f8f640 1 -- 172.21.15.193:0/444679903 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aaad91da0 con 0x559aaaf0df50 2024-09-12T17:12:26.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/444679903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2a480017b0 tx=0x7f2a48001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e8cb21ab3e39e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2946e0d640 1 -- 172.21.15.193:0/444679903 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a480044f0 con 0x559aaaf0df50 2024-09-12T17:12:26.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2946e0d640 1 -- 172.21.15.193:0/444679903 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a480046b0 con 0x559aaaf0df50 2024-09-12T17:12:26.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2946e0d640 1 -- 172.21.15.193:0/444679903 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48004a10 con 0x559aaaf0df50 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/444679903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 msgr2=0x559aaaff96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/444679903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f2a480017b0 tx=0x7f2a48001c70 comp rx=0 tx=0).stop 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/444679903 shutdown_connections 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/444679903 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aaaff96a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/444679903 >> 172.21.15.193:0/444679903 conn(0x559aaaf09a70 msgr2=0x559aaaff52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/444679903 shutdown_connections 2024-09-12T17:12:26.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.638+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/444679903 wait complete. 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559aaadb8a50 con 0x559aaaf0df50 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a58f8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a58f8f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33162/0 (socket says 172.21.15.193:33162) 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a58f8f640 1 -- 172.21.15.193:0/3868684525 learned_addr learned my addr 172.21.15.193:0/3868684525 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a58f8f640 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aab0012d0 con 0x559aaaf0df50 2024-09-12T17:12:26.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2a480012f0 tx=0x7f2a48000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 -- 172.21.15.193:0/3868684525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48013820 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 -- 172.21.15.193:0/3868684525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a480139c0 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aab001560 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 -- 172.21.15.193:0/3868684525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a48013ca0 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aab001f10 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 -- 172.21.15.193:0/3868684525 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a48010070 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 0x7f294003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f294560a640 1 -- 172.21.15.193:0/3868684525 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2a48018070 con 0x559aaaf0df50 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5878e640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 0x7f294003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 0x559aab007ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab008420 con 0x559aaaf120a0 2024-09-12T17:12:26.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.642+0000 7f2a59790640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 0x559aab007ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5878e640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 0x7f294003bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 0x559aab007ee0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 -- 172.21.15.193:0/3868684525 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a500083f0 con 0x559aaaf120a0 2024-09-12T17:12:26.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab002280 con 0x559aaaf120a0 2024-09-12T17:12:26.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 -- 172.21.15.193:0/3868684525 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a500083f0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab00a1b0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 -- 172.21.15.193:0/3868684525 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2a500083f0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0093e0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 -- 172.21.15.193:0/3868684525 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a500083f0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab009800 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a59790640 1 -- 172.21.15.193:0/3868684525 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2a500083f0 con 0x559aaaf120a0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5b4899c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559aaae23450 con 0x559aab018510 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33168/0 (socket says 172.21.15.193:33168) 2024-09-12T17:12:26.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5878e640 1 -- 172.21.15.193:0/3590389808 learned_addr learned my addr 172.21.15.193:0/3590389808 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.646+0000 7f2a5878e640 1 -- 172.21.15.193:0/3590389808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aab018f70 con 0x559aab018510 2024-09-12T17:12:26.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5878e640 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a40000c10 tx=0x7f2a400180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 -- 172.21.15.193:0/3590389808 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400c5030 con 0x559aab018510 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 -- 172.21.15.193:0/3590389808 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400b5950 con 0x559aab018510 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aab0197d0 con 0x559aab018510 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aab019d40 con 0x559aab018510 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 -- 172.21.15.193:0/3590389808 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400cf060 con 0x559aab018510 2024-09-12T17:12:26.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 -- 172.21.15.193:0/3590389808 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a400c8030 con 0x559aab018510 2024-09-12T17:12:26.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 0x7f293003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f293e7fc640 1 -- 172.21.15.193:0/3590389808 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2a400c6070 con 0x559aab018510 2024-09-12T17:12:26.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a59790640 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 0x7f293003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a59790640 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 0x7f293003bf20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x559aab009780 tx=0x7f2a50003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5b4899c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559aaaff9ef0 con 0x559aaae82ca0 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33170/0 (socket says 172.21.15.193:33170) 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5878e640 1 -- 172.21.15.193:0/2889490051 learned_addr learned my addr 172.21.15.193:0/2889490051 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.650+0000 7f2a5878e640 1 -- 172.21.15.193:0/2889490051 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aaae835e0 con 0x559aaae82ca0 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 --2- 172.21.15.193:0/2889490051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ebaf0 tx=0x7f2a400b5ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b33db50c65d54a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292ffff640 1 -- 172.21.15.193:0/2889490051 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400c1a40 con 0x559aaae82ca0 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292ffff640 1 -- 172.21.15.193:0/2889490051 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400c1440 con 0x559aaae82ca0 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292ffff640 1 -- 172.21.15.193:0/2889490051 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400ed0d0 con 0x559aaae82ca0 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2889490051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 msgr2=0x559aaae830a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/2889490051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ebaf0 tx=0x7f2a400b5ed0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2889490051 shutdown_connections 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/2889490051 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aaae830a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2889490051 >> 172.21.15.193:0/2889490051 conn(0x559aab021160 msgr2=0x559aab01f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2889490051 shutdown_connections 2024-09-12T17:12:26.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/2889490051 wait complete. 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 Processor -- start 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- start start 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559aaae83b60 con 0x559aaae82ca0 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33186/0 (socket says 172.21.15.193:33186) 2024-09-12T17:12:26.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 learned_addr learned my addr 172.21.15.193:0/1451614634 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aab02eb40 con 0x559aaae82ca0 2024-09-12T17:12:26.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5878e640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2a40018f40 tx=0x7f2a400eba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292e7fc640 1 -- 172.21.15.193:0/1451614634 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400f2070 con 0x559aaae82ca0 2024-09-12T17:12:26.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292e7fc640 1 -- 172.21.15.193:0/1451614634 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a400ea410 con 0x559aaae82ca0 2024-09-12T17:12:26.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aab02edd0 con 0x559aaae82ca0 2024-09-12T17:12:26.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f292e7fc640 1 -- 172.21.15.193:0/1451614634 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a400d8040 con 0x559aaae82ca0 2024-09-12T17:12:26.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.654+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aab02f780 con 0x559aaae82ca0 2024-09-12T17:12:26.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f292e7fc640 1 -- 172.21.15.193:0/1451614634 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f2a400f5070 con 0x559aaae82ca0 2024-09-12T17:12:26.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f292e7fc640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2924039a70 0x7f292403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f292e7fc640 1 -- 172.21.15.193:0/1451614634 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f2a400e7070 con 0x559aaae82ca0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aab039870 0x559aab03bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03c450 con 0x559aab039870 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a59790640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2924039a70 0x7f292403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aab039870 0x559aab03bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aab039870 0x559aab03bd00 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a59790640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2924039a70 0x7f292403bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000f010 tx=0x7f2a5001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 realm 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03c860 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d130 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d4d0 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 20 searching for the correct realm 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559aab03f8e0 0x559aab041cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab0422e0 con 0x559aab03f8e0 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5878e640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559aab03f8e0 0x559aab041cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.658+0000 7f2a5878e640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559aab03f8e0 0x559aab041cd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a5878e640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2a400f7060 0x7f2a400c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab0422e0 con 0x7f2a400f7060 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a59790640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2a400f7060 0x7f2a400c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a59790640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2a400f7060 0x7f2a400c05b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a59790640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2a50019040 0x7f2a50019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab0422e0 con 0x7f2a50019040 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2a50019040 0x7f2a50019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2a50019040 0x7f2a50019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x7f2a50019040 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x7f2a50019040 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.662+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x7f2a50019040 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a400f7060 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x7f2a50019040 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a400f7060 2024-09-12T17:12:26.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x7f2a50019040 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.666+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a4801b030 con 0x559aab039870 2024-09-12T17:12:26.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a400f7060 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.670+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a400f7060 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab03f8e0 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.676 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a50019040 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x559aab039870 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559aab03d970 con 0x7f2a400f7060 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:26.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03e250 con 0x559aab039870 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03e640 con 0x559aab039870 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03e640 con 0x559aab039870 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 zone default found 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 4 Realm: () 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 zonegroup default 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.674+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03ea60 con 0x7f2a50019040 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab03ea60 con 0x559aab03f8e0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0441b0 con 0x559aab03f8e0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 started sync module instance, tier type = 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:26.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab0435f0 con 0x7f2a400f7060 2024-09-12T17:12:26.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122782505440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab044ac0 con 0x7f2a400f7060 2024-09-12T17:12:26.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab045310 con 0x559aab039870 2024-09-12T17:12:26.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.678+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122782505440] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122782508560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab044f20 con 0x559aab039870 2024-09-12T17:12:26.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab045a20 con 0x559aab03f8e0 2024-09-12T17:12:26.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122782508560] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122782512400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab045e10 con 0x559aab03f8e0 2024-09-12T17:12:26.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.682+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab0467d0 con 0x7f2a400f7060 2024-09-12T17:12:26.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122782516304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab047070 con 0x7f2a400f7060 2024-09-12T17:12:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab047a30 con 0x559aab039870 2024-09-12T17:12:26.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122782512400] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122782516304] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122782518208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab047a30 con 0x559aab039870 2024-09-12T17:12:26.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.686+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab046fe0 con 0x7f2a50019040 2024-09-12T17:12:26.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122782518208] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122782520704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab047e50 con 0x7f2a50019040 2024-09-12T17:12:26.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab048720 con 0x7f2a50019040 2024-09-12T17:12:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122782522960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab048db0 con 0x7f2a50019040 2024-09-12T17:12:26.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab049660 con 0x7f2a50019040 2024-09-12T17:12:26.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.690+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122782520704] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122782522960] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122782521760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab048db0 con 0x7f2a50019040 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=0 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=1 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=2 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=3 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=4 2024-09-12T17:12:26.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=5 2024-09-12T17:12:26.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.694+0000 7f2a5b4899c0 20 add_watcher() i=6 2024-09-12T17:12:26.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122782521760] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 20 add_watcher() i=7 2024-09-12T17:12:26.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:26.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab04c760 con 0x559aab039870 2024-09-12T17:12:26.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122782525696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab049be0 con 0x559aab039870 2024-09-12T17:12:26.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122782525696] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f290f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:26.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:26.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 5 note: GC not initialized 2024-09-12T17:12:26.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f290e7e4640 20 reqs_thread_entry: start 2024-09-12T17:12:26.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 20 Filter name: none 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f29077fe640 20 reqs_thread_entry: start 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06fe30 con 0x559aab039870 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06fe30 con 0x7f2a400f7060 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.698+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0702b0 con 0x559aab039870 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0702b0 con 0x559aab03f8e0 2024-09-12T17:12:26.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab070650 con 0x559aab03f8e0 2024-09-12T17:12:26.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x559aab03f8e0 2024-09-12T17:12:26.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x559aab039870 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x559aab039870 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x559aab03f8e0 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x559aab03f8e0 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab0709f0 con 0x7f2a50019040 2024-09-12T17:12:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.702+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a400f7060 2024-09-12T17:12:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.706+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a400f7060 2024-09-12T17:12:26.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.710+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559aab06f7b0 con 0x7f2a50019040 2024-09-12T17:12:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f290f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122782525696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab071690 con 0x559aab039870 2024-09-12T17:12:26.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94122782525696] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.714+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122782505440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x7f2a400f7060 2024-09-12T17:12:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94122782505440] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a5b4899c0 20 remove_watcher() i=0 2024-09-12T17:12:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a5b4899c0 2 removed watcher, disabling cache 2024-09-12T17:12:26.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122782508560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x559aab039870 2024-09-12T17:12:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94122782508560] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a5b4899c0 20 remove_watcher() i=1 2024-09-12T17:12:26.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.718+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122782512400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x559aab03f8e0 2024-09-12T17:12:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a5878e640 1 -- 172.21.15.193:0/1451614634 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94122782512400] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a400f4030 con 0x559aab03f8e0 2024-09-12T17:12:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a5b4899c0 20 remove_watcher() i=2 2024-09-12T17:12:26.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122782516304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x7f2a400f7060 2024-09-12T17:12:26.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a59790640 1 -- 172.21.15.193:0/1451614634 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94122782516304] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a5002f040 con 0x7f2a400f7060 2024-09-12T17:12:26.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a5b4899c0 20 remove_watcher() i=3 2024-09-12T17:12:26.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.722+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122782518208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x559aab039870 2024-09-12T17:12:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94122782518208] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x559aab039870 2024-09-12T17:12:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a5b4899c0 20 remove_watcher() i=4 2024-09-12T17:12:26.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122782520704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x7f2a50019040 2024-09-12T17:12:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94122782520704] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a5b4899c0 20 remove_watcher() i=5 2024-09-12T17:12:26.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.726+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122782522960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x7f2a50019040 2024-09-12T17:12:26.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94122782522960] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 20 remove_watcher() i=6 2024-09-12T17:12:26.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122782521760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559aab06d1b0 con 0x7f2a50019040 2024-09-12T17:12:26.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94122782521760] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2a48058060 con 0x7f2a50019040 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 20 remove_watcher() i=7 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2a50019040 msgr2=0x7f2a50019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2a50019040 0x7f2a50019930 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aab039870 msgr2=0x559aab03bd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aab039870 0x559aab03bd00 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2a400f7060 msgr2=0x7f2a400c05b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f2a400f7060 0x7f2a400c05b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559aab03f8e0 msgr2=0x559aab041cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.730+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559aab03f8e0 0x559aab041cd0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2924039a70 msgr2=0x7f292403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2924039a70 0x7f292403bf30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a5000f010 tx=0x7f2a5001b070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 msgr2=0x559aab02e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2a40018f40 tx=0x7f2a400eba80 comp rx=0 tx=0).stop 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a58f8f640 1 -- 172.21.15.193:0/1451614634 reap_dead start 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 shutdown_connections 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/1451614634 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaae82ca0 0x559aab02e5e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 >> 172.21.15.193:0/1451614634 conn(0x559aab021160 msgr2=0x559aab01f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 shutdown_connections 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/1451614634 wait complete. 2024-09-12T17:12:26.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 msgr2=0x7f293003bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 0x7f293003bf20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x559aab009780 tx=0x7f2a50003070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 msgr2=0x559aab018930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2a40000c10 tx=0x7f2a400180b0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 shutdown_connections 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2930039a60 0x7f293003bf20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3590389808 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aab018510 0x559aab018930 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 >> 172.21.15.193:0/3590389808 conn(0x559aab00dec0 msgr2=0x559aab00e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 shutdown_connections 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3590389808 wait complete. 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 msgr2=0x559aab007ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 0x559aab007ee0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 msgr2=0x7f294003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 0x7f294003bf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a400a6000 comp rx=0 tx=0).stop 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 msgr2=0x559aab000d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2a480012f0 tx=0x7f2a48000f50 comp rx=0 tx=0).stop 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 shutdown_connections 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559aaaf120a0 0x559aab007ee0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f2940039a70 0x7f294003bf30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 --2- 172.21.15.193:0/3868684525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559aaaf0df50 0x559aab000d70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 >> 172.21.15.193:0/3868684525 conn(0x559aaaf09a70 msgr2=0x559aaaff3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 shutdown_connections 2024-09-12T17:12:26.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.734+0000 7f2a5b4899c0 1 -- 172.21.15.193:0/3868684525 wait complete. 2024-09-12T17:12:26.746 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:26.746 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:26.747 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T17:12:26.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T17:12:26.747 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T17:12:26.824 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:26.824 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:26.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.822+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.822+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.822+0000 7f1913a119c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c48cbee310 0x55c48cbf0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.822+0000 7f1913a119c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c48ca9e9c0 con 0x55c48cb5e240 2024-09-12T17:12:26.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.822+0000 7f1913a119c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c48caee6d0 con 0x55c48cbee310 2024-09-12T17:12:26.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c48cbee310 0x55c48cbf0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c48cbee310 0x55c48cbf0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33196/0 (socket says 172.21.15.193:33196) 2024-09-12T17:12:26.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 -- 172.21.15.193:0/3096807452 learned_addr learned my addr 172.21.15.193:0/3096807452 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1911517640 1 --1- 172.21.15.193:0/3096807452 >> v1:172.21.15.62:6789/0 conn(0x55c48cb5e240 0x55c48cbecbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:40212/0 (socket says 172.21.15.193:40212) 2024-09-12T17:12:26.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 -- 172.21.15.193:0/3096807452 >> v1:172.21.15.62:6789/0 conn(0x55c48cb5e240 legacy=0x55c48cbecbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 -- 172.21.15.193:0/3096807452 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48ca92ca0 con 0x55c48cbee310 2024-09-12T17:12:26.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1910d16640 1 --2- 172.21.15.193:0/3096807452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cbee310 0x55c48cbf0700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f190800a5c0 tx=0x7f190801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddece0425d74ee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1903fff640 1 -- 172.21.15.193:0/3096807452 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080b1070 con 0x55c48cbee310 2024-09-12T17:12:26.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1903fff640 1 -- 172.21.15.193:0/3096807452 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080a8070 con 0x55c48cbee310 2024-09-12T17:12:26.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.826+0000 7f1903fff640 1 -- 172.21.15.193:0/3096807452 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080ac5b0 con 0x55c48cbee310 2024-09-12T17:12:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 -- 172.21.15.193:0/3096807452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cbee310 msgr2=0x55c48cbf0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3096807452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cbee310 0x55c48cbf0700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f190800a5c0 tx=0x7f190801b340 comp rx=0 tx=0).stop 2024-09-12T17:12:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 -- 172.21.15.193:0/3096807452 shutdown_connections 2024-09-12T17:12:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3096807452 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cbee310 0x55c48cbf0700 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 -- 172.21.15.193:0/3096807452 >> 172.21.15.193:0/3096807452 conn(0x55c48cbe4920 msgr2=0x55c48cbe6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 -- 172.21.15.193:0/3096807452 shutdown_connections 2024-09-12T17:12:26.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.830+0000 7f1913a119c0 1 -- 172.21.15.193:0/3096807452 wait complete. 2024-09-12T17:12:26.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.842+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c48caf2680 con 0x55c48cb5e240 2024-09-12T17:12:26.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33204/0 (socket says 172.21.15.193:33204) 2024-09-12T17:12:26.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 -- 172.21.15.193:0/499894151 learned_addr learned my addr 172.21.15.193:0/499894151 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 -- 172.21.15.193:0/499894151 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48ca6dda0 con 0x55c48cb5e240 2024-09-12T17:12:26.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 --2- 172.21.15.193:0/499894151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1904001680 tx=0x7f1904001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbb6c2716889ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f17ff606640 1 -- 172.21.15.193:0/499894151 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1904013420 con 0x55c48cb5e240 2024-09-12T17:12:26.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f17ff606640 1 -- 172.21.15.193:0/499894151 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040135c0 con 0x55c48cb5e240 2024-09-12T17:12:26.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f17ff606640 1 -- 172.21.15.193:0/499894151 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19040138e0 con 0x55c48cb5e240 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- 172.21.15.193:0/499894151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 msgr2=0x55c48cbea150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 --2- 172.21.15.193:0/499894151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1904001680 tx=0x7f1904001b40 comp rx=0 tx=0).stop 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- 172.21.15.193:0/499894151 shutdown_connections 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 --2- 172.21.15.193:0/499894151 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48cbea150 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- 172.21.15.193:0/499894151 >> 172.21.15.193:0/499894151 conn(0x55c48cbe4920 msgr2=0x55c48ccd1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- 172.21.15.193:0/499894151 shutdown_connections 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- 172.21.15.193:0/499894151 wait complete. 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1913a119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c48ca94a50 con 0x55c48cb5e240 2024-09-12T17:12:26.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33214/0 (socket says 172.21.15.193:33214) 2024-09-12T17:12:26.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.846+0000 7f1911517640 1 -- 172.21.15.193:0/3212926863 learned_addr learned my addr 172.21.15.193:0/3212926863 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1911517640 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48ccdf620 con 0x55c48cb5e240 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1911517640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1904001b80 tx=0x7f1904000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 -- 172.21.15.193:0/3212926863 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1904013630 con 0x55c48cb5e240 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 -- 172.21.15.193:0/3212926863 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904023070 con 0x55c48cb5e240 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c48ccdf8b0 con 0x55c48cb5e240 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 -- 172.21.15.193:0/3212926863 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1904013920 con 0x55c48cb5e240 2024-09-12T17:12:26.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48cce0260 con 0x55c48cb5e240 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 -- 172.21.15.193:0/3212926863 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1904010070 con 0x55c48cb5e240 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 0x7f17f803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f17fde03640 1 -- 172.21.15.193:0/3212926863 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1904050200 con 0x55c48cb5e240 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1910d16640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 0x7f17f803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 0x55c48cce6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cce6770 con 0x55c48cbee310 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1911d18640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 0x55c48cce6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1910d16640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 0x7f17f803bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19080ae000 tx=0x7f19080a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.850+0000 7f1911d18640 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 0x55c48cce6230 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1911d18640 1 -- 172.21.15.193:0/3212926863 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190c0083f0 con 0x55c48cbee310 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cce6bc0 con 0x55c48cbee310 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1911d18640 1 -- 172.21.15.193:0/3212926863 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f190c0083f0 con 0x55c48cbee310 2024-09-12T17:12:26.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cce84c0 con 0x55c48cbee310 2024-09-12T17:12:26.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1911d18640 1 -- 172.21.15.193:0/3212926863 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f190c0083f0 con 0x55c48cbee310 2024-09-12T17:12:26.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cce76f0 con 0x55c48cbee310 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1911d18640 1 -- 172.21.15.193:0/3212926863 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f190c0083f0 con 0x55c48cbee310 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cce7b10 con 0x55c48cbee310 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1911d18640 1 -- 172.21.15.193:0/3212926863 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f190c0083f0 con 0x55c48cbee310 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1913a119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c48caff450 con 0x55c48ccf6820 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33224/0 (socket says 172.21.15.193:33224) 2024-09-12T17:12:26.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1910d16640 1 -- 172.21.15.193:0/2661540597 learned_addr learned my addr 172.21.15.193:0/2661540597 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1910d16640 1 -- 172.21.15.193:0/2661540597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48ccf7280 con 0x55c48ccf6820 2024-09-12T17:12:26.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f1910d16640 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1908018f70 tx=0x7f19080180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f17f6ffd640 1 -- 172.21.15.193:0/2661540597 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080b1040 con 0x55c48ccf6820 2024-09-12T17:12:26.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f17f6ffd640 1 -- 172.21.15.193:0/2661540597 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080c7070 con 0x55c48ccf6820 2024-09-12T17:12:26.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.854+0000 7f17f6ffd640 1 -- 172.21.15.193:0/2661540597 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080b6850 con 0x55c48ccf6820 2024-09-12T17:12:26.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c48ccf7ae0 con 0x55c48ccf6820 2024-09-12T17:12:26.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48ccf7f90 con 0x55c48ccf6820 2024-09-12T17:12:26.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f6ffd640 1 -- 172.21.15.193:0/2661540597 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f19080c1070 con 0x55c48ccf6820 2024-09-12T17:12:26.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f6ffd640 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 0x7f17e803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f6ffd640 1 -- 172.21.15.193:0/2661540597 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f19080ecf20 con 0x55c48ccf6820 2024-09-12T17:12:26.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1911d18640 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 0x7f17e803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1911d18640 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 0x7f17e803bf20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c48cce7a90 tx=0x7f190c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1913a119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c48cbea9a0 con 0x55c48cd03060 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33232/0 (socket says 172.21.15.193:33232) 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1910d16640 1 -- 172.21.15.193:0/2141612973 learned_addr learned my addr 172.21.15.193:0/2141612973 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1910d16640 1 -- 172.21.15.193:0/2141612973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48cd03a10 con 0x55c48cd03060 2024-09-12T17:12:26.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f1910d16640 1 --2- 172.21.15.193:0/2141612973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f19080ce030 tx=0x7f19080c1ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53df64508ee98d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f4ff9640 1 -- 172.21.15.193:0/2141612973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080c2e40 con 0x55c48cd03060 2024-09-12T17:12:26.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f4ff9640 1 -- 172.21.15.193:0/2141612973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19080aa520 con 0x55c48cd03060 2024-09-12T17:12:26.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.858+0000 7f17f4ff9640 1 -- 172.21.15.193:0/2141612973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1908006390 con 0x55c48cd03060 2024-09-12T17:12:26.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2141612973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 msgr2=0x55c48cd03440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2141612973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f19080ce030 tx=0x7f19080c1ab0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2141612973 shutdown_connections 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2141612973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd03440 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2141612973 >> 172.21.15.193:0/2141612973 conn(0x55c48ccff490 msgr2=0x55c48ccfd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2141612973 shutdown_connections 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2141612973 wait complete. 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 Processor -- start 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- start start 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c48cd04070 con 0x55c48cd03060 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1910d16640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33240/0 (socket says 172.21.15.193:33240) 2024-09-12T17:12:26.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 learned_addr learned my addr 172.21.15.193:0/2606856238 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:26.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c48cd0aaf0 con 0x55c48cd03060 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1910d16640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f19080c2c20 tx=0x7f19080eb210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f17e6ffd640 1 -- 172.21.15.193:0/2606856238 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080aa520 con 0x55c48cd03060 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f17e6ffd640 1 -- 172.21.15.193:0/2606856238 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1908006390 con 0x55c48cd03060 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c48cd0ad80 con 0x55c48cd03060 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f17e6ffd640 1 -- 172.21.15.193:0/2606856238 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19080aaac0 con 0x55c48cd03060 2024-09-12T17:12:26.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48cd0b730 con 0x55c48cd03060 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.862+0000 7f17e6ffd640 1 -- 172.21.15.193:0/2606856238 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f19080f7060 con 0x55c48cd03060 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f17e6ffd640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17dc039a70 0x7f17dc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f17e6ffd640 1 -- 172.21.15.193:0/2606856238 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f19080da020 con 0x55c48cd03060 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911d18640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17dc039a70 0x7f17dc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cd15870 0x55c48cd17d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd18450 con 0x55c48cd15870 2024-09-12T17:12:26.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cd15870 0x55c48cd17d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911d18640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17dc039a70 0x7f17dc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f190c00f010 tx=0x7f190c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cd15870 0x55c48cd17d00 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 realm 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd18860 con 0x55c48cd15870 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd19130 con 0x55c48cd15870 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd194d0 con 0x55c48cd15870 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd19970 con 0x55c48cd15870 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 20 searching for the correct realm 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c48cd1b8e0 0x55c48cd1dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1910d16640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c48cd1b8e0 0x55c48cd1dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1910d16640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c48cd1b8e0 0x55c48cd1dcd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1910d16640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f19080df040 0x7f19080c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911d18640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f19080df040 0x7f19080c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.866+0000 7f1911d18640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f19080df040 0x7f19080c4a40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911d18640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f190c019040 0x7f190c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f190c019040 0x7f190c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:26.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f190c019040 0x7f190c019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:26.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x7f190c019040 2024-09-12T17:12:26.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x7f190c019040 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x7f190c019040 2024-09-12T17:12:26.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.870+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x7f190c019040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x7f190c019040 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.874+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190400f030 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.878+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd1b8e0 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f190c019040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x55c48cd15870 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1e300 con 0x7f19080df040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:26.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1a380 con 0x55c48cd15870 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1ac20 con 0x55c48cd15870 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:26.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd19fc0 con 0x55c48cd15870 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 zone default found 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 4 Realm: () 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 zonegroup default 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1ac20 con 0x7f190c019040 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.882+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd20170 con 0x55c48cd1b8e0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd20540 con 0x55c48cd1b8e0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 20 started sync module instance, tier type = 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:26.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd1f610 con 0x7f19080df040 2024-09-12T17:12:26.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94302664522240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd20e30 con 0x7f19080df040 2024-09-12T17:12:26.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21680 con 0x55c48cd15870 2024-09-12T17:12:26.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.886+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94302664522240] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94302664526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21290 con 0x55c48cd15870 2024-09-12T17:12:26.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21db0 con 0x55c48cd1b8e0 2024-09-12T17:12:26.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94302664526208] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94302664530048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd221a0 con 0x55c48cd1b8e0 2024-09-12T17:12:26.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.890+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd22b60 con 0x7f19080df040 2024-09-12T17:12:26.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94302664533952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd23290 con 0x7f19080df040 2024-09-12T17:12:26.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd23db0 con 0x55c48cd15870 2024-09-12T17:12:26.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94302664530048] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94302664533952] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94302664538240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd23d70 con 0x55c48cd15870 2024-09-12T17:12:26.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.894+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd241a0 con 0x7f190c019040 2024-09-12T17:12:26.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94302664538240] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94302664527264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd24150 con 0x7f190c019040 2024-09-12T17:12:26.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd24aa0 con 0x7f190c019040 2024-09-12T17:12:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94302664541584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd24f10 con 0x7f190c019040 2024-09-12T17:12:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd259f0 con 0x7f190c019040 2024-09-12T17:12:26.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.898+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94302664527264] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94302664541584] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94302664545536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd24a60 con 0x7f190c019040 2024-09-12T17:12:26.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=0 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=1 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=2 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=3 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=4 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=5 2024-09-12T17:12:26.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=6 2024-09-12T17:12:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94302664545536] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 20 add_watcher() i=7 2024-09-12T17:12:26.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:26.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd28af0 con 0x55c48cd15870 2024-09-12T17:12:26.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.902+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94302664535264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd25f70 con 0x55c48cd15870 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94302664535264] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f17c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 5 note: GC not initialized 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f17c67e4640 20 reqs_thread_entry: start 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 Filter name: none 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1737fff640 20 reqs_thread_entry: start 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:26.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd4b6b0 con 0x55c48cd15870 2024-09-12T17:12:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:12:26.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd4cc30 con 0x7f190c019040 2024-09-12T17:12:26.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.906+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f17c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:26.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94302664535264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd4afd0 con 0x55c48cd15870 2024-09-12T17:12:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94302664535264] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94302664522240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd22ce0 con 0x7f19080df040 2024-09-12T17:12:26.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94302664522240] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1913a119c0 20 remove_watcher() i=0 2024-09-12T17:12:26.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1913a119c0 2 removed watcher, disabling cache 2024-09-12T17:12:26.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.910+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94302664526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd22ce0 con 0x55c48cd15870 2024-09-12T17:12:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94302664526208] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1913a119c0 20 remove_watcher() i=1 2024-09-12T17:12:26.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94302664530048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd20980 con 0x55c48cd1b8e0 2024-09-12T17:12:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1910d16640 1 -- 172.21.15.193:0/2606856238 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94302664530048] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19080c0030 con 0x55c48cd1b8e0 2024-09-12T17:12:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1913a119c0 20 remove_watcher() i=2 2024-09-12T17:12:26.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.914+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94302664533952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd22ce0 con 0x7f19080df040 2024-09-12T17:12:26.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1911d18640 1 -- 172.21.15.193:0/2606856238 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94302664533952] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190c02f040 con 0x7f19080df040 2024-09-12T17:12:26.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1913a119c0 20 remove_watcher() i=3 2024-09-12T17:12:26.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94302664538240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21880 con 0x55c48cd15870 2024-09-12T17:12:26.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94302664538240] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x55c48cd15870 2024-09-12T17:12:26.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1913a119c0 20 remove_watcher() i=4 2024-09-12T17:12:26.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.918+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94302664527264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd23880 con 0x7f190c019040 2024-09-12T17:12:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94302664527264] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1913a119c0 20 remove_watcher() i=5 2024-09-12T17:12:26.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94302664541584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21880 con 0x7f190c019040 2024-09-12T17:12:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94302664541584] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1913a119c0 20 remove_watcher() i=6 2024-09-12T17:12:26.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.922+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94302664545536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c48cd21880 con 0x7f190c019040 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94302664545536] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f190403c060 con 0x7f190c019040 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 20 remove_watcher() i=7 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f190c019040 msgr2=0x7f190c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f190c019040 0x7f190c019930 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cd15870 msgr2=0x55c48cd17d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cd15870 0x55c48cd17d00 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f19080df040 msgr2=0x7f19080c4a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f19080df040 0x7f19080c4a40 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c48cd1b8e0 msgr2=0x55c48cd1dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c48cd1b8e0 0x55c48cd1dcd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17dc039a70 msgr2=0x7f17dc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17dc039a70 0x7f17dc03bf30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f190c00f010 tx=0x7f190c01b070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 msgr2=0x55c48cd0a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f19080c2c20 tx=0x7f19080eb210 comp rx=0 tx=0).stop 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1911517640 1 -- 172.21.15.193:0/2606856238 reap_dead start 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 shutdown_connections 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2606856238 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cd03060 0x55c48cd0a590 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 >> 172.21.15.193:0/2606856238 conn(0x55c48ccff490 msgr2=0x55c48ccfd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 shutdown_connections 2024-09-12T17:12:26.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2606856238 wait complete. 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 msgr2=0x7f17e803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 0x7f17e803bf20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x55c48cce7a90 tx=0x7f190c003070 comp rx=0 tx=0).stop 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 msgr2=0x55c48ccf6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1908018f70 tx=0x7f19080180e0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 shutdown_connections 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17e8039a60 0x7f17e803bf20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/2661540597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48ccf6820 0x55c48ccf6c40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 >> 172.21.15.193:0/2661540597 conn(0x55c48ccec1d0 msgr2=0x55c48ccec5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 shutdown_connections 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/2661540597 wait complete. 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 msgr2=0x55c48cce6230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 0x55c48cce6230 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 msgr2=0x7f17f803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 0x7f17f803bf80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f19080ae000 tx=0x7f19080a6000 comp rx=0 tx=0).stop 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 msgr2=0x55c48ccdf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1904001b80 tx=0x7f1904000f50 comp rx=0 tx=0).stop 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 shutdown_connections 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c48cbee310 0x55c48cce6230 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f17f8039ac0 0x7f17f803bf80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 --2- 172.21.15.193:0/3212926863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c48cb5e240 0x55c48ccdf0c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 >> 172.21.15.193:0/3212926863 conn(0x55c48cbe4920 msgr2=0x55c48cbe8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 shutdown_connections 2024-09-12T17:12:26.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:26.926+0000 7f1913a119c0 1 -- 172.21.15.193:0/3212926863 wait complete. 2024-09-12T17:12:26.939 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:26.939 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:26.939 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T17:12:26.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-12T17:12:26.940 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-12T17:12:27.018 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.019 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f838947b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555fb3bd4e40 0x555fb3bd5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f838947b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555fb3a8a9c0 con 0x555fb3bd8020 2024-09-12T17:12:27.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f838947b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x555fb3ada6d0 con 0x555fb3bd4e40 2024-09-12T17:12:27.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f8386f81640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555fb3bd4e40 0x555fb3bd5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f8386f81640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555fb3bd4e40 0x555fb3bd5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33244/0 (socket says 172.21.15.193:33244) 2024-09-12T17:12:27.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f8386f81640 1 -- 172.21.15.193:0/2130419793 learned_addr learned my addr 172.21.15.193:0/2130419793 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f8386f81640 1 -- 172.21.15.193:0/2130419793 >> v1:172.21.15.62:6789/0 conn(0x555fb3bd8020 legacy=0x555fb3bda410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.018+0000 7f8386f81640 1 -- 172.21.15.193:0/2130419793 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3a7eca0 con 0x555fb3bd4e40 2024-09-12T17:12:27.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f8386f81640 1 --2- 172.21.15.193:0/2130419793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3bd5220 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f837000a5c0 tx=0x7f837001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f35f908440e65c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f8385f7f640 1 -- 172.21.15.193:0/2130419793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700a6070 con 0x555fb3bd4e40 2024-09-12T17:12:27.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f8385f7f640 1 -- 172.21.15.193:0/2130419793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83700af070 con 0x555fb3bd4e40 2024-09-12T17:12:27.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f8385f7f640 1 -- 172.21.15.193:0/2130419793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700aa5c0 con 0x555fb3bd4e40 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 -- 172.21.15.193:0/2130419793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 msgr2=0x555fb3bd5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 --2- 172.21.15.193:0/2130419793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3bd5220 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f837000a5c0 tx=0x7f837001b340 comp rx=0 tx=0).stop 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 -- 172.21.15.193:0/2130419793 shutdown_connections 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 --2- 172.21.15.193:0/2130419793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3bd5220 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 -- 172.21.15.193:0/2130419793 >> 172.21.15.193:0/2130419793 conn(0x555fb3bd0960 msgr2=0x555fb3bd2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 -- 172.21.15.193:0/2130419793 shutdown_connections 2024-09-12T17:12:27.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.022+0000 7f838947b9c0 1 -- 172.21.15.193:0/2130419793 wait complete. 2024-09-12T17:12:27.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555fb3ade680 con 0x555fb3bd4e40 2024-09-12T17:12:27.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33248/0 (socket says 172.21.15.193:33248) 2024-09-12T17:12:27.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 -- 172.21.15.193:0/399591055 learned_addr learned my addr 172.21.15.193:0/399591055 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.039 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 -- 172.21.15.193:0/399591055 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3a59da0 con 0x555fb3bd4e40 2024-09-12T17:12:27.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 --2- 172.21.15.193:0/399591055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8370018f70 tx=0x7f8370003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1063f4d5e70713 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8274e09640 1 -- 172.21.15.193:0/399591055 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700aa9e0 con 0x555fb3bd4e40 2024-09-12T17:12:27.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8274e09640 1 -- 172.21.15.193:0/399591055 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83700aab80 con 0x555fb3bd4e40 2024-09-12T17:12:27.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8274e09640 1 -- 172.21.15.193:0/399591055 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700aae60 con 0x555fb3bd4e40 2024-09-12T17:12:27.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- 172.21.15.193:0/399591055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 msgr2=0x555fb3cc1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 --2- 172.21.15.193:0/399591055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8370018f70 tx=0x7f8370003030 comp rx=0 tx=0).stop 2024-09-12T17:12:27.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- 172.21.15.193:0/399591055 shutdown_connections 2024-09-12T17:12:27.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 --2- 172.21.15.193:0/399591055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc1720 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- 172.21.15.193:0/399591055 >> 172.21.15.193:0/399591055 conn(0x555fb3bd0960 msgr2=0x555fb3cbd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- 172.21.15.193:0/399591055 shutdown_connections 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- 172.21.15.193:0/399591055 wait complete. 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f838947b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555fb3a80a50 con 0x555fb3bd4e40 2024-09-12T17:12:27.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33256/0 (socket says 172.21.15.193:33256) 2024-09-12T17:12:27.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.038+0000 7f8386f81640 1 -- 172.21.15.193:0/3872187866 learned_addr learned my addr 172.21.15.193:0/3872187866 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8386f81640 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3cc91b0 con 0x555fb3bd4e40 2024-09-12T17:12:27.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8386f81640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c10 tx=0x7f83700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 -- 172.21.15.193:0/3872187866 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700c6750 con 0x555fb3bd4e40 2024-09-12T17:12:27.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 -- 172.21.15.193:0/3872187866 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83700c68f0 con 0x555fb3bd4e40 2024-09-12T17:12:27.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb3cc9440 con 0x555fb3bd4e40 2024-09-12T17:12:27.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 -- 172.21.15.193:0/3872187866 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83700c6bf0 con 0x555fb3bd4e40 2024-09-12T17:12:27.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb3cc9df0 con 0x555fb3bd4e40 2024-09-12T17:12:27.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 -- 172.21.15.193:0/3872187866 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83700ce030 con 0x555fb3bd4e40 2024-09-12T17:12:27.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 0x7f826c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8273606640 1 -- 172.21.15.193:0/3872187866 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f83700cc020 con 0x555fb3bd4e40 2024-09-12T17:12:27.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8386780640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 0x7f826c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 0x555fb3ccfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3cd0300 con 0x555fb3bd8020 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8387782640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 0x555fb3ccfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8386780640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 0x7f826c03bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8378001e60 tx=0x7f83780013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8387782640 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 0x555fb3ccfdc0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8387782640 1 -- 172.21.15.193:0/3872187866 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f838000a4d0 con 0x555fb3bd8020 2024-09-12T17:12:27.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3cd0770 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f8387782640 1 -- 172.21.15.193:0/3872187866 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f838000a4d0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.042+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3cd2070 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8387782640 1 -- 172.21.15.193:0/3872187866 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f838000a4d0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3cd12a0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8387782640 1 -- 172.21.15.193:0/3872187866 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f838000a4d0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3cd16c0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8387782640 1 -- 172.21.15.193:0/3872187866 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f838000a4d0 con 0x555fb3bd8020 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555fb3aeb450 con 0x555fb3ce03d0 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33264/0 (socket says 172.21.15.193:33264) 2024-09-12T17:12:27.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8386780640 1 -- 172.21.15.193:0/45879459 learned_addr learned my addr 172.21.15.193:0/45879459 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8386780640 1 -- 172.21.15.193:0/45879459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3ce0e30 con 0x555fb3ce03d0 2024-09-12T17:12:27.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8386780640 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8378010f90 tx=0x7f837800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8270e01640 1 -- 172.21.15.193:0/45879459 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f837800a040 con 0x555fb3ce03d0 2024-09-12T17:12:27.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb3ce1690 con 0x555fb3ce03d0 2024-09-12T17:12:27.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8270e01640 1 -- 172.21.15.193:0/45879459 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378017050 con 0x555fb3ce03d0 2024-09-12T17:12:27.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f8270e01640 1 -- 172.21.15.193:0/45879459 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f837800e7e0 con 0x555fb3ce03d0 2024-09-12T17:12:27.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.046+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb3ce1c00 con 0x555fb3ce03d0 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8270e01640 1 -- 172.21.15.193:0/45879459 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f837800e9d0 con 0x555fb3ce03d0 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8270e01640 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 0x7f826003bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8270e01640 1 -- 172.21.15.193:0/45879459 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8378052270 con 0x555fb3ce03d0 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8387782640 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 0x7f826003bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8387782640 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 0x7f826003bf70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x555fb3cd1640 tx=0x7f8380005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555fb3cc1eb0 con 0x555fb3bde530 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33276/0 (socket says 172.21.15.193:33276) 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8386780640 1 -- 172.21.15.193:0/357885805 learned_addr learned my addr 172.21.15.193:0/357885805 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8386780640 1 -- 172.21.15.193:0/357885805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3bdee50 con 0x555fb3bde530 2024-09-12T17:12:27.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f8386780640 1 --2- 172.21.15.193:0/357885805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8378050510 tx=0x7f837801aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eafb697c93bf7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f826a7fc640 1 -- 172.21.15.193:0/357885805 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8378024360 con 0x555fb3bde530 2024-09-12T17:12:27.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f826a7fc640 1 -- 172.21.15.193:0/357885805 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837800ecc0 con 0x555fb3bde530 2024-09-12T17:12:27.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f826a7fc640 1 -- 172.21.15.193:0/357885805 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f837801a310 con 0x555fb3bde530 2024-09-12T17:12:27.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- 172.21.15.193:0/357885805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 msgr2=0x555fb3bde910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 --2- 172.21.15.193:0/357885805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8378050510 tx=0x7f837801aa60 comp rx=0 tx=0).stop 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- 172.21.15.193:0/357885805 shutdown_connections 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 --2- 172.21.15.193:0/357885805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3bde910 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- 172.21.15.193:0/357885805 >> 172.21.15.193:0/357885805 conn(0x555fb3ce9180 msgr2=0x555fb3ce73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- 172.21.15.193:0/357885805 shutdown_connections 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- 172.21.15.193:0/357885805 wait complete. 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 Processor -- start 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.050+0000 7f838947b9c0 1 -- start start 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3cf64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555fb3bdf440 con 0x555fb3bde530 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3cf64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386780640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3cf64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33282/0 (socket says 172.21.15.193:33282) 2024-09-12T17:12:27.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 learned_addr learned my addr 172.21.15.193:0/3092377769 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fb3cf6a40 con 0x555fb3bde530 2024-09-12T17:12:27.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386780640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3cf64e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8378050510 tx=0x7f83780504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 -- 172.21.15.193:0/3092377769 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8378024360 con 0x555fb3bde530 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 -- 172.21.15.193:0/3092377769 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837801c410 con 0x555fb3bde530 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555fb3cf6cd0 con 0x555fb3bde530 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 -- 172.21.15.193:0/3092377769 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f837801c5e0 con 0x555fb3bde530 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fb3cf7680 con 0x555fb3bde530 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 -- 172.21.15.193:0/3092377769 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8378024580 con 0x555fb3bde530 2024-09-12T17:12:27.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8250039a70 0x7f825003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8268ff9640 1 -- 172.21.15.193:0/3092377769 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f837803ace0 con 0x555fb3bde530 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8387782640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8250039a70 0x7f825003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3d017f0 0x555fb3d03c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d043d0 con 0x555fb3d017f0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386f81640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3d017f0 0x555fb3d03c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8387782640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8250039a70 0x7f825003bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555fb3cd0dc0 tx=0x7f838001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.054+0000 7f8386f81640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3d017f0 0x555fb3d03c80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 realm 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d047e0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d050b0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d05450 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d058f0 con 0x555fb3d017f0 2024-09-12T17:12:27.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 20 searching for the correct realm 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555fb3d07860 0x555fb3d09c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386780640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555fb3d07860 0x555fb3d09c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386780640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555fb3d07860 0x555fb3d09c50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386780640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f837801c030 0x7f83780387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8387782640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f837801c030 0x7f83780387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8387782640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f837801c030 0x7f83780387d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8387782640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8380031040 0x7f8380032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8380031040 0x7f8380032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.058+0000 7f8386f81640 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8380031040 0x7f8380032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.062+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.066+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d07860 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f8380031040 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x555fb3d017f0 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a260 con 0x7f837801c030 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f838001f070 con 0x7f837801c030 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d06330 con 0x555fb3d017f0 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d06bd0 con 0x555fb3d017f0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.070+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d05f70 con 0x555fb3d017f0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 zone default found 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 4 Realm: () 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 zonegroup default 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0a6e0 con 0x7f8380031040 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0c580 con 0x555fb3d07860 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0c920 con 0x555fb3d07860 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.079 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0b9c0 con 0x7f837801c030 2024-09-12T17:12:27.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93869527055840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0b620 con 0x7f837801c030 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0d790 con 0x555fb3d017f0 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.074+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93869527055840] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93869527059648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0d790 con 0x555fb3d017f0 2024-09-12T17:12:27.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0e150 con 0x555fb3d07860 2024-09-12T17:12:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93869527063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0e9a0 con 0x555fb3d07860 2024-09-12T17:12:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93869527059648] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.078+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0f360 con 0x7f837801c030 2024-09-12T17:12:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93869527068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0f780 con 0x7f837801c030 2024-09-12T17:12:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d10140 con 0x555fb3d017f0 2024-09-12T17:12:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93869527063712] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93869527068336] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93869527071888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0f780 con 0x555fb3d017f0 2024-09-12T17:12:27.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.082+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d100b0 con 0x7f8380031040 2024-09-12T17:12:27.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93869527071888] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93869527069664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d10560 con 0x7f8380031040 2024-09-12T17:12:27.087 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d10f20 con 0x7f8380031040 2024-09-12T17:12:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93869527075440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d11340 con 0x7f8380031040 2024-09-12T17:12:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d11e30 con 0x7f8380031040 2024-09-12T17:12:27.089 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.086+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93869527069664] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93869527075440] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93869527079168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d10e90 con 0x7f8380031040 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=0 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=1 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=2 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=3 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=4 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=5 2024-09-12T17:12:27.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=6 2024-09-12T17:12:27.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93869527079168] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 20 add_watcher() i=7 2024-09-12T17:12:27.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d14f30 con 0x555fb3d017f0 2024-09-12T17:12:27.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.090+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93869527072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d123b0 con 0x555fb3d017f0 2024-09-12T17:12:27.095 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93869527072944] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f823d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 5 note: GC not initialized 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f81b7fff640 20 reqs_thread_entry: start 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 Filter name: none 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f81b5ffb640 20 reqs_thread_entry: start 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d37ab0 con 0x555fb3d017f0 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:12:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d39030 con 0x7f8380031040 2024-09-12T17:12:27.097 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f823d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.098 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.094+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93869527072944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d373d0 con 0x555fb3d017f0 2024-09-12T17:12:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93869527072944] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93869527055840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d100b0 con 0x7f837801c030 2024-09-12T17:12:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93869527055840] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f838947b9c0 20 remove_watcher() i=0 2024-09-12T17:12:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f838947b9c0 2 removed watcher, disabling cache 2024-09-12T17:12:27.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93869527059648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d100b0 con 0x555fb3d017f0 2024-09-12T17:12:27.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.098+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93869527059648] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 20 remove_watcher() i=1 2024-09-12T17:12:27.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93869527063712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0ccc0 con 0x555fb3d07860 2024-09-12T17:12:27.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f8386780640 1 -- 172.21.15.193:0/3092377769 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93869527063712] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8378036020 con 0x555fb3d07860 2024-09-12T17:12:27.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 20 remove_watcher() i=2 2024-09-12T17:12:27.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93869527068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d100b0 con 0x7f837801c030 2024-09-12T17:12:27.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f8387782640 1 -- 172.21.15.193:0/3092377769 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93869527068336] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8380040040 con 0x7f837801c030 2024-09-12T17:12:27.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 20 remove_watcher() i=3 2024-09-12T17:12:27.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.102+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93869527071888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0dca0 con 0x555fb3d017f0 2024-09-12T17:12:27.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93869527071888] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x555fb3d017f0 2024-09-12T17:12:27.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f838947b9c0 20 remove_watcher() i=4 2024-09-12T17:12:27.107 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93869527069664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0eeb0 con 0x7f8380031040 2024-09-12T17:12:27.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93869527069664] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f838947b9c0 20 remove_watcher() i=5 2024-09-12T17:12:27.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.106+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93869527075440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0dca0 con 0x7f8380031040 2024-09-12T17:12:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93869527075440] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 20 remove_watcher() i=6 2024-09-12T17:12:27.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93869527079168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555fb3d0f3e0 con 0x7f8380031040 2024-09-12T17:12:27.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93869527079168] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83700c53e0 con 0x7f8380031040 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 20 remove_watcher() i=7 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8380031040 msgr2=0x7f8380032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8380031040 0x7f8380032940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3d017f0 msgr2=0x555fb3d03c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3d017f0 0x555fb3d03c80 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f837801c030 msgr2=0x7f83780387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f837801c030 0x7f83780387d0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555fb3d07860 msgr2=0x555fb3d09c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555fb3d07860 0x555fb3d09c50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8250039a70 msgr2=0x7f825003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8250039a70 0x7f825003bf30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x555fb3cd0dc0 tx=0x7f838001f000 comp rx=0 tx=0).stop 2024-09-12T17:12:27.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 msgr2=0x555fb3cf64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3092377769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bde530 0x555fb3cf64e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8378050510 tx=0x7f83780504a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.110+0000 7f8386f81640 1 -- 172.21.15.193:0/3092377769 reap_dead start 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 shutdown_connections 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 >> 172.21.15.193:0/3092377769 conn(0x555fb3ce9180 msgr2=0x555fb3ce7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 shutdown_connections 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3092377769 wait complete. 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 msgr2=0x7f826003bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 0x7f826003bf70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x555fb3cd1640 tx=0x7f8380005850 comp rx=0 tx=0).stop 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 msgr2=0x555fb3ce07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8378010f90 tx=0x7f837800f7a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 shutdown_connections 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8260039ab0 0x7f826003bf70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/45879459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3ce03d0 0x555fb3ce07f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 >> 172.21.15.193:0/45879459 conn(0x555fb3cd5d80 msgr2=0x555fb3cd6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 shutdown_connections 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/45879459 wait complete. 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 msgr2=0x555fb3ccfdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 0x555fb3ccfdc0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 msgr2=0x7f826c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 0x7f826c03bf30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8378001e60 tx=0x7f83780013e0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 msgr2=0x555fb3cc8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c10 tx=0x7f83700180e0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 shutdown_connections 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555fb3bd8020 0x555fb3ccfdc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f826c039a70 0x7f826c03bf30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 --2- 172.21.15.193:0/3872187866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555fb3bd4e40 0x555fb3cc8c50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 >> 172.21.15.193:0/3872187866 conn(0x555fb3bd0960 msgr2=0x555fb3cbbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 shutdown_connections 2024-09-12T17:12:27.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.114+0000 7f838947b9c0 1 -- 172.21.15.193:0/3872187866 wait complete. 2024-09-12T17:12:27.124 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:27.124 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:27.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T17:12:27.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-12T17:12:27.125 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-12T17:12:27.198 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.199 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fc0cf49c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56287d131230 0x56287d1bfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fc0cf49c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56287d0719c0 con 0x56287d1c0120 2024-09-12T17:12:27.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fc0cf49c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56287d0c16d0 con 0x56287d131230 2024-09-12T17:12:27.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fbe7fa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56287d131230 0x56287d1bfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fbe7fa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56287d131230 0x56287d1bfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49756/0 (socket says 172.21.15.193:49756) 2024-09-12T17:12:27.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/840588853 learned_addr learned my addr 172.21.15.193:0/840588853 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/840588853 >> v1:172.21.15.62:6789/0 conn(0x56287d1c0120 legacy=0x56287d1c2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.198+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/840588853 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d065ca0 con 0x56287d131230 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/840588853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d1bfbe0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a5c0 tx=0x7f7fb801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10a31d764b0248 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fbd7f8640 1 -- 172.21.15.193:0/840588853 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80b1070 con 0x56287d131230 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fbd7f8640 1 -- 172.21.15.193:0/840588853 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb80a8070 con 0x56287d131230 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fbd7f8640 1 -- 172.21.15.193:0/840588853 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80ac5b0 con 0x56287d131230 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/840588853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 msgr2=0x56287d1bfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/840588853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d1bfbe0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800a5c0 tx=0x7f7fb801b340 comp rx=0 tx=0).stop 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/840588853 shutdown_connections 2024-09-12T17:12:27.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/840588853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d1bfbe0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/840588853 >> 172.21.15.193:0/840588853 conn(0x56287d1b7910 msgr2=0x56287d1b9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/840588853 shutdown_connections 2024-09-12T17:12:27.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.202+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/840588853 wait complete. 2024-09-12T17:12:27.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fc0cf49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fc0cf49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56287d0c5680 con 0x56287d131230 2024-09-12T17:12:27.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fbe7fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fbe7fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49764/0 (socket says 172.21.15.193:49764) 2024-09-12T17:12:27.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/2752535534 learned_addr learned my addr 172.21.15.193:0/2752535534 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.214+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/2752535534 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d040da0 con 0x56287d131230 2024-09-12T17:12:27.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/2752535534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8018f70 tx=0x7f7fb8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a020e36f1de63c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eac608640 1 -- 172.21.15.193:0/2752535534 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80bb070 con 0x56287d131230 2024-09-12T17:12:27.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eac608640 1 -- 172.21.15.193:0/2752535534 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb80ac880 con 0x56287d131230 2024-09-12T17:12:27.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eac608640 1 -- 172.21.15.193:0/2752535534 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80b1040 con 0x56287d131230 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/2752535534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 msgr2=0x56287d2a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/2752535534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8018f70 tx=0x7f7fb8003030 comp rx=0 tx=0).stop 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/2752535534 shutdown_connections 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/2752535534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2a8840 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/2752535534 >> 172.21.15.193:0/2752535534 conn(0x56287d1b7910 msgr2=0x56287d2a4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/2752535534 shutdown_connections 2024-09-12T17:12:27.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/2752535534 wait complete. 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56287d067a50 con 0x56287d131230 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49766/0 (socket says 172.21.15.193:49766) 2024-09-12T17:12:27.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/951063233 learned_addr learned my addr 172.21.15.193:0/951063233 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d2b0370 con 0x56287d131230 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8018f70 tx=0x7f7fb80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eaae05640 1 -- 172.21.15.193:0/951063233 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80cd070 con 0x56287d131230 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eaae05640 1 -- 172.21.15.193:0/951063233 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fb80c0850 con 0x56287d131230 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56287d2b0600 con 0x56287d131230 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7eaae05640 1 -- 172.21.15.193:0/951063233 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fb80b1070 con 0x56287d131230 2024-09-12T17:12:27.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.218+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287d2b0f60 con 0x56287d131230 2024-09-12T17:12:27.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7eaae05640 1 -- 172.21.15.193:0/951063233 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fb80d0070 con 0x56287d131230 2024-09-12T17:12:27.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7eaae05640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 0x7f7ea403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7eaae05640 1 -- 172.21.15.193:0/951063233 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7fb80eafd0 con 0x56287d131230 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 0x7f7ea403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 0x56287d2b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2b7470 con 0x56287d1c0120 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 0x56287d2b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 0x7f7ea403bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80015d0 tx=0x7f7fa80066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 0x56287d2b6f30 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 -- 172.21.15.193:0/951063233 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb00083f0 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2b1320 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 -- 172.21.15.193:0/951063233 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fb00083f0 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2b9200 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 -- 172.21.15.193:0/951063233 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7fb00083f0 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2b8430 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 -- 172.21.15.193:0/951063233 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fb00083f0 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2b8880 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fbeffb640 1 -- 172.21.15.193:0/951063233 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7fb00083f0 con 0x56287d1c0120 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.222+0000 7f7fc0cf49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56287d0d2450 con 0x56287d1bd320 2024-09-12T17:12:27.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49778/0 (socket says 172.21.15.193:49778) 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3861963855 learned_addr learned my addr 172.21.15.193:0/3861963855 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3861963855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d1bd840 con 0x56287d1bd320 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8012630 tx=0x7f7fa8015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 -- 172.21.15.193:0/3861963855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa80152c0 con 0x56287d1bd320 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 -- 172.21.15.193:0/3861963855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa8020430 con 0x56287d1bd320 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56287d1bc100 con 0x56287d1bd320 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 -- 172.21.15.193:0/3861963855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8020710 con 0x56287d1bd320 2024-09-12T17:12:27.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287d1bc670 con 0x56287d1bd320 2024-09-12T17:12:27.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 -- 172.21.15.193:0/3861963855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fa8010070 con 0x56287d1bd320 2024-09-12T17:12:27.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7ea3fff640 1 -- 172.21.15.193:0/3861963855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7fa801b070 con 0x56287d1bd320 2024-09-12T17:12:27.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.226+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 0x7f7e9803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000e3f0 tx=0x7f7fb0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56287d2a9030 con 0x56287d2d71b0 2024-09-12T17:12:27.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49784/0 (socket says 172.21.15.193:49784) 2024-09-12T17:12:27.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3594050823 learned_addr learned my addr 172.21.15.193:0/3594050823 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3594050823 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d2d7ba0 con 0x56287d2d71b0 2024-09-12T17:12:27.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3594050823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8050410 tx=0x7f7fa8043420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc09da9105b4c2b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7ea1ffb640 1 -- 172.21.15.193:0/3594050823 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa801d8f0 con 0x56287d2d71b0 2024-09-12T17:12:27.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7ea1ffb640 1 -- 172.21.15.193:0/3594050823 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa801dd80 con 0x56287d2d71b0 2024-09-12T17:12:27.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7ea1ffb640 1 -- 172.21.15.193:0/3594050823 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8028de0 con 0x56287d2d71b0 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3594050823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 msgr2=0x56287d2d75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3594050823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8050410 tx=0x7f7fa8043420 comp rx=0 tx=0).stop 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3594050823 shutdown_connections 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3594050823 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2d75b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3594050823 >> 172.21.15.193:0/3594050823 conn(0x56287d2d25d0 msgr2=0x56287d2d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3594050823 shutdown_connections 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3594050823 wait complete. 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 Processor -- start 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- start start 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fc0cf49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56287d2d6100 con 0x56287d2d71b0 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.234 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49798/0 (socket says 172.21.15.193:49798) 2024-09-12T17:12:27.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 learned_addr learned my addr 172.21.15.193:0/3836653047 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.230+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56287d2ddc70 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8028c40 tx=0x7f7fa80503a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 -- 172.21.15.193:0/3836653047 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8039070 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56287d2ddf00 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 -- 172.21.15.193:0/3836653047 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa801d8f0 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 -- 172.21.15.193:0/3836653047 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fa8048040 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287d2de8b0 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 -- 172.21.15.193:0/3836653047 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f7fa801ecd0 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e88039a70 0x7f7e8803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7e8ffff640 1 -- 172.21.15.193:0/3836653047 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f7fa802f040 con 0x56287d2d71b0 2024-09-12T17:12:27.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e88039a70 0x7f7e8803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d2e89d0 0x56287d2eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2eb5b0 con 0x56287d2e89d0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d2e89d0 0x56287d2eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e88039a70 0x7f7e8803bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000f010 tx=0x7f7fb001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d2e89d0 0x56287d2eae60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 realm 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2eb9c0 con 0x56287d2e89d0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2ec290 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2ec630 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2ecad0 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 20 searching for the correct realm 2024-09-12T17:12:27.241 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56287d2eea40 0x56287d2f0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.234+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56287d2eea40 0x56287d2f0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56287d2eea40 0x56287d2f0e30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbdff9640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f7fa8033070 0x7f7fa80550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fa8033070 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f7fa8033070 0x7f7fa80550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f7fa8033070 0x7f7fa80550c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbeffb640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7fb0019040 0x7f7fb0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7fb0019040 0x7f7fb0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7fb0019040 0x7f7fb0019930 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.238+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fa8033070 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fa8033070 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.242+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.249 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fa8033070 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2e89d0 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fa8033070 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x56287d2eea40 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.246+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f1440 con 0x7f7fb0019040 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7fb8100040 con 0x56287d2e89d0 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.255 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7fb8100040 con 0x7f7fa8033070 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2ed4b0 con 0x56287d2e89d0 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2edd50 con 0x56287d2e89d0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2ed0f0 con 0x56287d2e89d0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 zone default found 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 4 Realm: () 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.257 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 zonegroup default 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2edd50 con 0x7f7fb0019040 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f32b0 con 0x56287d2eea40 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f3650 con 0x56287d2eea40 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f2750 con 0x7f7fa8033070 2024-09-12T17:12:27.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94731898923888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f3ea0 con 0x7f7fa8033070 2024-09-12T17:12:27.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.250+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f46f0 con 0x56287d2e89d0 2024-09-12T17:12:27.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.254+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94731898923888] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.254+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.254+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94731898927600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f43a0 con 0x56287d2e89d0 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.254+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f4ec0 con 0x56287d2eea40 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.254+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94731898927600] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94731898931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f52b0 con 0x56287d2eea40 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f5c70 con 0x7f7fa8033070 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94731898935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6380 con 0x7f7fa8033070 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6ea0 con 0x56287d2e89d0 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94731898931600] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94731898935504] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94731898939760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x56287d2e89d0 2024-09-12T17:12:27.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.258+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f7740 con 0x7f7fb0019040 2024-09-12T17:12:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.262+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94731898939760] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.262+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.262+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94731898928656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f7310 con 0x7f7fb0019040 2024-09-12T17:12:27.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.262+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f7cd0 con 0x7f7fb0019040 2024-09-12T17:12:27.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94731898943520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f80f0 con 0x7f7fb0019040 2024-09-12T17:12:27.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f8b60 con 0x7f7fb0019040 2024-09-12T17:12:27.267 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94731898928656] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.268 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94731898943520] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94731898947120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f7c40 con 0x7f7fb0019040 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=0 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=1 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=2 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=3 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=4 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=5 2024-09-12T17:12:27.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.266+0000 7f7fc0cf49c0 20 add_watcher() i=6 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94731898947120] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 add_watcher() i=7 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d2fbc60 con 0x56287d2e89d0 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94731898941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f90e0 con 0x56287d2e89d0 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94731898941024] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 5 note: GC not initialized 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7def7fe640 20 reqs_thread_entry: start 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 Filter name: none 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7ded7fa640 20 reqs_thread_entry: start 2024-09-12T17:12:27.273 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d31e7c0 con 0x56287d2e89d0 2024-09-12T17:12:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:12:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.270+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56287d31fd40 con 0x7f7fb0019040 2024-09-12T17:12:27.274 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94731898941024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d31e0e0 con 0x56287d2e89d0 2024-09-12T17:12:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94731898941024] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.276 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94731898923888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x7f7fa8033070 2024-09-12T17:12:27.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94731898923888] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fc0cf49c0 20 remove_watcher() i=0 2024-09-12T17:12:27.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fc0cf49c0 2 removed watcher, disabling cache 2024-09-12T17:12:27.278 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.274+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94731898927600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x56287d2e89d0 2024-09-12T17:12:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94731898927600] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fc0cf49c0 20 remove_watcher() i=1 2024-09-12T17:12:27.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94731898931600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f39f0 con 0x56287d2eea40 2024-09-12T17:12:27.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fbdff9640 1 -- 172.21.15.193:0/3836653047 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94731898931600] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fa805c040 con 0x56287d2eea40 2024-09-12T17:12:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fc0cf49c0 20 remove_watcher() i=2 2024-09-12T17:12:27.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.278+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94731898935504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x7f7fa8033070 2024-09-12T17:12:27.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fbeffb640 1 -- 172.21.15.193:0/3836653047 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94731898935504] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb002f040 con 0x7f7fa8033070 2024-09-12T17:12:27.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fc0cf49c0 20 remove_watcher() i=3 2024-09-12T17:12:27.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94731898939760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f4990 con 0x56287d2e89d0 2024-09-12T17:12:27.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94731898939760] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x56287d2e89d0 2024-09-12T17:12:27.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fc0cf49c0 20 remove_watcher() i=4 2024-09-12T17:12:27.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.282+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94731898928656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x7f7fb0019040 2024-09-12T17:12:27.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94731898928656] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fc0cf49c0 20 remove_watcher() i=5 2024-09-12T17:12:27.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94731898943520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f4990 con 0x7f7fb0019040 2024-09-12T17:12:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94731898943520] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fc0cf49c0 20 remove_watcher() i=6 2024-09-12T17:12:27.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.286+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94731898947120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56287d2f6e60 con 0x7f7fb0019040 2024-09-12T17:12:27.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94731898947120] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fb80cf030 con 0x7f7fb0019040 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 20 remove_watcher() i=7 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7fb0019040 msgr2=0x7f7fb0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7fb0019040 0x7f7fb0019930 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d2e89d0 msgr2=0x56287d2eae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d2e89d0 0x56287d2eae60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f7fa8033070 msgr2=0x7f7fa80550c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f7fa8033070 0x7f7fa80550c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56287d2eea40 msgr2=0x56287d2f0e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56287d2eea40 0x56287d2f0e30 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e88039a70 msgr2=0x7f7e8803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e88039a70 0x7f7e8803bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000f010 tx=0x7f7fb001b070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 msgr2=0x56287d2dd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fbe7fa640 1 -- 172.21.15.193:0/3836653047 reap_dead start 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8028c40 tx=0x7f7fa80503a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 shutdown_connections 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3836653047 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d2d71b0 0x56287d2dd710 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 >> 172.21.15.193:0/3836653047 conn(0x56287d2d25d0 msgr2=0x56287d2d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 shutdown_connections 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3836653047 wait complete. 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 msgr2=0x7f7e9803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 0x7f7e9803bf80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000e3f0 tx=0x7f7fb0003070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 msgr2=0x56287d1bbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8012630 tx=0x7f7fa8015f90 comp rx=0 tx=0).stop 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 shutdown_connections 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7e98039ac0 0x7f7e9803bf80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/3861963855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d1bd320 0x56287d1bbbc0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 >> 172.21.15.193:0/3861963855 conn(0x56287d2bcf50 msgr2=0x56287d2bd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 shutdown_connections 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/3861963855 wait complete. 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 msgr2=0x56287d2b6f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 0x56287d2b6f30 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 msgr2=0x7f7ea403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 0x7f7ea403bf30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80015d0 tx=0x7f7fa80066b0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 msgr2=0x56287d2afe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7fb8018f70 tx=0x7f7fb80180e0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 shutdown_connections 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56287d1c0120 0x56287d2b6f30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7ea4039a70 0x7f7ea403bf30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 --2- 172.21.15.193:0/951063233 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56287d131230 0x56287d2afe10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 >> 172.21.15.193:0/951063233 conn(0x56287d1b7910 msgr2=0x56287d2a2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 shutdown_connections 2024-09-12T17:12:27.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.290+0000 7f7fc0cf49c0 1 -- 172.21.15.193:0/951063233 wait complete. 2024-09-12T17:12:27.301 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:27.301 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:27.301 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T17:12:27.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-12T17:12:27.302 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-12T17:12:27.372 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.372 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f3660a609c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c7fa7ee230 0x55c7fa87efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f3660a609c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c7fa72e9c0 con 0x55c7fa7ee610 2024-09-12T17:12:27.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f3660a609c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c7fa77e6d0 con 0x55c7fa7ee230 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f365e566640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c7fa7ee230 0x55c7fa87efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f365e566640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c7fa7ee230 0x55c7fa87efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49808/0 (socket says 172.21.15.193:49808) 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f365dd65640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c7fa7ee610 0x55c7fa881530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:39072/0 (socket says 172.21.15.193:39072) 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.370+0000 7f365e566640 1 -- 172.21.15.193:0/1560343091 learned_addr learned my addr 172.21.15.193:0/1560343091 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365e566640 1 -- 172.21.15.193:0/1560343091 >> v1:172.21.15.62:6789/0 conn(0x55c7fa7ee610 legacy=0x55c7fa881530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365e566640 1 -- 172.21.15.193:0/1560343091 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa722ca0 con 0x55c7fa7ee230 2024-09-12T17:12:27.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365e566640 1 --2- 172.21.15.193:0/1560343091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa87efe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f365800a4e0 tx=0x7f365801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ff84f0a4e6deb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365d564640 1 -- 172.21.15.193:0/1560343091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580aa540 con 0x55c7fa7ee230 2024-09-12T17:12:27.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365d564640 1 -- 172.21.15.193:0/1560343091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580aa6e0 con 0x55c7fa7ee230 2024-09-12T17:12:27.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f365d564640 1 -- 172.21.15.193:0/1560343091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580aaa40 con 0x55c7fa7ee230 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 -- 172.21.15.193:0/1560343091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 msgr2=0x55c7fa87efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1560343091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa87efe0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f365800a4e0 tx=0x7f365801b090 comp rx=0 tx=0).stop 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 -- 172.21.15.193:0/1560343091 shutdown_connections 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1560343091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa87efe0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 -- 172.21.15.193:0/1560343091 >> 172.21.15.193:0/1560343091 conn(0x55c7fa874910 msgr2=0x55c7fa876d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 -- 172.21.15.193:0/1560343091 shutdown_connections 2024-09-12T17:12:27.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.374+0000 7f3660a609c0 1 -- 172.21.15.193:0/1560343091 wait complete. 2024-09-12T17:12:27.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c7fa782680 con 0x55c7fa7ee230 2024-09-12T17:12:27.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49814/0 (socket says 172.21.15.193:49814) 2024-09-12T17:12:27.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 -- 172.21.15.193:0/3170152122 learned_addr learned my addr 172.21.15.193:0/3170152122 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 -- 172.21.15.193:0/3170152122 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa6fdda0 con 0x55c7fa7ee230 2024-09-12T17:12:27.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 --2- 172.21.15.193:0/3170152122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f36580ac040 tx=0x7f36580033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad4a51c71f6a318 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f354c608640 1 -- 172.21.15.193:0/3170152122 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580b9030 con 0x55c7fa7ee230 2024-09-12T17:12:27.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f354c608640 1 -- 172.21.15.193:0/3170152122 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580aaa40 con 0x55c7fa7ee230 2024-09-12T17:12:27.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f354c608640 1 -- 172.21.15.193:0/3170152122 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580aad20 con 0x55c7fa7ee230 2024-09-12T17:12:27.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- 172.21.15.193:0/3170152122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 msgr2=0x55c7fa967930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 --2- 172.21.15.193:0/3170152122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f36580ac040 tx=0x7f36580033b0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- 172.21.15.193:0/3170152122 shutdown_connections 2024-09-12T17:12:27.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 --2- 172.21.15.193:0/3170152122 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa967930 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- 172.21.15.193:0/3170152122 >> 172.21.15.193:0/3170152122 conn(0x55c7fa874910 msgr2=0x55c7fa963570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- 172.21.15.193:0/3170152122 shutdown_connections 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- 172.21.15.193:0/3170152122 wait complete. 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f3660a609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c7fa724a50 con 0x55c7fa7ee230 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49820/0 (socket says 172.21.15.193:49820) 2024-09-12T17:12:27.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.390+0000 7f365e566640 1 -- 172.21.15.193:0/2757932337 learned_addr learned my addr 172.21.15.193:0/2757932337 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365e566640 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa96f400 con 0x55c7fa7ee230 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365e566640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3658003430 tx=0x7f3658017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 -- 172.21.15.193:0/2757932337 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580b9070 con 0x55c7fa7ee230 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 -- 172.21.15.193:0/2757932337 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36580c2070 con 0x55c7fa7ee230 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fa96f690 con 0x55c7fa7ee230 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 -- 172.21.15.193:0/2757932337 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580b5ca0 con 0x55c7fa7ee230 2024-09-12T17:12:27.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fa970040 con 0x55c7fa7ee230 2024-09-12T17:12:27.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 -- 172.21.15.193:0/2757932337 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f36580b3040 con 0x55c7fa7ee230 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 0x7f354403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f354ae05640 1 -- 172.21.15.193:0/2757932337 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f36580ba070 con 0x55c7fa7ee230 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365dd65640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 0x7f354403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 0x55c7fa976010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa976550 con 0x55c7fa7ee610 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365ed67640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 0x55c7fa976010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365dd65640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 0x7f354403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3654001e40 tx=0x7f36540013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365ed67640 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 0x55c7fa976010 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365ed67640 1 -- 172.21.15.193:0/2757932337 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36500083f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9769c0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365ed67640 1 -- 172.21.15.193:0/2757932337 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9782c0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.394+0000 7f365ed67640 1 -- 172.21.15.193:0/2757932337 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36500083f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9774f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365ed67640 1 -- 172.21.15.193:0/2757932337 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36500083f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa977940 con 0x55c7fa7ee610 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365ed67640 1 -- 172.21.15.193:0/2757932337 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36500083f0 con 0x55c7fa7ee610 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c7fa78f450 con 0x55c7fa9865c0 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49824/0 (socket says 172.21.15.193:49824) 2024-09-12T17:12:27.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365dd65640 1 -- 172.21.15.193:0/1100609963 learned_addr learned my addr 172.21.15.193:0/1100609963 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365dd65640 1 -- 172.21.15.193:0/1100609963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa987020 con 0x55c7fa9865c0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f365dd65640 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f365400e670 tx=0x7f365400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3543fff640 1 -- 172.21.15.193:0/1100609963 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654022070 con 0x55c7fa9865c0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fa987880 con 0x55c7fa9865c0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3543fff640 1 -- 172.21.15.193:0/1100609963 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365400d660 con 0x55c7fa9865c0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3543fff640 1 -- 172.21.15.193:0/1100609963 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654006070 con 0x55c7fa9865c0 2024-09-12T17:12:27.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.398+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fa987df0 con 0x55c7fa9865c0 2024-09-12T17:12:27.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3543fff640 1 -- 172.21.15.193:0/1100609963 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f3654025070 con 0x55c7fa9865c0 2024-09-12T17:12:27.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3543fff640 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 0x7f353803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3543fff640 1 -- 172.21.15.193:0/1100609963 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f3654051af0 con 0x55c7fa9865c0 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365ed67640 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 0x7f353803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365ed67640 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 0x7f353803bf20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f365000e3f0 tx=0x7f3650003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c7fa9680c0 con 0x55c7fa992f20 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49832/0 (socket says 172.21.15.193:49832) 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365dd65640 1 -- 172.21.15.193:0/841856659 learned_addr learned my addr 172.21.15.193:0/841856659 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365dd65640 1 -- 172.21.15.193:0/841856659 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa9938d0 con 0x55c7fa992f20 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f365dd65640 1 --2- 172.21.15.193:0/841856659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f365404fe50 tx=0x7f365400d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7765d4a59f41eb0e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3541ffb640 1 -- 172.21.15.193:0/841856659 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654024e00 con 0x55c7fa992f20 2024-09-12T17:12:27.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3541ffb640 1 -- 172.21.15.193:0/841856659 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540263b0 con 0x55c7fa992f20 2024-09-12T17:12:27.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3541ffb640 1 -- 172.21.15.193:0/841856659 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365400dcc0 con 0x55c7fa992f20 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- 172.21.15.193:0/841856659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 msgr2=0x55c7fa993300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 --2- 172.21.15.193:0/841856659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f365404fe50 tx=0x7f365400d940 comp rx=0 tx=0).stop 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- 172.21.15.193:0/841856659 shutdown_connections 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 --2- 172.21.15.193:0/841856659 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa993300 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- 172.21.15.193:0/841856659 >> 172.21.15.193:0/841856659 conn(0x55c7fa98f350 msgr2=0x55c7fa98d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- 172.21.15.193:0/841856659 shutdown_connections 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- 172.21.15.193:0/841856659 wait complete. 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 Processor -- start 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- start start 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.402+0000 7f3660a609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c7fa993f30 con 0x55c7fa992f20 2024-09-12T17:12:27.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.412 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365dd65640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49844/0 (socket says 172.21.15.193:49844) 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 learned_addr learned my addr 172.21.15.193:0/1190819581 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7fa99aa50 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365dd65640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f365401afd0 tx=0x7f365404fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 -- 172.21.15.193:0/1190819581 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3654025c40 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c7fa99aa50 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 -- 172.21.15.193:0/1190819581 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3654047070 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 -- 172.21.15.193:0/1190819581 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f365403a060 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7fa99aa50 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 -- 172.21.15.193:0/1190819581 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f365401b8c0 con 0x55c7fa992f20 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3528039a20 0x7f352803bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f352ffff640 1 -- 172.21.15.193:0/1190819581 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f365404edf0 con 0x55c7fa992f20 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365ed67640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3528039a20 0x7f352803bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa9a5390 0x55c7fa9a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a7f70 con 0x55c7fa9a5390 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365e566640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa9a5390 0x55c7fa9a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365ed67640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3528039a20 0x7f352803bee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f365000f010 tx=0x7f365001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365e566640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa9a5390 0x55c7fa9a7820 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 realm 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a8380 con 0x55c7fa9a5390 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.406+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a8c50 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a8ff0 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a9450 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 20 searching for the correct realm 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c7fa9ab3c0 0x55c7fa9ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365dd65640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c7fa9ab3c0 0x55c7fa9ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365dd65640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c7fa9ab3c0 0x55c7fa9ad7b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365dd65640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3654041040 0x7f3654027440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365ed67640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3654041040 0x7f3654027440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365ed67640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3654041040 0x7f3654027440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365ed67640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3650019040 0x7f3650019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3650019040 0x7f3650019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3650019040 0x7f3650019930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.410+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.421 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.414+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.425 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.418+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3650019040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x55c7fa9a5390 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9ade30 con 0x7f3654041040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a9e30 con 0x55c7fa9a5390 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9aa6d0 con 0x55c7fa9a5390 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9a9a70 con 0x55c7fa9a5390 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 zone default found 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 4 Realm: () 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 zonegroup default 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9aa6d0 con 0x7f3650019040 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9afc80 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0020 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.422+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9af120 con 0x7f3654041040 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94317391312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b08c0 con 0x7f3654041040 2024-09-12T17:12:27.432 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b1110 con 0x55c7fa9a5390 2024-09-12T17:12:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94317391312144] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94317391315984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0d60 con 0x55c7fa9a5390 2024-09-12T17:12:27.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.426+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b1880 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94317391319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b2120 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b2ae0 con 0x7f3654041040 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94317391315984] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94317391324720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b2a50 con 0x7f3654041040 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b38b0 con 0x55c7fa9a5390 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94317391324720] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94317391319888] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94317391322224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b2a50 con 0x55c7fa9a5390 2024-09-12T17:12:27.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.430+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b3ca0 con 0x7f3650019040 2024-09-12T17:12:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.434+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94317391322224] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.434+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.434+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94317391330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b3380 con 0x7f3650019040 2024-09-12T17:12:27.436 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.434+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b45d0 con 0x7f3650019040 2024-09-12T17:12:27.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94317391331520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b4a40 con 0x7f3650019040 2024-09-12T17:12:27.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b5510 con 0x7f3650019040 2024-09-12T17:12:27.439 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94317391330304] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94317391335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b54d0 con 0x7f3650019040 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=0 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=1 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=2 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=3 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=4 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=5 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94317391331520] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.441 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.438+0000 7f3660a609c0 20 add_watcher() i=6 2024-09-12T17:12:27.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94317391335424] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.442 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 add_watcher() i=7 2024-09-12T17:12:27.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b4590 con 0x55c7fa9a5390 2024-09-12T17:12:27.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.443 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94317391332752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b5960 con 0x55c7fa9a5390 2024-09-12T17:12:27.444 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94317391332752] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 5 note: GC not initialized 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f348f7fe640 20 reqs_thread_entry: start 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 Filter name: none 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f348d7fa640 20 reqs_thread_entry: start 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9db220 con 0x55c7fa9a5390 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:12:27.445 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9dc7a0 con 0x7f3650019040 2024-09-12T17:12:27.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.442+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3514fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.446 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94317391332752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9dab40 con 0x55c7fa9a5390 2024-09-12T17:12:27.447 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94317391332752] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94317391312144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b4590 con 0x7f3654041040 2024-09-12T17:12:27.448 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94317391312144] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3660a609c0 20 remove_watcher() i=0 2024-09-12T17:12:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3660a609c0 2 removed watcher, disabling cache 2024-09-12T17:12:27.449 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.446+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94317391315984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9af510 con 0x55c7fa9a5390 2024-09-12T17:12:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94317391315984] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 20 remove_watcher() i=1 2024-09-12T17:12:27.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94317391319888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9af510 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.452 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f365dd65640 1 -- 172.21.15.193:0/1190819581 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94317391319888] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365405b040 con 0x55c7fa9ab3c0 2024-09-12T17:12:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 20 remove_watcher() i=2 2024-09-12T17:12:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94317391324720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0410 con 0x7f3654041040 2024-09-12T17:12:27.453 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f365ed67640 1 -- 172.21.15.193:0/1190819581 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94317391324720] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f365002f040 con 0x7f3654041040 2024-09-12T17:12:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 20 remove_watcher() i=3 2024-09-12T17:12:27.454 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.450+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94317391322224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0410 con 0x55c7fa9a5390 2024-09-12T17:12:27.455 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94317391322224] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x55c7fa9a5390 2024-09-12T17:12:27.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f3660a609c0 20 remove_watcher() i=4 2024-09-12T17:12:27.457 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94317391330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b1c70 con 0x7f3650019040 2024-09-12T17:12:27.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94317391330304] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f3660a609c0 20 remove_watcher() i=5 2024-09-12T17:12:27.458 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.454+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94317391331520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0410 con 0x7f3650019040 2024-09-12T17:12:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94317391331520] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 20 remove_watcher() i=6 2024-09-12T17:12:27.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94317391335424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c7fa9b0410 con 0x7f3650019040 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94317391335424] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580beca0 con 0x7f3650019040 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 20 remove_watcher() i=7 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3650019040 msgr2=0x7f3650019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f3650019040 0x7f3650019930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa9a5390 msgr2=0x55c7fa9a7820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa9a5390 0x55c7fa9a7820 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3654041040 msgr2=0x7f3654027440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3654041040 0x7f3654027440 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c7fa9ab3c0 msgr2=0x55c7fa9ad7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c7fa9ab3c0 0x55c7fa9ad7b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3528039a20 msgr2=0x7f352803bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3528039a20 0x7f352803bee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f365000f010 tx=0x7f365001b070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 msgr2=0x55c7fa99a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f365e566640 1 -- 172.21.15.193:0/1190819581 reap_dead start 2024-09-12T17:12:27.465 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.458+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f365401afd0 tx=0x7f365404fde0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 shutdown_connections 2024-09-12T17:12:27.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1190819581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa992f20 0x55c7fa99a4f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 >> 172.21.15.193:0/1190819581 conn(0x55c7fa98f350 msgr2=0x55c7fa98d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 shutdown_connections 2024-09-12T17:12:27.467 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1190819581 wait complete. 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 msgr2=0x7f353803bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 0x7f353803bf20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f365000e3f0 tx=0x7f3650003070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 msgr2=0x55c7fa9869e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f365400e670 tx=0x7f365400ea70 comp rx=0 tx=0).stop 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 shutdown_connections 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3538039a60 0x7f353803bf20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/1100609963 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa9865c0 0x55c7fa9869e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 >> 172.21.15.193:0/1100609963 conn(0x55c7fa97bf70 msgr2=0x55c7fa97c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.468 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 shutdown_connections 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/1100609963 wait complete. 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 msgr2=0x55c7fa976010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 0x55c7fa976010 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 msgr2=0x7f354403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 0x7f354403bf30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3654001e40 tx=0x7f36540013a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 msgr2=0x55c7fa96eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3658003430 tx=0x7f3658017e30 comp rx=0 tx=0).stop 2024-09-12T17:12:27.469 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 shutdown_connections 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c7fa7ee610 0x55c7fa976010 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3544039a70 0x7f354403bf30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 --2- 172.21.15.193:0/2757932337 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c7fa7ee230 0x55c7fa96eea0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 >> 172.21.15.193:0/2757932337 conn(0x55c7fa874910 msgr2=0x55c7fa962000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 shutdown_connections 2024-09-12T17:12:27.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.462+0000 7f3660a609c0 1 -- 172.21.15.193:0/2757932337 wait complete. 2024-09-12T17:12:27.472 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:27.472 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:27.472 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T17:12:27.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-12T17:12:27.473 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-12T17:12:27.545 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.545 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb858c1f9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5567a8728230 0x5567a87b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb858c1f9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5567a86689c0 con 0x5567a87b7120 2024-09-12T17:12:27.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb858c1f9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5567a86b86d0 con 0x5567a8728230 2024-09-12T17:12:27.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5567a8728230 0x5567a87b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5567a8728230 0x5567a87b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49854/0 (socket says 172.21.15.193:49854) 2024-09-12T17:12:27.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 -- 172.21.15.193:0/3559916223 learned_addr learned my addr 172.21.15.193:0/3559916223 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 -- 172.21.15.193:0/3559916223 >> v1:172.21.15.62:6789/0 conn(0x5567a87b7120 legacy=0x5567a87b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 -- 172.21.15.193:0/3559916223 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a865cca0 con 0x5567a8728230 2024-09-12T17:12:27.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.546+0000 7fb856725640 1 --2- 172.21.15.193:0/3559916223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b6be0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb85000a4e0 tx=0x7fb85001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f895ed0c13a77a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb855723640 1 -- 172.21.15.193:0/3559916223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500aa540 con 0x5567a8728230 2024-09-12T17:12:27.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb855723640 1 -- 172.21.15.193:0/3559916223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500aa6e0 con 0x5567a8728230 2024-09-12T17:12:27.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb855723640 1 -- 172.21.15.193:0/3559916223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500aaa40 con 0x5567a8728230 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/3559916223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 msgr2=0x5567a87b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/3559916223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b6be0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb85000a4e0 tx=0x7fb85001b090 comp rx=0 tx=0).stop 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/3559916223 shutdown_connections 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/3559916223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b6be0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/3559916223 >> 172.21.15.193:0/3559916223 conn(0x5567a87ae910 msgr2=0x5567a87b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/3559916223 shutdown_connections 2024-09-12T17:12:27.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.550+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/3559916223 wait complete. 2024-09-12T17:12:27.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb858c1f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb858c1f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567a86bc680 con 0x5567a8728230 2024-09-12T17:12:27.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb856725640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb856725640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49856/0 (socket says 172.21.15.193:49856) 2024-09-12T17:12:27.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb856725640 1 -- 172.21.15.193:0/1240291208 learned_addr learned my addr 172.21.15.193:0/1240291208 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb856725640 1 -- 172.21.15.193:0/1240291208 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a8637da0 con 0x5567a8728230 2024-09-12T17:12:27.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb856725640 1 --2- 172.21.15.193:0/1240291208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb850019740 tx=0x7fb8500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc7f1750c8de1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb744608640 1 -- 172.21.15.193:0/1240291208 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500b9070 con 0x5567a8728230 2024-09-12T17:12:27.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb744608640 1 -- 172.21.15.193:0/1240291208 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500aaa90 con 0x5567a8728230 2024-09-12T17:12:27.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.562+0000 7fb744608640 1 -- 172.21.15.193:0/1240291208 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500aad70 con 0x5567a8728230 2024-09-12T17:12:27.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1240291208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 msgr2=0x5567a87b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1240291208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb850019740 tx=0x7fb8500033b0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1240291208 shutdown_connections 2024-09-12T17:12:27.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1240291208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a87b4160 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1240291208 >> 172.21.15.193:0/1240291208 conn(0x5567a87ae910 msgr2=0x5567a889b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1240291208 shutdown_connections 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1240291208 wait complete. 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567a865ea50 con 0x5567a8728230 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb856725640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb856725640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49872/0 (socket says 172.21.15.193:49872) 2024-09-12T17:12:27.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb856725640 1 -- 172.21.15.193:0/2018623723 learned_addr learned my addr 172.21.15.193:0/2018623723 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb856725640 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a88a9480 con 0x5567a8728230 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb856725640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb850018cc0 tx=0x7fb850017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb742e05640 1 -- 172.21.15.193:0/2018623723 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500b9070 con 0x5567a8728230 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb742e05640 1 -- 172.21.15.193:0/2018623723 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500b5b10 con 0x5567a8728230 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a88a9710 con 0x5567a8728230 2024-09-12T17:12:27.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb742e05640 1 -- 172.21.15.193:0/2018623723 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8500b5df0 con 0x5567a8728230 2024-09-12T17:12:27.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a88aa0c0 con 0x5567a8728230 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.566+0000 7fb742e05640 1 -- 172.21.15.193:0/2018623723 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb8500b3040 con 0x5567a8728230 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb742e05640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb742e05640 1 -- 172.21.15.193:0/2018623723 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb8500c4070 con 0x5567a8728230 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 0x5567a88b0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88b05d0 con 0x5567a87b7120 2024-09-12T17:12:27.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 0x5567a88b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb84c001e60 tx=0x7fb84c0013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 0x5567a88b0090 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 -- 172.21.15.193:0/2018623723 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8480083f0 con 0x5567a87b7120 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88b0a40 con 0x5567a87b7120 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 -- 172.21.15.193:0/2018623723 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8480083f0 con 0x5567a87b7120 2024-09-12T17:12:27.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88b2340 con 0x5567a87b7120 2024-09-12T17:12:27.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 -- 172.21.15.193:0/2018623723 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8480083f0 con 0x5567a87b7120 2024-09-12T17:12:27.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88b1570 con 0x5567a87b7120 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 -- 172.21.15.193:0/2018623723 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8480083f0 con 0x5567a87b7120 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88b1990 con 0x5567a87b7120 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb856f26640 1 -- 172.21.15.193:0/2018623723 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8480083f0 con 0x5567a87b7120 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb858c1f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567a86c9450 con 0x5567a88c06a0 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49884/0 (socket says 172.21.15.193:49884) 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 -- 172.21.15.193:0/173461909 learned_addr learned my addr 172.21.15.193:0/173461909 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.570+0000 7fb855f24640 1 -- 172.21.15.193:0/173461909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a88c1100 con 0x5567a88c06a0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb84c010f90 tx=0x7fb84c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 -- 172.21.15.193:0/173461909 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c00a040 con 0x5567a88c06a0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 -- 172.21.15.193:0/173461909 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c017050 con 0x5567a88c06a0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a88c1960 con 0x5567a88c06a0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 -- 172.21.15.193:0/173461909 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c00e7e0 con 0x5567a88c06a0 2024-09-12T17:12:27.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a88c1ed0 con 0x5567a88c06a0 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 -- 172.21.15.193:0/173461909 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb84c00e980 con 0x5567a88c06a0 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 0x7fb73003bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb73bfff640 1 -- 172.21.15.193:0/173461909 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb84c0521e0 con 0x5567a88c06a0 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb856f26640 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 0x7fb73003bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb856f26640 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 0x7fb73003bf20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5567a88b1910 tx=0x7fb848003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb858c1f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567a87b48f0 con 0x5567a88cd020 2024-09-12T17:12:27.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49900/0 (socket says 172.21.15.193:49900) 2024-09-12T17:12:27.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 -- 172.21.15.193:0/2372708742 learned_addr learned my addr 172.21.15.193:0/2372708742 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 -- 172.21.15.193:0/2372708742 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a88cd9d0 con 0x5567a88cd020 2024-09-12T17:12:27.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb855f24640 1 --2- 172.21.15.193:0/2372708742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb84c050540 tx=0x7fb84c049f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe28429f11beb772 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb739ffb640 1 -- 172.21.15.193:0/2372708742 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c025e20 con 0x5567a88cd020 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb739ffb640 1 -- 172.21.15.193:0/2372708742 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c024c70 con 0x5567a88cd020 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.574+0000 7fb739ffb640 1 -- 172.21.15.193:0/2372708742 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c01ca60 con 0x5567a88cd020 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2372708742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 msgr2=0x5567a88cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2372708742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb84c050540 tx=0x7fb84c049f40 comp rx=0 tx=0).stop 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2372708742 shutdown_connections 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2372708742 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88cd400 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2372708742 >> 172.21.15.193:0/2372708742 conn(0x5567a88c9450 msgr2=0x5567a88c7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2372708742 shutdown_connections 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2372708742 wait complete. 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 Processor -- start 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- start start 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5567a88ce030 con 0x5567a88cd020 2024-09-12T17:12:27.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb855f24640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49912/0 (socket says 172.21.15.193:49912) 2024-09-12T17:12:27.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 learned_addr learned my addr 172.21.15.193:0/1433520094 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a88d4ad0 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb855f24640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb84c025c20 tx=0x7fb84c0504d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 -- 172.21.15.193:0/1433520094 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c024c70 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 -- 172.21.15.193:0/1433520094 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c046040 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5567a88d4d60 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 -- 172.21.15.193:0/1433520094 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb84c025e20 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a88d5710 con 0x5567a88cd020 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 -- 172.21.15.193:0/1433520094 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb84c035020 con 0x5567a88cd020 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb720039a70 0x7fb72003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb727fff640 1 -- 172.21.15.193:0/1433520094 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb84c033020 con 0x5567a88cd020 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb856f26640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb720039a70 0x7fb72003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.578+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a88df8c0 0x5567a88e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e24a0 con 0x5567a88df8c0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a88df8c0 0x5567a88e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb720039a70 0x7fb72003bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb84800f010 tx=0x7fb84801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a88df8c0 0x5567a88e1d50 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 realm 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e28b0 con 0x5567a88df8c0 2024-09-12T17:12:27.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e3180 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e3520 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e39c0 con 0x5567a88df8c0 2024-09-12T17:12:27.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 20 searching for the correct realm 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5567a88e5930 0x5567a88e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb855f24640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5567a88e5930 0x5567a88e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb855f24640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5567a88e5930 0x5567a88e7d20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb855f24640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb84c01c030 0x7fb84c0369e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb84c01c030 0x7fb84c0369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb84c01c030 0x7fb84c0369e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb848019040 0x7fb848019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb848019040 0x7fb848019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.582+0000 7fb856725640 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb848019040 0x7fb848019930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.586+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.590+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88e5930 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb848019040 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x5567a88df8c0 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e83a0 con 0x7fb84c01c030 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e43d0 con 0x5567a88df8c0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e4c70 con 0x5567a88df8c0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e4010 con 0x5567a88df8c0 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 zone default found 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 4 Realm: () 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 zonegroup default 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.594+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e4c70 con 0x7fb848019040 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ea1f0 con 0x5567a88e5930 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ea590 con 0x5567a88e5930 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e9690 con 0x7fb84c01c030 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93903697910400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e92f0 con 0x7fb84c01c030 2024-09-12T17:12:27.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eb450 con 0x5567a88df8c0 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93903697910400] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93903697914240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eb450 con 0x5567a88df8c0 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.598+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ebe10 con 0x5567a88e5930 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93903697914240] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93903697915808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eb3c0 con 0x5567a88e5930 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ecb60 con 0x7fb84c01c030 2024-09-12T17:12:27.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93903697922016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ed400 con 0x7fb84c01c030 2024-09-12T17:12:27.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.602+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eddc0 con 0x5567a88df8c0 2024-09-12T17:12:27.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93903697915808] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93903697922016] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.607 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93903697923920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eddc0 con 0x5567a88df8c0 2024-09-12T17:12:27.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ed370 con 0x7fb848019040 2024-09-12T17:12:27.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.606+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93903697923920] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93903697926416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ee1e0 con 0x7fb848019040 2024-09-12T17:12:27.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eeba0 con 0x7fb848019040 2024-09-12T17:12:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93903697926416] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93903697927952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eeba0 con 0x7fb848019040 2024-09-12T17:12:27.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.610+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ef560 con 0x7fb848019040 2024-09-12T17:12:27.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93903697927952] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93903697932944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eeba0 con 0x7fb848019040 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=0 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=1 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=2 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=3 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=4 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=5 2024-09-12T17:12:27.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=6 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93903697932944] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 20 add_watcher() i=7 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a88f2980 con 0x5567a88df8c0 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.614+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93903697930432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88efe80 con 0x5567a88df8c0 2024-09-12T17:12:27.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93903697930432] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb70cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 5 note: GC not initialized 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb6877fe640 20 reqs_thread_entry: start 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 Filter name: none 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb6857fa640 20 reqs_thread_entry: start 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a8915730 con 0x5567a88df8c0 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:12:27.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5567a8916cb0 con 0x7fb848019040 2024-09-12T17:12:27.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb70cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.618+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93903697930432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a8915050 con 0x5567a88df8c0 2024-09-12T17:12:27.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93903697930432] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93903697910400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ee890 con 0x7fb84c01c030 2024-09-12T17:12:27.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93903697910400] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 20 remove_watcher() i=0 2024-09-12T17:12:27.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 2 removed watcher, disabling cache 2024-09-12T17:12:27.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93903697914240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e9a80 con 0x5567a88df8c0 2024-09-12T17:12:27.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93903697914240] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 20 remove_watcher() i=1 2024-09-12T17:12:27.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.622+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93903697915808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88e9a80 con 0x5567a88e5930 2024-09-12T17:12:27.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb855f24640 1 -- 172.21.15.193:0/1433520094 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93903697915808] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84c00d040 con 0x5567a88e5930 2024-09-12T17:12:27.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb858c1f9c0 20 remove_watcher() i=2 2024-09-12T17:12:27.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93903697922016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eafa0 con 0x7fb84c01c030 2024-09-12T17:12:27.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb856f26640 1 -- 172.21.15.193:0/1433520094 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93903697922016] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb84802f040 con 0x7fb84c01c030 2024-09-12T17:12:27.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb858c1f9c0 20 remove_watcher() i=3 2024-09-12T17:12:27.628 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.626+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93903697923920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ec7e0 con 0x5567a88df8c0 2024-09-12T17:12:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93903697923920] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x5567a88df8c0 2024-09-12T17:12:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb858c1f9c0 20 remove_watcher() i=4 2024-09-12T17:12:27.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93903697926416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88eafa0 con 0x7fb848019040 2024-09-12T17:12:27.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93903697926416] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb858c1f9c0 20 remove_watcher() i=5 2024-09-12T17:12:27.632 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.630+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93903697927952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ecf50 con 0x7fb848019040 2024-09-12T17:12:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93903697927952] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 20 remove_watcher() i=6 2024-09-12T17:12:27.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93903697932944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5567a88ec7e0 con 0x7fb848019040 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93903697932944] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8500c6d80 con 0x7fb848019040 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 20 remove_watcher() i=7 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb848019040 msgr2=0x7fb848019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb848019040 0x7fb848019930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a88df8c0 msgr2=0x5567a88e1d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a88df8c0 0x5567a88e1d50 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb84c01c030 msgr2=0x7fb84c0369e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb84c01c030 0x7fb84c0369e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5567a88e5930 msgr2=0x5567a88e7d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5567a88e5930 0x5567a88e7d20 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb720039a70 msgr2=0x7fb72003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb720039a70 0x7fb72003bf30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb84800f010 tx=0x7fb84801b070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 msgr2=0x5567a88d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb856725640 1 -- 172.21.15.193:0/1433520094 reap_dead start 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb84c025c20 tx=0x7fb84c0504d0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 shutdown_connections 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/1433520094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88cd020 0x5567a88d4570 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 >> 172.21.15.193:0/1433520094 conn(0x5567a88c9450 msgr2=0x5567a88c7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 shutdown_connections 2024-09-12T17:12:27.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/1433520094 wait complete. 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 msgr2=0x7fb73003bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 0x7fb73003bf20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x5567a88b1910 tx=0x7fb848003070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 msgr2=0x5567a88c0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb84c010f90 tx=0x7fb84c00f7a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 shutdown_connections 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb730039a60 0x7fb73003bf20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/173461909 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a88c06a0 0x5567a88c0ac0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 >> 172.21.15.193:0/173461909 conn(0x5567a88b6050 msgr2=0x5567a88b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 shutdown_connections 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/173461909 wait complete. 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 msgr2=0x5567a88b0090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 0x5567a88b0090 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 msgr2=0x7fb73c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb84c001e60 tx=0x7fb84c0013e0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 msgr2=0x5567a88a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb850018cc0 tx=0x7fb850017e30 comp rx=0 tx=0).stop 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 shutdown_connections 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5567a87b7120 0x5567a88b0090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb73c039a70 0x7fb73c03bf30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 --2- 172.21.15.193:0/2018623723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5567a8728230 0x5567a88a8f20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 >> 172.21.15.193:0/2018623723 conn(0x5567a87ae910 msgr2=0x5567a87b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 shutdown_connections 2024-09-12T17:12:27.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.634+0000 7fb858c1f9c0 1 -- 172.21.15.193:0/2018623723 wait complete. 2024-09-12T17:12:27.647 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-12T17:00:00.000000Z","epoch":1726160400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-12T17:12:27.647 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:12:27.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T17:12:27.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-12T17:12:27.647 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-12T17:12:27.727 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.727 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1e24059c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ead110d220 0x55ead119e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1e24059c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ead104d9c0 con 0x55ead110d600 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1e24059c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ead109d6d0 con 0x55ead110d220 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1dff0b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ead110d220 0x55ead119e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1dff0b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ead110d220 0x55ead119e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49924/0 (socket says 172.21.15.193:49924) 2024-09-12T17:12:27.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1dff0b640 1 -- 172.21.15.193:0/173605512 learned_addr learned my addr 172.21.15.193:0/173605512 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1dff0b640 1 -- 172.21.15.193:0/173605512 >> v1:172.21.15.62:6789/0 conn(0x55ead110d600 legacy=0x55ead11a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.726+0000 7fa1dff0b640 1 -- 172.21.15.193:0/173605512 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead1041ca0 con 0x55ead110d220 2024-09-12T17:12:27.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/173605512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead119e050 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800a4e0 tx=0x7fa1c801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c525eec066269e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1def09640 1 -- 172.21.15.193:0/173605512 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80aa540 con 0x55ead110d220 2024-09-12T17:12:27.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1def09640 1 -- 172.21.15.193:0/173605512 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80aa6e0 con 0x55ead110d220 2024-09-12T17:12:27.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1def09640 1 -- 172.21.15.193:0/173605512 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80aaa40 con 0x55ead110d220 2024-09-12T17:12:27.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 -- 172.21.15.193:0/173605512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 msgr2=0x55ead119e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/173605512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead119e050 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800a4e0 tx=0x7fa1c801b090 comp rx=0 tx=0).stop 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 -- 172.21.15.193:0/173605512 shutdown_connections 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/173605512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead119e050 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 -- 172.21.15.193:0/173605512 >> 172.21.15.193:0/173605512 conn(0x55ead1193940 msgr2=0x55ead1195d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 -- 172.21.15.193:0/173605512 shutdown_connections 2024-09-12T17:12:27.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.730+0000 7fa1e24059c0 1 -- 172.21.15.193:0/173605512 wait complete. 2024-09-12T17:12:27.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.742+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.742+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.742+0000 7fa1e24059c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.742+0000 7fa1e24059c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ead10a1680 con 0x55ead110d220 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49926/0 (socket says 172.21.15.193:49926) 2024-09-12T17:12:27.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 -- 172.21.15.193:0/110739506 learned_addr learned my addr 172.21.15.193:0/110739506 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 -- 172.21.15.193:0/110739506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead101cda0 con 0x55ead110d220 2024-09-12T17:12:27.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/110739506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80ac040 tx=0x7fa1c80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59dc8701d30fe0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0cde0b640 1 -- 172.21.15.193:0/110739506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80b9030 con 0x55ead110d220 2024-09-12T17:12:27.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0cde0b640 1 -- 172.21.15.193:0/110739506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80aaa40 con 0x55ead110d220 2024-09-12T17:12:27.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0cde0b640 1 -- 172.21.15.193:0/110739506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80aad20 con 0x55ead110d220 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/110739506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 msgr2=0x55ead12869b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/110739506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80ac040 tx=0x7fa1c80033b0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/110739506 shutdown_connections 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/110739506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead12869b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/110739506 >> 172.21.15.193:0/110739506 conn(0x55ead1193940 msgr2=0x55ead12825f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/110739506 shutdown_connections 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/110739506 wait complete. 2024-09-12T17:12:27.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ead1043a50 con 0x55ead110d220 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49928/0 (socket says 172.21.15.193:49928) 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2912709313 learned_addr learned my addr 172.21.15.193:0/2912709313 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead128e480 con 0x55ead110d220 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8003430 tx=0x7fa1c8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0c7fff640 1 -- 172.21.15.193:0/2912709313 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80b9070 con 0x55ead110d220 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ead128e710 con 0x55ead110d220 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0c7fff640 1 -- 172.21.15.193:0/2912709313 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c80c2070 con 0x55ead110d220 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.746+0000 7fa0c7fff640 1 -- 172.21.15.193:0/2912709313 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c80b5ca0 con 0x55ead110d220 2024-09-12T17:12:27.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ead128f0c0 con 0x55ead110d220 2024-09-12T17:12:27.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa0c7fff640 1 -- 172.21.15.193:0/2912709313 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa1c80b3040 con 0x55ead110d220 2024-09-12T17:12:27.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa0c7fff640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 0x7fa0c803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa0c7fff640 1 -- 172.21.15.193:0/2912709313 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa1c80ba070 con 0x55ead110d220 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 0x7fa0c803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 0x55ead1295090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12955d0 con 0x55ead110d600 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 0x55ead1295090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 0x7fa0c803bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0001e60 tx=0x7fa1d00013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 0x55ead1295090 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 -- 172.21.15.193:0/2912709313 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1d80083f0 con 0x55ead110d600 2024-09-12T17:12:27.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead1295a10 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 -- 172.21.15.193:0/2912709313 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1d80083f0 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead1297310 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 -- 172.21.15.193:0/2912709313 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa1d80083f0 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead1296450 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e070c640 1 -- 172.21.15.193:0/2912709313 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1d80083f0 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.750+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead1296870 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e070c640 1 -- 172.21.15.193:0/2912709313 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa1d80083f0 con 0x55ead110d600 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ead10ae450 con 0x55ead12a5640 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49930/0 (socket says 172.21.15.193:49930) 2024-09-12T17:12:27.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1df70a640 1 -- 172.21.15.193:0/1284582503 learned_addr learned my addr 172.21.15.193:0/1284582503 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1df70a640 1 -- 172.21.15.193:0/1284582503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead12a60a0 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1df70a640 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0010f90 tx=0x7fa1d000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa0c57fa640 1 -- 172.21.15.193:0/1284582503 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d000a040 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ead12a6900 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa0c57fa640 1 -- 172.21.15.193:0/1284582503 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d0017050 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa0c57fa640 1 -- 172.21.15.193:0/1284582503 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d000e7e0 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ead12a6e70 con 0x55ead12a5640 2024-09-12T17:12:27.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.754+0000 7fa0c57fa640 1 -- 172.21.15.193:0/1284582503 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa1d000e9d0 con 0x55ead12a5640 2024-09-12T17:12:27.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa0c57fa640 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 0x7fa0b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa0c57fa640 1 -- 172.21.15.193:0/1284582503 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa1d0052270 con 0x55ead12a5640 2024-09-12T17:12:27.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e070c640 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 0x7fa0b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e070c640 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 0x7fa0b803bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55ead12967f0 tx=0x7fa1d8003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ead1287140 con 0x55ead12b2fd0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49938/0 (socket says 172.21.15.193:49938) 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 -- 172.21.15.193:0/1335625141 learned_addr learned my addr 172.21.15.193:0/1335625141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 -- 172.21.15.193:0/1335625141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead12b39c0 con 0x55ead12b2fd0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 --2- 172.21.15.193:0/1335625141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0050510 tx=0x7fa1d001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4181696ea85d4f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa0beffd640 1 -- 172.21.15.193:0/1335625141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d0024360 con 0x55ead12b2fd0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa0beffd640 1 -- 172.21.15.193:0/1335625141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d001c930 con 0x55ead12b2fd0 2024-09-12T17:12:27.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa0beffd640 1 -- 172.21.15.193:0/1335625141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d000ecc0 con 0x55ead12b2fd0 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1335625141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 msgr2=0x55ead12b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1335625141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0050510 tx=0x7fa1d001aa60 comp rx=0 tx=0).stop 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1335625141 shutdown_connections 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1335625141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b33d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1335625141 >> 172.21.15.193:0/1335625141 conn(0x55ead12ae3f0 msgr2=0x55ead12ac630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1335625141 shutdown_connections 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1335625141 wait complete. 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 Processor -- start 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- start start 2024-09-12T17:12:27.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1e24059c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ead12b1f20 con 0x55ead12b2fd0 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49940/0 (socket says 172.21.15.193:49940) 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 learned_addr learned my addr 172.21.15.193:0/2708270264 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.758+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ead12b9aa0 con 0x55ead12b2fd0 2024-09-12T17:12:27.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000fcf0 tx=0x7fa1d00504a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 -- 172.21.15.193:0/2708270264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d0024360 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ead12b9d30 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 -- 172.21.15.193:0/2708270264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1d001c410 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 -- 172.21.15.193:0/2708270264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1d001c5c0 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ead12ba6e0 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 -- 172.21.15.193:0/2708270264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fa1d0023760 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0a8039a70 0x7fa0a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa0bd7fa640 1 -- 172.21.15.193:0/2708270264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fa1d003ace0 con 0x55ead12b2fd0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0a8039a70 0x7fa0a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.767 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead12c48e0 0x55ead12c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c74c0 con 0x55ead12c48e0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead12c48e0 0x55ead12c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0a8039a70 0x7fa0a803bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800f010 tx=0x7fa1d801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead12c48e0 0x55ead12c6d70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 realm 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c78d0 con 0x55ead12c48e0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c81a0 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c8540 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c8d90 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.762+0000 7fa1e24059c0 20 searching for the correct realm 2024-09-12T17:12:27.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ead12cab00 0x55ead12ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ead12cab00 0x55ead12ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ead12cab00 0x55ead12ccef0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1df70a640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fa1d001c030 0x7fa1d00338f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fa1d001c030 0x7fa1d00338f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fa1d001c030 0x7fa1d00338f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e070c640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fa1d8019040 0x7fa1d8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fa1d8019040 0x7fa1d8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fa1d8019040 0x7fa1d8019930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.766+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.776 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.770+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.783 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12cab00 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.774+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d8019040 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x55ead12c48e0 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cd430 con 0x7fa1d001c030 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c96e0 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c9f80 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c9320 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 zone default found 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 4 Realm: () 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 zonegroup default 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12c9fa0 con 0x7fa1d8019040 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cf710 con 0x55ead12cab00 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.786 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cfab0 con 0x55ead12cab00 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.778+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12ceba0 con 0x7fa1d001c030 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94467020091328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12ce800 con 0x7fa1d001c030 2024-09-12T17:12:27.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d0990 con 0x55ead12c48e0 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94467020091328] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94467020095168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d0990 con 0x55ead12c48e0 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.782+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d1350 con 0x55ead12cab00 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94467020095168] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94467020096736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d0900 con 0x55ead12cab00 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d2050 con 0x7fa1d001c030 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94467020102832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d2920 con 0x7fa1d001c030 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d3320 con 0x55ead12c48e0 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94467020102832] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94467020096736] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94467020101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d2470 con 0x55ead12c48e0 2024-09-12T17:12:27.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.786+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d3bc0 con 0x7fa1d8019040 2024-09-12T17:12:27.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.790+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94467020101360] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.790+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.790+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94467020107312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d2470 con 0x7fa1d8019040 2024-09-12T17:12:27.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.790+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d3fe0 con 0x7fa1d8019040 2024-09-12T17:12:27.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94467020107312] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94467020109072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d3fe0 con 0x7fa1d8019040 2024-09-12T17:12:27.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d4a00 con 0x7fa1d8019040 2024-09-12T17:12:27.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94467020113136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d4e70 con 0x7fa1d8019040 2024-09-12T17:12:27.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=0 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=1 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=2 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=3 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=4 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=5 2024-09-12T17:12:27.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94467020109072] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.794+0000 7fa1e24059c0 20 add_watcher() i=6 2024-09-12T17:12:27.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94467020113136] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 add_watcher() i=7 2024-09-12T17:12:27.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d3b30 con 0x55ead12c48e0 2024-09-12T17:12:27.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.799 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94467020110640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d5380 con 0x55ead12c48e0 2024-09-12T17:12:27.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94467020110640] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa0967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 5 note: GC not initialized 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa0957e2640 20 reqs_thread_entry: start 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 Filter name: none 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa08e7fc640 20 reqs_thread_entry: start 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12fb1c0 con 0x7fa1d8019040 2024-09-12T17:12:27.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f9860 con 0x55ead12c48e0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T17:12:27.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.798+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12fa130 con 0x7fa1d8019040 2024-09-12T17:12:27.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1e24059c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1e24059c0 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1e24059c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94467020266624 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12fec60 con 0x7fa1d8019040 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== watch-notify(notify (1) cookie 94467020113136 notify 146028888078 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ead12fa4d0 con 0x7fa1d8019040 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa0beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94467020113136 notifier 4727 bl.length()=556 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa0beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa0beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa0beffd640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa0a4003eb0 con 0x7fa1d8019040 2024-09-12T17:12:27.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(65 notify.7 [notify cookie 94467020266624 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== watch-notify(notify_complete (2) cookie 94467020266624 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ead12fab10 con 0x7fa1d8019040 2024-09-12T17:12:27.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.802+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12fa0c0 con 0x55ead12c48e0 2024-09-12T17:12:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1e24059c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:12:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1e24059c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:12:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1e24059c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:12:27.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94467020267008 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ead12fec60 con 0x7fa1d8019040 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== watch-notify(notify (1) cookie 94467020107312 notify 146028888079 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ead12fab10 con 0x7fa1d8019040 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa0be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94467020107312 notifier 4727 bl.length()=177 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa0be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa0be7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa0be7fc640 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa008003410 con 0x7fa1d8019040 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(68 notify.5 [notify cookie 94467020267008 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== watch-notify(notify_complete (2) cookie 94467020267008 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ead128f0c0 con 0x7fa1d8019040 2024-09-12T17:12:27.809 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T17:12:27.802330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:12:27.802318Z","tags":[],"group_ids":[]} 2024-09-12T17:12:27.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa0967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.806+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94467020110640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f8f10 con 0x55ead12c48e0 2024-09-12T17:12:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94467020110640] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94467020091328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f8f10 con 0x7fa1d001c030 2024-09-12T17:12:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94467020091328] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 20 remove_watcher() i=0 2024-09-12T17:12:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 2 removed watcher, disabling cache 2024-09-12T17:12:27.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94467020095168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f8f10 con 0x55ead12c48e0 2024-09-12T17:12:27.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94467020095168] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 20 remove_watcher() i=1 2024-09-12T17:12:27.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.810+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94467020096736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12cfec0 con 0x55ead12cab00 2024-09-12T17:12:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1df70a640 1 -- 172.21.15.193:0/2708270264 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94467020096736] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d0036020 con 0x55ead12cab00 2024-09-12T17:12:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1e24059c0 20 remove_watcher() i=2 2024-09-12T17:12:27.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94467020102832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f8f10 con 0x7fa1d001c030 2024-09-12T17:12:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1e070c640 1 -- 172.21.15.193:0/2708270264 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94467020102832] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1d802f040 con 0x7fa1d001c030 2024-09-12T17:12:27.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1e24059c0 20 remove_watcher() i=3 2024-09-12T17:12:27.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.814+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94467020101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d04e0 con 0x55ead12c48e0 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94467020101360] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x55ead12c48e0 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1e24059c0 20 remove_watcher() i=4 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94467020107312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12f8f10 con 0x7fa1d8019040 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94467020107312] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1e24059c0 20 remove_watcher() i=5 2024-09-12T17:12:27.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.818+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94467020109072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d16f0 con 0x7fa1d8019040 2024-09-12T17:12:27.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94467020109072] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 20 remove_watcher() i=6 2024-09-12T17:12:27.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94467020113136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ead12d16f0 con 0x7fa1d8019040 2024-09-12T17:12:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94467020113136] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1c80beca0 con 0x7fa1d8019040 2024-09-12T17:12:27.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 20 remove_watcher() i=7 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fa1d8019040 msgr2=0x7fa1d8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fa1d8019040 0x7fa1d8019930 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead12c48e0 msgr2=0x55ead12c6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead12c48e0 0x55ead12c6d70 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fa1d001c030 msgr2=0x7fa1d00338f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fa1d001c030 0x7fa1d00338f0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ead12cab00 msgr2=0x55ead12ccef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ead12cab00 0x55ead12ccef0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0a8039a70 msgr2=0x7fa0a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0a8039a70 0x7fa0a803bf30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa1d800f010 tx=0x7fa1d801b070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 msgr2=0x55ead12b9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1dff0b640 1 -- 172.21.15.193:0/2708270264 reap_dead start 2024-09-12T17:12:27.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000fcf0 tx=0x7fa1d00504a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 shutdown_connections 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2708270264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12b2fd0 0x55ead12b9540 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 >> 172.21.15.193:0/2708270264 conn(0x55ead12ae3f0 msgr2=0x55ead12ac600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 shutdown_connections 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2708270264 wait complete. 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 msgr2=0x7fa0b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 0x7fa0b803bf30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55ead12967f0 tx=0x7fa1d8003070 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 msgr2=0x55ead12a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0010f90 tx=0x7fa1d000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 shutdown_connections 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0b8039a70 0x7fa0b803bf30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/1284582503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead12a5640 0x55ead12a5a60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 >> 172.21.15.193:0/1284582503 conn(0x55ead129aff0 msgr2=0x55ead129b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 shutdown_connections 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/1284582503 wait complete. 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 msgr2=0x55ead1295090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.822+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 0x55ead1295090 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 msgr2=0x7fa0c803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 0x7fa0c803bf30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0001e60 tx=0x7fa1d00013e0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 msgr2=0x55ead128df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8003430 tx=0x7fa1c8017e30 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 shutdown_connections 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ead110d600 0x55ead1295090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fa0c8039a70 0x7fa0c803bf30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 --2- 172.21.15.193:0/2912709313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ead110d220 0x55ead128df20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 >> 172.21.15.193:0/2912709313 conn(0x55ead1193940 msgr2=0x55ead1281080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 shutdown_connections 2024-09-12T17:12:27.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.826+0000 7fa1e24059c0 1 -- 172.21.15.193:0/2912709313 wait complete. 2024-09-12T17:12:27.835 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T17:12:27.802330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:12:27.802318Z', 'tags': [], 'group_ids': []} 2024-09-12T17:12:27.851 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:12:27.858 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-12T17:12:27.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T17:12:27.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-12T17:12:27.859 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-12T17:12:27.909 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:27.909 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:27.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb46b939c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e417ecd340 0x55e417ecf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb46b939c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e417d7b9c0 con 0x55e417ec91f0 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb46b939c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e417dcb6d0 con 0x55e417ecd340 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e417ecd340 0x55e417ecf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e417ecd340 0x55e417ecf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49956/0 (socket says 172.21.15.193:49956) 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb44699640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e417ec91f0 0x55e417ec95d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:39098/0 (socket says 172.21.15.193:39098) 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 -- 172.21.15.193:0/249805540 learned_addr learned my addr 172.21.15.193:0/249805540 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 -- 172.21.15.193:0/249805540 >> v1:172.21.15.62:6789/0 conn(0x55e417ec91f0 legacy=0x55e417ec95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 -- 172.21.15.193:0/249805540 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417d6fca0 con 0x55e417ecd340 2024-09-12T17:12:27.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43e98640 1 --2- 172.21.15.193:0/249805540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ecd340 0x55e417ecf730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400a5c0 tx=0x7fbb3401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6438d0cf0b47f7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.910+0000 7fbb43697640 1 -- 172.21.15.193:0/249805540 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340a9590 con 0x55e417ecd340 2024-09-12T17:12:27.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb43697640 1 -- 172.21.15.193:0/249805540 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340ae070 con 0x55e417ecd340 2024-09-12T17:12:27.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb43697640 1 -- 172.21.15.193:0/249805540 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340a9880 con 0x55e417ecd340 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 -- 172.21.15.193:0/249805540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ecd340 msgr2=0x55e417ecf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/249805540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ecd340 0x55e417ecf730 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400a5c0 tx=0x7fbb3401b3d0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 -- 172.21.15.193:0/249805540 shutdown_connections 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/249805540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ecd340 0x55e417ecf730 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 -- 172.21.15.193:0/249805540 >> 172.21.15.193:0/249805540 conn(0x55e417e3cb00 msgr2=0x55e417e3cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 -- 172.21.15.193:0/249805540 shutdown_connections 2024-09-12T17:12:27.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.914+0000 7fbb46b939c0 1 -- 172.21.15.193:0/249805540 wait complete. 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e417dcf680 con 0x55e417ec91f0 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb44699640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb44699640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49970/0 (socket says 172.21.15.193:49970) 2024-09-12T17:12:27.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb44699640 1 -- 172.21.15.193:0/4207628608 learned_addr learned my addr 172.21.15.193:0/4207628608 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb44699640 1 -- 172.21.15.193:0/4207628608 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417d4ada0 con 0x55e417ec91f0 2024-09-12T17:12:27.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb44699640 1 --2- 172.21.15.193:0/4207628608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c001680 tx=0x7fbb3c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb1192181110b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fba3260c640 1 -- 172.21.15.193:0/4207628608 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c013420 con 0x55e417ec91f0 2024-09-12T17:12:27.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fba3260c640 1 -- 172.21.15.193:0/4207628608 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c0135c0 con 0x55e417ec91f0 2024-09-12T17:12:27.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fba3260c640 1 -- 172.21.15.193:0/4207628608 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c0138e0 con 0x55e417ec91f0 2024-09-12T17:12:27.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4207628608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 msgr2=0x55e417fb4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4207628608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c001680 tx=0x7fbb3c001b40 comp rx=0 tx=0).stop 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4207628608 shutdown_connections 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4207628608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fb4890 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4207628608 >> 172.21.15.193:0/4207628608 conn(0x55e417e3cb00 msgr2=0x55e417fb04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4207628608 shutdown_connections 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.926+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4207628608 wait complete. 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e417d71a50 con 0x55e417ec91f0 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44699640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44699640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49972/0 (socket says 172.21.15.193:49972) 2024-09-12T17:12:27.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44699640 1 -- 172.21.15.193:0/3679113273 learned_addr learned my addr 172.21.15.193:0/3679113273 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44699640 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417fbc4c0 con 0x55e417ec91f0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44699640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55e417fb5820 tx=0x7fbb3c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 -- 172.21.15.193:0/3679113273 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c0037a0 con 0x55e417ec91f0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e417fbc750 con 0x55e417ec91f0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 -- 172.21.15.193:0/3679113273 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c023070 con 0x55e417ec91f0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 -- 172.21.15.193:0/3679113273 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb3c003ad0 con 0x55e417ec91f0 2024-09-12T17:12:27.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e417fbd100 con 0x55e417ec91f0 2024-09-12T17:12:27.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 -- 172.21.15.193:0/3679113273 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbb3c010070 con 0x55e417ec91f0 2024-09-12T17:12:27.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 0x7fba2c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fba30e09640 1 -- 172.21.15.193:0/3679113273 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb3c050360 con 0x55e417ec91f0 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb43e98640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 0x7fba2c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 0x55e417fc30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417fc3610 con 0x55e417ecd340 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.930+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 0x55e417fc30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 0x7fba2c03bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb340ad000 tx=0x7fbb340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 0x55e417fc30d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 -- 172.21.15.193:0/3679113273 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb2c0083f0 con 0x55e417ecd340 2024-09-12T17:12:27.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417fc3a60 con 0x55e417ecd340 2024-09-12T17:12:27.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 -- 172.21.15.193:0/3679113273 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb2c0083f0 con 0x55e417ecd340 2024-09-12T17:12:27.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417fc5360 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 -- 172.21.15.193:0/3679113273 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb2c0083f0 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417fc4590 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 -- 172.21.15.193:0/3679113273 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb2c0083f0 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417fc49b0 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb44e9a640 1 -- 172.21.15.193:0/3679113273 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb2c0083f0 con 0x55e417ecd340 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb46b939c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e417ddc450 con 0x55e417fd36c0 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49988/0 (socket says 172.21.15.193:49988) 2024-09-12T17:12:27.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 -- 172.21.15.193:0/2082896739 learned_addr learned my addr 172.21.15.193:0/2082896739 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 -- 172.21.15.193:0/2082896739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417fd4120 con 0x55e417fd36c0 2024-09-12T17:12:27.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.934+0000 7fbb43e98640 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbb34017fe0 tx=0x7fbb34018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 -- 172.21.15.193:0/2082896739 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340b3ba0 con 0x55e417fd36c0 2024-09-12T17:12:27.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e417fd4980 con 0x55e417fd36c0 2024-09-12T17:12:27.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 -- 172.21.15.193:0/2082896739 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340b3d40 con 0x55e417fd36c0 2024-09-12T17:12:27.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 -- 172.21.15.193:0/2082896739 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340c8580 con 0x55e417fd36c0 2024-09-12T17:12:27.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e417fd4e90 con 0x55e417fd36c0 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 -- 172.21.15.193:0/2082896739 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbb340d1440 con 0x55e417fd36c0 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 0x7fba1c03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba29ffb640 1 -- 172.21.15.193:0/2082896739 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb340edd20 con 0x55e417fd36c0 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 0x7fba1c03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 0x7fba1c03bf20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55e417fc4930 tx=0x7fbb2c003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb46b939c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e417fb50e0 con 0x55e417fdff00 2024-09-12T17:12:27.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:49996/0 (socket says 172.21.15.193:49996) 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb43e98640 1 -- 172.21.15.193:0/80417036 learned_addr learned my addr 172.21.15.193:0/80417036 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb43e98640 1 -- 172.21.15.193:0/80417036 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417fe08b0 con 0x55e417fdff00 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fbb43e98640 1 --2- 172.21.15.193:0/80417036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c73d0 tx=0x7fbb340c74c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8526327b08e1dcad server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba237fe640 1 -- 172.21.15.193:0/80417036 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340be410 con 0x55e417fdff00 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba237fe640 1 -- 172.21.15.193:0/80417036 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340bc3b0 con 0x55e417fdff00 2024-09-12T17:12:27.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.938+0000 7fba237fe640 1 -- 172.21.15.193:0/80417036 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340be5b0 con 0x55e417fdff00 2024-09-12T17:12:27.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/80417036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 msgr2=0x55e417fe02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:27.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/80417036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c73d0 tx=0x7fbb340c74c0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/80417036 shutdown_connections 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/80417036 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe02e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/80417036 >> 172.21.15.193:0/80417036 conn(0x55e417fdc330 msgr2=0x55e417fda570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/80417036 shutdown_connections 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/80417036 wait complete. 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 Processor -- start 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- start start 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e417fe0f10 con 0x55e417fdff00 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb43e98640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50006/0 (socket says 172.21.15.193:50006) 2024-09-12T17:12:27.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 learned_addr learned my addr 172.21.15.193:0/4001014700 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:27.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e417fe7990 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb43e98640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c7540 tx=0x7fbb340ec010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 -- 172.21.15.193:0/4001014700 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340bc950 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e417fe7c20 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 -- 172.21.15.193:0/4001014700 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb340bda50 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e417fe85d0 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 -- 172.21.15.193:0/4001014700 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb340bdc00 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 -- 172.21.15.193:0/4001014700 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fbb340d8020 con 0x55e417fdff00 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba14039a70 0x7fba1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.942+0000 7fba21ffb640 1 -- 172.21.15.193:0/4001014700 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fbb340dc0c0 con 0x55e417fdff00 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba14039a70 0x7fba1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ff2770 0x55e417ff4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff5350 con 0x55e417ff2770 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ff2770 0x55e417ff4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba14039a70 0x7fba1403bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00f010 tx=0x7fbb2c01b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ff2770 0x55e417ff4c00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 realm 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff5760 con 0x55e417ff2770 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff6030 con 0x55e417ff2770 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff63d0 con 0x55e417ff2770 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff6c20 con 0x55e417ff2770 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 20 searching for the correct realm 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e417ff8990 0x55e417ffad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffb2c0 con 0x55e417ff8990 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb43e98640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e417ff8990 0x55e417ffad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb43e98640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e417ff8990 0x55e417ffad80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb43e98640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbb34009040 0x7fbb340bd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffb2c0 con 0x7fbb34009040 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbb34009040 0x7fbb340bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbb34009040 0x7fbb340bd390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbb2c019040 0x7fbb2c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffb2c0 con 0x7fbb2c019040 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.946+0000 7fbb44699640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbb2c019040 0x7fbb2c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbb2c019040 0x7fbb2c019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb34009040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.950+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb34009040 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb34009040 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff2770 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.954+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb34009040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x55e417ff8990 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c033040 con 0x7fbb2c019040 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c05c040 con 0x55e417ff2770 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbb3c05c040 con 0x7fbb34009040 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff7470 con 0x55e417ff2770 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff7860 con 0x55e417ff2770 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:27.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff7860 con 0x55e417ff2770 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 zone default found 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 4 Realm: () 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 zonegroup default 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.958+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ff7d30 con 0x7fbb2c019040 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffd0e0 con 0x55e417ff8990 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffd480 con 0x55e417ff8990 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 started sync module instance, tier type = 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffc580 con 0x7fbb34009040 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94438143543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffdcd0 con 0x7fbb34009040 2024-09-12T17:12:27.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffe520 con 0x55e417ff2770 2024-09-12T17:12:27.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.962+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94438143543712] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94438143547424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffe0f0 con 0x55e417ff2770 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffeb10 con 0x55e417ff8990 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94438143550976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417fff3e0 con 0x55e417ff8990 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417fffde0 con 0x7fbb34009040 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94438143547424] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94438143548480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180001d0 con 0x7fbb34009040 2024-09-12T17:12:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.966+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418000b90 con 0x55e417ff2770 2024-09-12T17:12:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94438143550976] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94438143548480] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94438143555824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180006e0 con 0x55e417ff2770 2024-09-12T17:12:27.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418000f70 con 0x7fbb2c019040 2024-09-12T17:12:27.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94438143555824] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94438143553328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418000b90 con 0x7fbb2c019040 2024-09-12T17:12:27.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.970+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418001980 con 0x7fbb2c019040 2024-09-12T17:12:27.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.974+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94438143553328] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.974+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.974+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94438143559664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418001980 con 0x7fbb2c019040 2024-09-12T17:12:27.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.974+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418002340 con 0x7fbb2c019040 2024-09-12T17:12:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94438143559664] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94438143563232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418002340 con 0x7fbb2c019040 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=0 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=1 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=2 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=3 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=4 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=5 2024-09-12T17:12:27.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=6 2024-09-12T17:12:27.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94438143563232] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 20 add_watcher() i=7 2024-09-12T17:12:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e418005640 con 0x55e417ff2770 2024-09-12T17:12:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.978+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94438143565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180028d0 con 0x55e417ff2770 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94438143565824] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fb9fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 5 note: GC not initialized 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fb9f97e2640 20 reqs_thread_entry: start 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 Filter name: none 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fb96affd640 20 reqs_thread_entry: start 2024-09-12T17:12:27.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-12T17:12:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180288a0 con 0x7fbb2c019040 2024-09-12T17:12:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:12:27.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e41802cbb0 con 0x7fbb34009040 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:12:27.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:27.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:12:27.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.982+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94438143735200 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e41802d880 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== watch-notify(notify (1) cookie 94438143553328 notify 146028888080 ret 0) ==== 424+0+0 (crc 0 0 0) 0x7fbb3c057060 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fba237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94438143553328 notifier 4734 bl.length()=382 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fba237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fba237fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fba237fe640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fba08003eb0 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(64 notify.5 [notify cookie 94438143735200 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== watch-notify(notify_complete (2) cookie 94438143735200 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e417fbd100 con 0x7fbb2c019040 2024-09-12T17:12:27.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e41802d760 con 0x55e417ff2770 2024-09-12T17:12:27.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 : miss 2024-09-12T17:12:27.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:27.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:67 8.1 8:87de47dc:root::.bucket.meta.myfoo6%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e41802ae50 con 0x7fbb2c019040 2024-09-12T17:12:27.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(67 .bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 2024-09-12T17:12:27.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.986+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:68 8.1 8:87de47dc:root::.bucket.meta.myfoo6%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418034d20 con 0x7fbb2c019040 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(68 .bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9, ofs0, ns] 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [notify cookie 94438143734992 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e418031190 con 0x55e417ff2770 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== watch-notify(notify (1) cookie 94438143555824 notify 146028888104 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55e41802b240 con 0x55e417ff2770 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fba22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888104 cookie 94438143555824 notifier 4734 bl.length()=756 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fba22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fba22ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fba22ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:12:27.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(69 notify.4 [notify cookie 94438143734992 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fba22ffd640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb978003540 con 0x55e417ff2770 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(70 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify_complete (2) cookie 94438143734992 notify 146028888104 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e41802a590 con 0x55e417ff2770 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): orig_sources= new_sources= 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): potential sources added=[] removed=[] 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): orig_dests= new_dests= 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): potential dests added=[] removed=[] 2024-09-12T17:12:27.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e41802b4d0 con 0x55e417ff2770 2024-09-12T17:12:27.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.990+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e41802fcd0 con 0x55e417ff2770 2024-09-12T17:12:27.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418030ce0 con 0x55e417ff2770 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94438143734992 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e418031190 con 0x7fbb34009040 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== watch-notify(notify (1) cookie 94438143548480 notify 146028888081 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fbb2c026900 con 0x7fbb34009040 2024-09-12T17:12:27.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fba237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94438143548480 notifier 4734 bl.length()=316 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fba237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fba237fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(74 notify.3 [notify cookie 94438143734992 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fba237fe640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fba08003eb0 con 0x7fbb34009040 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== watch-notify(notify_complete (2) cookie 94438143734992 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbb2c026ba0 con 0x7fbb34009040 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 : hit (requested=0x17, cached=0x17) 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 2024-09-12T17:12:27.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.994+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 8.1 8:87de47dc:root::.bucket.meta.myfoo6%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418034700 con 0x7fbb2c019040 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(76 .bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v34'7 uv7 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9, ofs0, ns] 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 94438143749312 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e418031810 con 0x55e417ff2770 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== watch-notify(notify (1) cookie 94438143555824 notify 146028888105 ret 0) ==== 798+0+0 (crc 0 0 0) 0x55e41802ba10 con 0x55e417ff2770 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fba237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888105 cookie 94438143555824 notifier 4734 bl.length()=756 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fba237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:28.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fba237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fba237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(77 notify.4 [notify cookie 94438143749312 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fba237fe640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fba08003eb0 con 0x55e417ff2770 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== watch-notify(notify_complete (2) cookie 94438143749312 notify 146028888105 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e41802a590 con 0x55e417ff2770 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): orig_sources= new_sources= 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): potential sources added=[] removed=[] 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): orig_dests= new_dests= 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 20 handle_bi_update(): bucket=:myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]): potential dests added=[] removed=[] 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:79 4.1a 4:5b70d9b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aaac0 con 0x7fbb34009040 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(79 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:80 4.1f 4:fbbbcb00:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aaac0 con 0x55e417ff8990 2024-09-12T17:12:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(80 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:81 4.19 4:98fa104b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x7fbb34009040 2024-09-12T17:12:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(81 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:27.998+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:82 4.4 4:23748be6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x7fbb2c019040 2024-09-12T17:12:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(82 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:83 4.10 4:0ae012b3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(83 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 4.6 4:6115323f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(84 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:85 4.1a 4:598b9631:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x7fbb34009040 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(85 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 4.6 4:62ee59c6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(86 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 4.1f 4:f98b8f36:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(87 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:88 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(88 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [call out=382b] v0'0 uv5 ondisk = 0) ==== 194+0+382 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:89 4.4 4:217f794e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x7fbb2c019040 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(89 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 get_obj_state: octx=0x7fbb3c04e880 obj=myfoo6:thirteen state=0x55e41802e3a8 s->prefetch_data=0 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:90 3.ds0 3:b0ed643d:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e4180aae60 con 0x55e417ff8990 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(90 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 10 manifest: total_size = 8 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.12658116139090212096 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.acl 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-12T17:12:28.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.etag 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 get_obj_state: octx=0x7fbb3c04e880 obj=myfoo6:thirteen state=0x55e41802e3a8 s->prefetch_data=0 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 : hit (requested=0x17, cached=0x17) 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 2024-09-12T17:12:28.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.002+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418037510 con 0x55e417ff8990 2024-09-12T17:12:28.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.006+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(91 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.006+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:92 3.ds0 3:b0ed643d:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418035970 con 0x55e417ff8990 2024-09-12T17:12:28.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(92 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:93 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180358f0 con 0x55e417ff8990 2024-09-12T17:12:28.011 INFO:teuthology.orchestra.run.smithi193.stderr:1 objects processed in :myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9]). Next marker thirteen 2024-09-12T17:12:28.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180358f0 con 0x7fbb34009040 2024-09-12T17:12:28.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(93 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fba237fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T17:12:28.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:12:28.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:28.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:12:28.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94438143777008 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e41802dcb0 con 0x7fbb2c019040 2024-09-12T17:12:28.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== watch-notify(notify (1) cookie 94438143553328 notify 146028888081 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55e41802a590 con 0x7fbb2c019040 2024-09-12T17:12:28.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fba22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94438143553328 notifier 4734 bl.length()=556 2024-09-12T17:12:28.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fba22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-12T17:12:28.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fba22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:28.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.010+0000 7fba22ffd640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb9780035a0 con 0x7fbb2c019040 2024-09-12T17:12:28.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(95 notify.5 [notify cookie 94438143777008 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== watch-notify(notify_complete (2) cookie 94438143777008 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e417fbd100 con 0x7fbb2c019040 2024-09-12T17:12:28.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180358f0 con 0x55e417ff2770 2024-09-12T17:12:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:12:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:12:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:12:28.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94438143777008 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e41802d290 con 0x7fbb2c019040 2024-09-12T17:12:28.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== watch-notify(notify (1) cookie 94438143553328 notify 146028888082 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e417fbd100 con 0x7fbb2c019040 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fba237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94438143553328 notifier 4734 bl.length()=177 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fba237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fba237fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fba237fe640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fba08003eb0 con 0x7fbb2c019040 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(98 notify.5 [notify cookie 94438143777008 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== watch-notify(notify_complete (2) cookie 94438143777008 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e417fbc750 con 0x7fbb2c019040 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 10 removing user index: bar 2024-09-12T17:12:28.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.014+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e4180358f0 con 0x7fbb2c019040 2024-09-12T17:12:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(100 bar [delete] v34'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb46b939c0 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-12T17:12:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb46b939c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-12T17:12:28.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94438143777008 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e418035f90 con 0x7fbb2c019040 2024-09-12T17:12:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== watch-notify(notify (1) cookie 94438143563232 notify 146028888083 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e417fbc750 con 0x7fbb2c019040 2024-09-12T17:12:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fba22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94438143563232 notifier 4734 bl.length()=152 2024-09-12T17:12:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(101 notify.7 [notify cookie 94438143777008 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.018+0000 7fba22ffd640 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb9780035a0 con 0x7fbb2c019040 2024-09-12T17:12:28.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== watch-notify(notify_complete (2) cookie 94438143777008 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e417fbc4c0 con 0x7fbb2c019040 2024-09-12T17:12:28.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.025 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-12T17:12:27.802330Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:12:27.802318Z","tags":[],"group_ids":[]} 2024-09-12T17:12:28.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fb9fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94438143565824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418026eb0 con 0x55e417ff2770 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94438143565824] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94438143543712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e418002000 con 0x7fbb34009040 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94438143543712] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb46b939c0 20 remove_watcher() i=0 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb46b939c0 2 removed watcher, disabling cache 2024-09-12T17:12:28.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.022+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94438143547424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffc9a0 con 0x55e417ff2770 2024-09-12T17:12:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.026+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94438143547424] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.026+0000 7fbb46b939c0 20 remove_watcher() i=1 2024-09-12T17:12:28.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.026+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94438143550976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffd820 con 0x55e417ff8990 2024-09-12T17:12:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb43e98640 1 -- 172.21.15.193:0/4001014700 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94438143550976] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb340f3020 con 0x55e417ff8990 2024-09-12T17:12:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 20 remove_watcher() i=2 2024-09-12T17:12:28.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94438143548480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffd820 con 0x7fbb34009040 2024-09-12T17:12:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb44e9a640 1 -- 172.21.15.193:0/4001014700 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94438143548480] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb2c02f040 con 0x7fbb34009040 2024-09-12T17:12:28.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 20 remove_watcher() i=3 2024-09-12T17:12:28.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94438143555824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffe600 con 0x55e417ff2770 2024-09-12T17:12:28.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94438143555824] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x55e417ff2770 2024-09-12T17:12:28.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 20 remove_watcher() i=4 2024-09-12T17:12:28.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.030+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94438143553328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffe600 con 0x7fbb2c019040 2024-09-12T17:12:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94438143553328] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb46b939c0 20 remove_watcher() i=5 2024-09-12T17:12:28.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94438143559664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffef30 con 0x7fbb2c019040 2024-09-12T17:12:28.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94438143559664] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb46b939c0 20 remove_watcher() i=6 2024-09-12T17:12:28.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.034+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94438143563232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e417ffe600 con 0x7fbb2c019040 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94438143563232] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb3c00f030 con 0x7fbb2c019040 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 20 remove_watcher() i=7 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbb2c019040 msgr2=0x7fbb2c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fbb2c019040 0x7fbb2c019930 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ff2770 msgr2=0x55e417ff4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ff2770 0x55e417ff4c00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbb34009040 msgr2=0x7fbb340bd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fbb34009040 0x7fbb340bd390 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e417ff8990 msgr2=0x55e417ffad80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e417ff8990 0x55e417ffad80 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba14039a70 msgr2=0x7fba1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba14039a70 0x7fba1403bf30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00f010 tx=0x7fbb2c01b070 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 msgr2=0x55e417fe7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb44699640 1 -- 172.21.15.193:0/4001014700 reap_dead start 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbb340c7540 tx=0x7fbb340ec010 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 shutdown_connections 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/4001014700 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fdff00 0x55e417fe7430 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 >> 172.21.15.193:0/4001014700 conn(0x55e417fdc330 msgr2=0x55e417fda540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:28.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 shutdown_connections 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/4001014700 wait complete. 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 msgr2=0x7fba1c03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 0x7fba1c03bf20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55e417fc4930 tx=0x7fbb2c003070 comp rx=0 tx=0).stop 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 msgr2=0x55e417fd3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fbb34017fe0 tx=0x7fbb34018170 comp rx=0 tx=0).stop 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 shutdown_connections 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba1c039a60 0x7fba1c03bf20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/2082896739 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417fd36c0 0x55e417fd3ae0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 >> 172.21.15.193:0/2082896739 conn(0x55e417fc9070 msgr2=0x55e417fc9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 shutdown_connections 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/2082896739 wait complete. 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 msgr2=0x55e417fc30d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 0x55e417fc30d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 msgr2=0x7fba2c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 0x7fba2c03bf30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbb340ad000 tx=0x7fbb340a6000 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 msgr2=0x55e417fbbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x55e417fb5820 tx=0x7fbb3c000f50 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 shutdown_connections 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e417ecd340 0x55e417fc30d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fba2c039a70 0x7fba2c03bf30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 --2- 172.21.15.193:0/3679113273 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e417ec91f0 0x55e417fbbf60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 >> 172.21.15.193:0/3679113273 conn(0x55e417e3cb00 msgr2=0x55e417faef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 shutdown_connections 2024-09-12T17:12:28.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:28.038+0000 7fbb46b939c0 1 -- 172.21.15.193:0/3679113273 wait complete. 2024-09-12T17:12:28.051 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-12T17:12:27.802330Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:12:27.802318Z', 'tags': [], 'group_ids': []} 2024-09-12T17:12:33.063 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:12:33.064 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:12:33.064 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T17:12:33.064 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-12T17:12:33.064 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-12T17:12:33.113 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:33.113 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.110+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.110+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4ab94b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561421ff3220 0x561421ff3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4ab94b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561421ea59c0 con 0x561421ff6360 2024-09-12T17:12:33.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4ab94b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x561421ef56d0 con 0x561421ff3220 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561421ff3220 0x561421ff3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x561421ff3220 0x561421ff3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50012/0 (socket says 172.21.15.193:50012) 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 -- 172.21.15.193:0/3441236853 learned_addr learned my addr 172.21.15.193:0/3441236853 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a8c50640 1 --1- 172.21.15.193:0/3441236853 >> v1:172.21.15.62:6789/0 conn(0x561421ff6360 0x561421ff8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:39100/0 (socket says 172.21.15.193:39100) 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 -- 172.21.15.193:0/3441236853 >> v1:172.21.15.62:6789/0 conn(0x561421ff6360 legacy=0x561421ff8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 -- 172.21.15.193:0/3441236853 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561421e99ca0 con 0x561421ff3220 2024-09-12T17:12:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.114+0000 7fb4a9451640 1 --2- 172.21.15.193:0/3441236853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x561421ff3600 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00a4e0 tx=0x7fb49c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a0548017983f8f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4a3fff640 1 -- 172.21.15.193:0/3441236853 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0aa540 con 0x561421ff3220 2024-09-12T17:12:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4a3fff640 1 -- 172.21.15.193:0/3441236853 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0aa6e0 con 0x561421ff3220 2024-09-12T17:12:33.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4a3fff640 1 -- 172.21.15.193:0/3441236853 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0aaa40 con 0x561421ff3220 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3441236853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 msgr2=0x561421ff3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3441236853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x561421ff3600 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00a4e0 tx=0x7fb49c01b090 comp rx=0 tx=0).stop 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3441236853 shutdown_connections 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3441236853 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x561421ff3600 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3441236853 >> 172.21.15.193:0/3441236853 conn(0x561421f66b30 msgr2=0x561421f66f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3441236853 shutdown_connections 2024-09-12T17:12:33.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.118+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3441236853 wait complete. 2024-09-12T17:12:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.130+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561421ef9680 con 0x561421ff3220 2024-09-12T17:12:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50022/0 (socket says 172.21.15.193:50022) 2024-09-12T17:12:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 -- 172.21.15.193:0/3707431589 learned_addr learned my addr 172.21.15.193:0/3707431589 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 -- 172.21.15.193:0/3707431589 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561421e74da0 con 0x561421ff3220 2024-09-12T17:12:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 --2- 172.21.15.193:0/3707431589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb49c019740 tx=0x7fb49c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572120b52351734a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb397606640 1 -- 172.21.15.193:0/3707431589 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0b9070 con 0x561421ff3220 2024-09-12T17:12:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb397606640 1 -- 172.21.15.193:0/3707431589 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0aaa90 con 0x561421ff3220 2024-09-12T17:12:33.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb397606640 1 -- 172.21.15.193:0/3707431589 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0aad70 con 0x561421ff3220 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3707431589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 msgr2=0x5614220de910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3707431589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb49c019740 tx=0x7fb49c0033b0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3707431589 shutdown_connections 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3707431589 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff3220 0x5614220de910 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3707431589 >> 172.21.15.193:0/3707431589 conn(0x561421f66b30 msgr2=0x5614220da590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3707431589 shutdown_connections 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3707431589 wait complete. 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4ab94b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561421e9ba50 con 0x561421ff6360 2024-09-12T17:12:33.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50028/0 (socket says 172.21.15.193:50028) 2024-09-12T17:12:33.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.134+0000 7fb4a9451640 1 -- 172.21.15.193:0/2170527147 learned_addr learned my addr 172.21.15.193:0/2170527147 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9451640 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614220e6650 con 0x561421ff6360 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9451640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb49c018cc0 tx=0x7fb49c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 -- 172.21.15.193:0/2170527147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0b9050 con 0x561421ff6360 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 -- 172.21.15.193:0/2170527147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49c0b6a90 con 0x561421ff6360 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614220e68e0 con 0x561421ff6360 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 -- 172.21.15.193:0/2170527147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49c0b6db0 con 0x561421ff6360 2024-09-12T17:12:33.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614220e71f0 con 0x561421ff6360 2024-09-12T17:12:33.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 -- 172.21.15.193:0/2170527147 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb49c0cd060 con 0x561421ff6360 2024-09-12T17:12:33.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 0x7fb39003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb395e03640 1 -- 172.21.15.193:0/2170527147 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb49c0c3070 con 0x561421ff6360 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 0x7fb39003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 0x5614220ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614220edae0 con 0x5614220eb1b0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 0x5614220ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 0x7fb39003bf80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb494001e90 tx=0x7fb4940013f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 0x5614220ed5a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2170527147 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a40083f0 con 0x5614220eb1b0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614220edf30 con 0x5614220eb1b0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.138+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2170527147 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4a40083f0 con 0x5614220eb1b0 2024-09-12T17:12:33.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614220ef830 con 0x5614220eb1b0 2024-09-12T17:12:33.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2170527147 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb4a40083f0 con 0x5614220eb1b0 2024-09-12T17:12:33.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614220eea60 con 0x5614220eb1b0 2024-09-12T17:12:33.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2170527147 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4a40083f0 con 0x5614220eb1b0 2024-09-12T17:12:33.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614220eeeb0 con 0x5614220eb1b0 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2170527147 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4a40083f0 con 0x5614220eb1b0 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x561421f06450 con 0x5614220fdad0 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50030/0 (socket says 172.21.15.193:50030) 2024-09-12T17:12:33.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a8c50640 1 -- 172.21.15.193:0/3620545828 learned_addr learned my addr 172.21.15.193:0/3620545828 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a8c50640 1 -- 172.21.15.193:0/3620545828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614220fe530 con 0x5614220fdad0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb49400e670 tx=0x7fb49400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb38effd640 1 -- 172.21.15.193:0/3620545828 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb494022070 con 0x5614220fdad0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb38effd640 1 -- 172.21.15.193:0/3620545828 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49400d660 con 0x5614220fdad0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5614220fed90 con 0x5614220fdad0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb38effd640 1 -- 172.21.15.193:0/3620545828 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb494006070 con 0x5614220fdad0 2024-09-12T17:12:33.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.142+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614220ff300 con 0x5614220fdad0 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38effd640 1 -- 172.21.15.193:0/3620545828 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb494025070 con 0x5614220fdad0 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38effd640 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 0x7fb38003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38effd640 1 -- 172.21.15.193:0/3620545828 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb494051d60 con 0x5614220fdad0 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 0x7fb38003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5614220df0a0 con 0x56142210a430 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 0x7fb38003bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5614220ee580 tx=0x7fb4a4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50038/0 (socket says 172.21.15.193:50038) 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a8c50640 1 -- 172.21.15.193:0/3909621733 learned_addr learned my addr 172.21.15.193:0/3909621733 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a8c50640 1 -- 172.21.15.193:0/3909621733 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56142210ae00 con 0x56142210a430 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/3909621733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb494050030 tx=0x7fb49400df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f954ee8a88b8368 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38cff9640 1 -- 172.21.15.193:0/3909621733 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49404e030 con 0x56142210a430 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38cff9640 1 -- 172.21.15.193:0/3909621733 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49401a320 con 0x56142210a430 2024-09-12T17:12:33.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb38cff9640 1 -- 172.21.15.193:0/3909621733 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4940268d0 con 0x56142210a430 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3909621733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 msgr2=0x56142210a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3909621733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb494050030 tx=0x7fb49400df30 comp rx=0 tx=0).stop 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3909621733 shutdown_connections 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3909621733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x56142210a810 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3909621733 >> 172.21.15.193:0/3909621733 conn(0x561422106860 msgr2=0x561422104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3909621733 shutdown_connections 2024-09-12T17:12:33.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.146+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3909621733 wait complete. 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 Processor -- start 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 -- start start 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56142210b440 con 0x56142210a430 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a8c50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50046/0 (socket says 172.21.15.193:50046) 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 learned_addr learned my addr 172.21.15.193:0/2007751012 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561422111ef0 con 0x56142210a430 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb49401bfd0 tx=0x7fb49404ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 -- 172.21.15.193:0/2007751012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb494036070 con 0x56142210a430 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561422111ef0 con 0x56142210a430 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 -- 172.21.15.193:0/2007751012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49401a540 con 0x56142210a430 2024-09-12T17:12:33.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 -- 172.21.15.193:0/2007751012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49401a820 con 0x56142210a430 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561422112520 con 0x56142210a430 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 -- 172.21.15.193:0/2007751012 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fb49401a9c0 con 0x56142210a430 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb374039a70 0x7fb37403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb37effd640 1 -- 172.21.15.193:0/2007751012 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fb49403bce0 con 0x56142210a430 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb374039a70 0x7fb37403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56142211c970 0x56142211ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56142211f580 con 0x56142211c970 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.150+0000 7fb4a9451640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56142211c970 0x56142211ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb374039a70 0x7fb37403bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400f010 tx=0x7fb4a401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56142211c970 0x56142211ee30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 realm 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56142211f990 con 0x56142211c970 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422120260 con 0x56142211c970 2024-09-12T17:12:33.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422120600 con 0x56142211c970 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422120e50 con 0x56142211c970 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 20 searching for the correct realm 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561422122bc0 0x561422124fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561422122bc0 0x561422124fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561422122bc0 0x561422124fb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a8c50640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb494027060 0x7fb494033080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb494027060 0x7fb494033080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb494027060 0x7fb494033080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb4a4019040 0x7fb4a4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.154+0000 7fb4a9451640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb4a4019040 0x7fb4a4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb4a4019040 0x7fb4a4019930 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.158+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.162+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x561422122bc0 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.166+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb4a4019040 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x56142211c970 2024-09-12T17:12:33.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5614221254f0 con 0x7fb494027060 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614221217a0 con 0x56142211c970 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422121ff0 con 0x56142211c970 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422121ff0 con 0x56142211c970 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 zone default found 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 4 Realm: () 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:33.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 zonegroup default 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422122010 con 0x7fb4a4019040 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422127860 con 0x561422122bc0 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422127c00 con 0x561422122bc0 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 started sync module instance, tier type = 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.170+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422126cf0 con 0x7fb494027060 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644470968544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422126950 con 0x7fb494027060 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422128a50 con 0x56142211c970 2024-09-12T17:12:33.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644470968544] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644470972560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422128a10 con 0x56142211c970 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.174+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422129460 con 0x561422122bc0 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644470972560] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644470976432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422129850 con 0x561422122bc0 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212a210 con 0x7fb494027060 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644470980208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212a940 con 0x7fb494027060 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.178+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212b460 con 0x56142211c970 2024-09-12T17:12:33.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644470976432] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644470980208] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644470984496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212b420 con 0x56142211c970 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212bd00 con 0x7fb4a4019040 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644470985760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212bcf0 con 0x7fb4a4019040 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212c710 con 0x7fb4a4019040 2024-09-12T17:12:33.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.182+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644470984496] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.186+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644470985760] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.186+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.186+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644470989312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212b840 con 0x7fb4a4019040 2024-09-12T17:12:33.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.186+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212cda0 con 0x7fb4a4019040 2024-09-12T17:12:33.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.186+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644470989312] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644470973616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212cda0 con 0x7fb4a4019040 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=0 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=1 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=2 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=3 2024-09-12T17:12:33.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=4 2024-09-12T17:12:33.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=5 2024-09-12T17:12:33.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=6 2024-09-12T17:12:33.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644470973616] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 20 add_watcher() i=7 2024-09-12T17:12:33.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:33.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56142212ff30 con 0x56142211c970 2024-09-12T17:12:33.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644470991088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212d1c0 con 0x56142211c970 2024-09-12T17:12:33.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.190+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644470991088] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb35f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 5 note: GC not initialized 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb35e7e4640 20 reqs_thread_entry: start 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 Filter name: none 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb2cffff640 20 reqs_thread_entry: start 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5614221532b0 con 0x7fb4a4019040 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422151950 con 0x7fb4a4019040 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-12T17:12:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:12:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:12:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-12T17:12:33.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.194+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422152220 con 0x7fb4a4019040 2024-09-12T17:12:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4ab94b9c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:12:33.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4ab94b9c0 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:12:33.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4ab94b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:12:33.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94644471143792 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422156d50 con 0x7fb4a4019040 2024-09-12T17:12:33.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify (1) cookie 94644470985760 notify 146028888084 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5614221525c0 con 0x7fb4a4019040 2024-09-12T17:12:33.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb38cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94644470985760 notifier 4741 bl.length()=556 2024-09-12T17:12:33.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb38cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb38cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb38cff9640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb36c003eb0 con 0x7fb4a4019040 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(65 notify.5 [notify cookie 94644471143792 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== watch-notify(notify_complete (2) cookie 94644471143792 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561422152c00 con 0x7fb4a4019040 2024-09-12T17:12:33.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.198+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422154880 con 0x7fb4a4019040 2024-09-12T17:12:33.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4ab94b9c0 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:12:33.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4ab94b9c0 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:12:33.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4ab94b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:12:33.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94644471143712 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561422156d50 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 94644470976432 notify 146028888070 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56142210ae00 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb37ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888070 cookie 94644470976432 notifier 4741 bl.length()=177 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb37ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb37ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb37ffff640 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fb2dc003410 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 notify.2 [notify cookie 94644471143712 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== watch-notify(notify_complete (2) cookie 94644471143712 notify 146028888070 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb494044070 con 0x561422122bc0 2024-09-12T17:12:33.205 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-12T17:12:33.197294Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:12:33.197269Z","tags":[],"group_ids":[]} 2024-09-12T17:12:33.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb35f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.202+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644470991088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422151000 con 0x56142211c970 2024-09-12T17:12:33.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94644470991088] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644470968544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422151000 con 0x7fb494027060 2024-09-12T17:12:33.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94644470968544] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4ab94b9c0 20 remove_watcher() i=0 2024-09-12T17:12:33.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4ab94b9c0 2 removed watcher, disabling cache 2024-09-12T17:12:33.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.206+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644470972560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614221270e0 con 0x56142211c970 2024-09-12T17:12:33.210 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94644470972560] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4ab94b9c0 20 remove_watcher() i=1 2024-09-12T17:12:33.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644470976432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422151000 con 0x561422122bc0 2024-09-12T17:12:33.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4a8c50640 1 -- 172.21.15.193:0/2007751012 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94644470976432] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb494024030 con 0x561422122bc0 2024-09-12T17:12:33.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4ab94b9c0 20 remove_watcher() i=2 2024-09-12T17:12:33.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644470980208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422128090 con 0x7fb494027060 2024-09-12T17:12:33.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.210+0000 7fb4a9c52640 1 -- 172.21.15.193:0/2007751012 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94644470980208] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a402f040 con 0x7fb494027060 2024-09-12T17:12:33.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.214+0000 7fb4ab94b9c0 20 remove_watcher() i=3 2024-09-12T17:12:33.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.214+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644470984496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614221270e0 con 0x56142211c970 2024-09-12T17:12:33.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.214+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94644470984496] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x56142211c970 2024-09-12T17:12:33.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.214+0000 7fb4ab94b9c0 20 remove_watcher() i=4 2024-09-12T17:12:33.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.214+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644470985760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561422128090 con 0x7fb4a4019040 2024-09-12T17:12:33.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94644470985760] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4ab94b9c0 20 remove_watcher() i=5 2024-09-12T17:12:33.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644470989312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5614221270e0 con 0x7fb4a4019040 2024-09-12T17:12:33.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94644470989312] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4ab94b9c0 20 remove_watcher() i=6 2024-09-12T17:12:33.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.218+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644470973616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56142212b420 con 0x7fb4a4019040 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94644470973616] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49c0b3d40 con 0x7fb4a4019040 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 20 remove_watcher() i=7 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb4a4019040 msgr2=0x7fb4a4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fb4a4019040 0x7fb4a4019930 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56142211c970 msgr2=0x56142211ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56142211c970 0x56142211ee30 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb494027060 msgr2=0x7fb494033080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fb494027060 0x7fb494033080 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561422122bc0 msgr2=0x561422124fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x561422122bc0 0x561422124fb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb374039a70 msgr2=0x7fb37403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb374039a70 0x7fb37403bf30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400f010 tx=0x7fb4a401b070 comp rx=0 tx=0).stop 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 msgr2=0x561422111990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4a9451640 1 -- 172.21.15.193:0/2007751012 reap_dead start 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb49401bfd0 tx=0x7fb49404ff90 comp rx=0 tx=0).stop 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 shutdown_connections 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2007751012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56142210a430 0x561422111990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 >> 172.21.15.193:0/2007751012 conn(0x561422106860 msgr2=0x561422104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 shutdown_connections 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2007751012 wait complete. 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 msgr2=0x7fb38003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.227 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 0x7fb38003bf80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5614220ee580 tx=0x7fb4a4003070 comp rx=0 tx=0).stop 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 msgr2=0x5614220fdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb49400e670 tx=0x7fb49400ea70 comp rx=0 tx=0).stop 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 shutdown_connections 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb380039ac0 0x7fb38003bf80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/3620545828 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5614220fdad0 0x5614220fdef0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 >> 172.21.15.193:0/3620545828 conn(0x5614220f3480 msgr2=0x5614220f3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 shutdown_connections 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/3620545828 wait complete. 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 msgr2=0x5614220ed5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 0x5614220ed5a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 msgr2=0x7fb39003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 0x7fb39003bf80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb494001e90 tx=0x7fb4940013f0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 msgr2=0x5614220e60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb49c018cc0 tx=0x7fb49c017e30 comp rx=0 tx=0).stop 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 shutdown_connections 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5614220eb1b0 0x5614220ed5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fb390039ac0 0x7fb39003bf80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 --2- 172.21.15.193:0/2170527147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x561421ff6360 0x5614220e60f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 >> 172.21.15.193:0/2170527147 conn(0x561421f66b30 msgr2=0x5614220d9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 shutdown_connections 2024-09-12T17:12:33.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.222+0000 7fb4ab94b9c0 1 -- 172.21.15.193:0/2170527147 wait complete. 2024-09-12T17:12:33.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-12T17:12:33.197294Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:12:33.197269Z', 'tags': [], 'group_ids': []} 2024-09-12T17:12:33.257 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:12:33.266 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-12T17:12:33.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T17:12:33.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-12T17:12:33.267 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-12T17:12:33.300 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:33.300 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548f7449c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b4b8234f90 0x55b4b8235370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548f7449c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4b81729c0 con 0x55b4b82380d0 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548f7449c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b4b81c26d0 con 0x55b4b8234f90 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548d24a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b4b8234f90 0x55b4b8235370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548ca49640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b4b82380d0 0x55b4b82384e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:39108/0 (socket says 172.21.15.193:39108) 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548d24a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b4b8234f90 0x55b4b8235370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50052/0 (socket says 172.21.15.193:50052) 2024-09-12T17:12:33.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.298+0000 7f548ca49640 1 -- 172.21.15.193:0/480466876 learned_addr learned my addr 172.21.15.193:0/480466876 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:12:33.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548d24a640 1 -- 172.21.15.193:0/480466876 >> v1:172.21.15.62:6789/0 conn(0x55b4b82380d0 legacy=0x55b4b82384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548d24a640 1 -- 172.21.15.193:0/480466876 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8166ca0 con 0x55b4b8234f90 2024-09-12T17:12:33.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548d24a640 1 --2- 172.21.15.193:0/480466876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b8235370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f548000a480 tx=0x7f548001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93e91f430c96b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f547ffff640 1 -- 172.21.15.193:0/480466876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800af070 con 0x55b4b8234f90 2024-09-12T17:12:33.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f547ffff640 1 -- 172.21.15.193:0/480466876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800aa530 con 0x55b4b8234f90 2024-09-12T17:12:33.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f547ffff640 1 -- 172.21.15.193:0/480466876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800aa830 con 0x55b4b8234f90 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 -- 172.21.15.193:0/480466876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 msgr2=0x55b4b8235370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 --2- 172.21.15.193:0/480466876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b8235370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f548000a480 tx=0x7f548001b280 comp rx=0 tx=0).stop 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 -- 172.21.15.193:0/480466876 shutdown_connections 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 --2- 172.21.15.193:0/480466876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b8235370 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 -- 172.21.15.193:0/480466876 >> 172.21.15.193:0/480466876 conn(0x55b4b8233b00 msgr2=0x55b4b8233f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 -- 172.21.15.193:0/480466876 shutdown_connections 2024-09-12T17:12:33.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.302+0000 7f548f7449c0 1 -- 172.21.15.193:0/480466876 wait complete. 2024-09-12T17:12:33.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548f7449c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548f7449c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4b81c6680 con 0x55b4b8234f90 2024-09-12T17:12:33.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548d24a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548d24a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50060/0 (socket says 172.21.15.193:50060) 2024-09-12T17:12:33.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.318+0000 7f548d24a640 1 -- 172.21.15.193:0/2336393189 learned_addr learned my addr 172.21.15.193:0/2336393189 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 -- 172.21.15.193:0/2336393189 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b8141da0 con 0x55b4b8234f90 2024-09-12T17:12:33.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 --2- 172.21.15.193:0/2336393189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f54800ad040 tx=0x7f5480003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5168b5821d5ba80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f537b606640 1 -- 172.21.15.193:0/2336393189 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800af040 con 0x55b4b8234f90 2024-09-12T17:12:33.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f537b606640 1 -- 172.21.15.193:0/2336393189 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800aa6e0 con 0x55b4b8234f90 2024-09-12T17:12:33.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f537b606640 1 -- 172.21.15.193:0/2336393189 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800aa9e0 con 0x55b4b8234f90 2024-09-12T17:12:33.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- 172.21.15.193:0/2336393189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 msgr2=0x55b4b83b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2336393189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f54800ad040 tx=0x7f5480003030 comp rx=0 tx=0).stop 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- 172.21.15.193:0/2336393189 shutdown_connections 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2336393189 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b0330 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- 172.21.15.193:0/2336393189 >> 172.21.15.193:0/2336393189 conn(0x55b4b8233b00 msgr2=0x55b4b83abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- 172.21.15.193:0/2336393189 shutdown_connections 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- 172.21.15.193:0/2336393189 wait complete. 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548f7449c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4b8168a50 con 0x55b4b8234f90 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50070/0 (socket says 172.21.15.193:50070) 2024-09-12T17:12:33.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 -- 172.21.15.193:0/2226871008 learned_addr learned my addr 172.21.15.193:0/2226871008 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b83b7ec0 con 0x55b4b8234f90 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.322+0000 7f548d24a640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f548000a480 tx=0x7f5480018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 -- 172.21.15.193:0/2226871008 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800af040 con 0x55b4b8234f90 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 -- 172.21.15.193:0/2226871008 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800b57b0 con 0x55b4b8234f90 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b83b8150 con 0x55b4b8234f90 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 -- 172.21.15.193:0/2226871008 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800b5a90 con 0x55b4b8234f90 2024-09-12T17:12:33.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b83b8b00 con 0x55b4b8234f90 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 -- 172.21.15.193:0/2226871008 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54800b5c30 con 0x55b4b8234f90 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 0x7f537403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f5379e03640 1 -- 172.21.15.193:0/2226871008 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f54800ba070 con 0x55b4b8234f90 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548ca49640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 0x7f537403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 0x55b4b83bead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83bf010 con 0x55b4b82380d0 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548da4b640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 0x55b4b83bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548ca49640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 0x7f537403bf80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5484001d80 tx=0x7f54840012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548da4b640 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 0x55b4b83bead0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548da4b640 1 -- 172.21.15.193:0/2226871008 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f548800a4d0 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83bf3f0 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548da4b640 1 -- 172.21.15.193:0/2226871008 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f548800a4d0 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.326+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83c0cf0 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548da4b640 1 -- 172.21.15.193:0/2226871008 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f548800a4d0 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83bff20 con 0x55b4b82380d0 2024-09-12T17:12:33.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548da4b640 1 -- 172.21.15.193:0/2226871008 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f548800a4d0 con 0x55b4b82380d0 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83c0340 con 0x55b4b82380d0 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548da4b640 1 -- 172.21.15.193:0/2226871008 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f548800a4d0 con 0x55b4b82380d0 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4b81d3450 con 0x55b4b83cf040 2024-09-12T17:12:33.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50074/0 (socket says 172.21.15.193:50074) 2024-09-12T17:12:33.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548ca49640 1 -- 172.21.15.193:0/2571356474 learned_addr learned my addr 172.21.15.193:0/2571356474 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548ca49640 1 -- 172.21.15.193:0/2571356474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b83cfaa0 con 0x55b4b83cf040 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548ca49640 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f548400d660 tx=0x7f548400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f5372ffd640 1 -- 172.21.15.193:0/2571356474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548400c6b0 con 0x55b4b83cf040 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f5372ffd640 1 -- 172.21.15.193:0/2571356474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548400c850 con 0x55b4b83cf040 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b83d0300 con 0x55b4b83cf040 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f5372ffd640 1 -- 172.21.15.193:0/2571356474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548400cb30 con 0x55b4b83cf040 2024-09-12T17:12:33.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.330+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b83d0870 con 0x55b4b83cf040 2024-09-12T17:12:33.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5372ffd640 1 -- 172.21.15.193:0/2571356474 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5484023020 con 0x55b4b83cf040 2024-09-12T17:12:33.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5372ffd640 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 0x7f536403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5372ffd640 1 -- 172.21.15.193:0/2571356474 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5484021020 con 0x55b4b83cf040 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548da4b640 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 0x7f536403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548da4b640 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 0x7f536403bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b4b83c02c0 tx=0x7f5488005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4b83b0ac0 con 0x55b4b83dca10 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50078/0 (socket says 172.21.15.193:50078) 2024-09-12T17:12:33.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548ca49640 1 -- 172.21.15.193:0/3085032215 learned_addr learned my addr 172.21.15.193:0/3085032215 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548ca49640 1 -- 172.21.15.193:0/3085032215 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b83dd400 con 0x55b4b83dca10 2024-09-12T17:12:33.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548ca49640 1 --2- 172.21.15.193:0/3085032215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5484050f10 tx=0x7f5484023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ca8889586da69b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5370ff9640 1 -- 172.21.15.193:0/3085032215 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5484047070 con 0x55b4b83dca10 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5370ff9640 1 -- 172.21.15.193:0/3085032215 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f548400cd20 con 0x55b4b83dca10 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f5370ff9640 1 -- 172.21.15.193:0/3085032215 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f548401bcc0 con 0x55b4b83dca10 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- 172.21.15.193:0/3085032215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 msgr2=0x55b4b83dce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 --2- 172.21.15.193:0/3085032215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5484050f10 tx=0x7f5484023420 comp rx=0 tx=0).stop 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- 172.21.15.193:0/3085032215 shutdown_connections 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 --2- 172.21.15.193:0/3085032215 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83dce10 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- 172.21.15.193:0/3085032215 >> 172.21.15.193:0/3085032215 conn(0x55b4b83d7e30 msgr2=0x55b4b83d6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- 172.21.15.193:0/3085032215 shutdown_connections 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- 172.21.15.193:0/3085032215 wait complete. 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 Processor -- start 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- start start 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.334+0000 7f548f7449c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b4b83db960 con 0x55b4b83dca10 2024-09-12T17:12:33.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548ca49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50086/0 (socket says 172.21.15.193:50086) 2024-09-12T17:12:33.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 learned_addr learned my addr 172.21.15.193:0/517712777 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4b83e34e0 con 0x55b4b83dca10 2024-09-12T17:12:33.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548ca49640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f548404fdb0 tx=0x7f5484050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 -- 172.21.15.193:0/517712777 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5484032030 con 0x55b4b83dca10 2024-09-12T17:12:33.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4b83e3770 con 0x55b4b83dca10 2024-09-12T17:12:33.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 -- 172.21.15.193:0/517712777 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5484048040 con 0x55b4b83dca10 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 -- 172.21.15.193:0/517712777 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5484047070 con 0x55b4b83dca10 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4b83e3770 con 0x55b4b83dca10 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 -- 172.21.15.193:0/517712777 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f5484035030 con 0x55b4b83dca10 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5358039a70 0x7f535803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f5362ffd640 1 -- 172.21.15.193:0/517712777 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f5484033070 con 0x55b4b83dca10 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548da4b640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5358039a70 0x7f535803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b83ee070 0x55b4b83f0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f0c80 con 0x55b4b83ee070 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548d24a640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b83ee070 0x55b4b83f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548da4b640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5358039a70 0x7f535803bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b4b83bfa40 tx=0x7f548801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548d24a640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b83ee070 0x55b4b83f0530 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 20 realm 2024-09-12T17:12:33.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.338+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f1090 con 0x55b4b83ee070 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f1960 con 0x55b4b83ee070 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f1d00 con 0x55b4b83ee070 2024-09-12T17:12:33.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f2550 con 0x55b4b83ee070 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 20 searching for the correct realm 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b4b83f42c0 0x55b4b83f66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548ca49640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b4b83f42c0 0x55b4b83f66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548ca49640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b4b83f42c0 0x55b4b83f66b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548ca49640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f548401a590 0x7f548401aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548da4b640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f548401a590 0x7f548401aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548da4b640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f548401a590 0x7f548401aa10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548da4b640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5488031040 0x7f5488032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5488031040 0x7f5488032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.342+0000 7f548d24a640 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5488031040 0x7f5488032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.346+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.350+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83f42c0 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f5488031040 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.354+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x55b4b83ee070 2024-09-12T17:12:33.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6bf0 con 0x7f548401a590 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548801f070 con 0x7f548401a590 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f2ea0 con 0x55b4b83ee070 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f3740 con 0x55b4b83ee070 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f3740 con 0x55b4b83ee070 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 zone default found 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 4 Realm: () 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:33.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 zonegroup default 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f6f90 con 0x7f5488031040 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f8a80 con 0x55b4b83f42c0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f8ec0 con 0x55b4b83f42c0 2024-09-12T17:12:33.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 started sync module instance, tier type = 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.358+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f7e20 con 0x7f548401a590 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94234673644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f7a80 con 0x7f548401a590 2024-09-12T17:12:33.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9df0 con 0x55b4b83ee070 2024-09-12T17:12:33.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94234673644096] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94234673648416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9df0 con 0x55b4b83ee070 2024-09-12T17:12:33.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.362+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fa800 con 0x55b4b83f42c0 2024-09-12T17:12:33.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94234673648416] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94234673649984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9d60 con 0x55b4b83f42c0 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fb540 con 0x7f548401a590 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94234673655888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fbde0 con 0x7f548401a590 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fc820 con 0x55b4b83ee070 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94234673649984] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.366+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94234673655888] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94234673660656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fb930 con 0x55b4b83ee070 2024-09-12T17:12:33.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fd0c0 con 0x7f5488031040 2024-09-12T17:12:33.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94234673660656] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94234673654688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fb930 con 0x7f5488031040 2024-09-12T17:12:33.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.370+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fd550 con 0x7f5488031040 2024-09-12T17:12:33.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94234673654688] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94234673664064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fd510 con 0x7f5488031040 2024-09-12T17:12:33.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fdf30 con 0x7f5488031040 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94234673664064] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94234673666592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fdef0 con 0x7f5488031040 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=0 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=1 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=2 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=3 2024-09-12T17:12:33.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=4 2024-09-12T17:12:33.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=5 2024-09-12T17:12:33.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.374+0000 7f548f7449c0 20 add_watcher() i=6 2024-09-12T17:12:33.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94234673666592] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 add_watcher() i=7 2024-09-12T17:12:33.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:33.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8401320 con 0x55b4b83ee070 2024-09-12T17:12:33.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94234673662416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83fe870 con 0x55b4b83ee070 2024-09-12T17:12:33.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94234673662416] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f5343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 5 note: GC not initialized 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f5342fe5640 20 reqs_thread_entry: start 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 Filter name: none 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f5340fe1640 20 reqs_thread_entry: start 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.378+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8424570 con 0x7f548401a590 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:33.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b84288d0 con 0x7f5488031040 2024-09-12T17:12:33.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.384 INFO:teuthology.orchestra.run.smithi193.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-12T17:12:33.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f5343fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.382+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94234673662416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8422380 con 0x55b4b83ee070 2024-09-12T17:12:33.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94234673662416] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94234673644096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8422380 con 0x7f548401a590 2024-09-12T17:12:33.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94234673644096] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548f7449c0 20 remove_watcher() i=0 2024-09-12T17:12:33.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548f7449c0 2 removed watcher, disabling cache 2024-09-12T17:12:33.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.386+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94234673648416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8422380 con 0x55b4b83ee070 2024-09-12T17:12:33.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94234673648416] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 20 remove_watcher() i=1 2024-09-12T17:12:33.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94234673649984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b8422380 con 0x55b4b83f42c0 2024-09-12T17:12:33.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548ca49640 1 -- 172.21.15.193:0/517712777 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94234673649984] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54840247a0 con 0x55b4b83f42c0 2024-09-12T17:12:33.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 20 remove_watcher() i=2 2024-09-12T17:12:33.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94234673655888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9940 con 0x7f548401a590 2024-09-12T17:12:33.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548da4b640 1 -- 172.21.15.193:0/517712777 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94234673655888] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5488040040 con 0x7f548401a590 2024-09-12T17:12:33.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 20 remove_watcher() i=3 2024-09-12T17:12:33.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.390+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94234673660656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9940 con 0x55b4b83ee070 2024-09-12T17:12:33.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.394+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94234673660656] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x55b4b83ee070 2024-09-12T17:12:33.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.394+0000 7f548f7449c0 20 remove_watcher() i=4 2024-09-12T17:12:33.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.394+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94234673654688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9940 con 0x7f5488031040 2024-09-12T17:12:33.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.394+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94234673654688] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548f7449c0 20 remove_watcher() i=5 2024-09-12T17:12:33.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94234673664064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83faba0 con 0x7f5488031040 2024-09-12T17:12:33.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94234673664064] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548f7449c0 20 remove_watcher() i=6 2024-09-12T17:12:33.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94234673666592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4b83f9940 con 0x7f5488031040 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94234673666592] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54800ce070 con 0x7f5488031040 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.398+0000 7f548f7449c0 20 remove_watcher() i=7 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5488031040 msgr2=0x7f5488032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f5488031040 0x7f5488032940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b83ee070 msgr2=0x55b4b83f0530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b83ee070 0x55b4b83f0530 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f548401a590 msgr2=0x7f548401aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f548401a590 0x7f548401aa10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b4b83f42c0 msgr2=0x55b4b83f66b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b4b83f42c0 0x55b4b83f66b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5358039a70 msgr2=0x7f535803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5358039a70 0x7f535803bf30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55b4b83bfa40 tx=0x7f548801f000 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 msgr2=0x55b4b83e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548d24a640 1 -- 172.21.15.193:0/517712777 reap_dead start 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f548404fdb0 tx=0x7f5484050e70 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 shutdown_connections 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/517712777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83dca10 0x55b4b83e2f80 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 >> 172.21.15.193:0/517712777 conn(0x55b4b83d7e30 msgr2=0x55b4b83d6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 shutdown_connections 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/517712777 wait complete. 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 msgr2=0x7f536403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 0x7f536403bf30 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55b4b83c02c0 tx=0x7f5488005850 comp rx=0 tx=0).stop 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 msgr2=0x55b4b83cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f548400d660 tx=0x7f548400da60 comp rx=0 tx=0).stop 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 shutdown_connections 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5364039a70 0x7f536403bf30 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2571356474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b83cf040 0x55b4b83cf460 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 >> 172.21.15.193:0/2571356474 conn(0x55b4b83c49f0 msgr2=0x55b4b83c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 shutdown_connections 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2571356474 wait complete. 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 msgr2=0x55b4b83bead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 0x55b4b83bead0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 msgr2=0x7f537403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 0x7f537403bf80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5484001d80 tx=0x7f54840012e0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 msgr2=0x55b4b83b7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f548000a480 tx=0x7f5480018020 comp rx=0 tx=0).stop 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 shutdown_connections 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b4b82380d0 0x55b4b83bead0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f5374039ac0 0x7f537403bf80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 --2- 172.21.15.193:0/2226871008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b4b8234f90 0x55b4b83b7960 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 >> 172.21.15.193:0/2226871008 conn(0x55b4b8233b00 msgr2=0x55b4b83aaa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 shutdown_connections 2024-09-12T17:12:33.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.402+0000 7f548f7449c0 1 -- 172.21.15.193:0/2226871008 wait complete. 2024-09-12T17:12:33.414 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-12T17:12:33.461 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:12:33.461 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:12:33.470 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-12T17:12:33.470 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-12T17:12:33.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T17:12:33.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-12T17:12:33.471 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-12T17:12:33.509 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:33.510 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdcec7749c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55847a159340 0x55847a15b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdcec7749c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55847a0079c0 con 0x55847a1551f0 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdcec7749c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55847a0576d0 con 0x55847a159340 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdce9a79640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55847a159340 0x55847a15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.511 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdce9a79640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55847a159340 0x55847a15b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50102/0 (socket says 172.21.15.193:50102) 2024-09-12T17:12:33.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdce9a79640 1 -- 172.21.15.193:0/1184936993 learned_addr learned my addr 172.21.15.193:0/1184936993 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdce9a79640 1 -- 172.21.15.193:0/1184936993 >> v1:172.21.15.62:6789/0 conn(0x55847a1551f0 legacy=0x55847a1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.510+0000 7fdce9a79640 1 -- 172.21.15.193:0/1184936993 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558479ffbca0 con 0x55847a159340 2024-09-12T17:12:33.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1184936993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a159340 0x55847a15b730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a5c0 tx=0x7fdcd401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9334514c56c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdce9278640 1 -- 172.21.15.193:0/1184936993 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40a9590 con 0x55847a159340 2024-09-12T17:12:33.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdce9278640 1 -- 172.21.15.193:0/1184936993 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40ae070 con 0x55847a159340 2024-09-12T17:12:33.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdce9278640 1 -- 172.21.15.193:0/1184936993 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40a9880 con 0x55847a159340 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1184936993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a159340 msgr2=0x55847a15b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1184936993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a159340 0x55847a15b730 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdcd400a5c0 tx=0x7fdcd401b3d0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1184936993 shutdown_connections 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1184936993 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a159340 0x55847a15b730 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1184936993 >> 172.21.15.193:0/1184936993 conn(0x55847a0c8b00 msgr2=0x55847a0c8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1184936993 shutdown_connections 2024-09-12T17:12:33.517 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.514+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1184936993 wait complete. 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcec7749c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcec7749c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55847a05b680 con 0x55847a1551f0 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcea27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcea27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50116/0 (socket says 172.21.15.193:50116) 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcea27a640 1 -- 172.21.15.193:0/3909548979 learned_addr learned my addr 172.21.15.193:0/3909548979 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcea27a640 1 -- 172.21.15.193:0/3909548979 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558479fd6da0 con 0x55847a1551f0 2024-09-12T17:12:33.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdcea27a640 1 --2- 172.21.15.193:0/3909548979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc001690 tx=0x7fdcdc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c04834e887fd0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdbd8608640 1 -- 172.21.15.193:0/3909548979 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc016070 con 0x55847a1551f0 2024-09-12T17:12:33.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdbd8608640 1 -- 172.21.15.193:0/3909548979 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00f640 con 0x55847a1551f0 2024-09-12T17:12:33.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.530+0000 7fdbd8608640 1 -- 172.21.15.193:0/3909548979 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc00f960 con 0x55847a1551f0 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3909548979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 msgr2=0x55847a240890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/3909548979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc001690 tx=0x7fdcdc001b50 comp rx=0 tx=0).stop 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3909548979 shutdown_connections 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/3909548979 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a240890 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3909548979 >> 172.21.15.193:0/3909548979 conn(0x55847a0c8b00 msgr2=0x55847a23c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3909548979 shutdown_connections 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3909548979 wait complete. 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558479ffda50 con 0x55847a1551f0 2024-09-12T17:12:33.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcea27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcea27a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50124/0 (socket says 172.21.15.193:50124) 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcea27a640 1 -- 172.21.15.193:0/1391015851 learned_addr learned my addr 172.21.15.193:0/1391015851 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcea27a640 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847a2484c0 con 0x55847a1551f0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcea27a640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55847a241820 tx=0x7fdcdc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdbd6e05640 1 -- 172.21.15.193:0/1391015851 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc021020 con 0x55847a1551f0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdbd6e05640 1 -- 172.21.15.193:0/1391015851 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0115f0 con 0x55847a1551f0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55847a248750 con 0x55847a1551f0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdbd6e05640 1 -- 172.21.15.193:0/1391015851 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcdc016040 con 0x55847a1551f0 2024-09-12T17:12:33.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.534+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847a249100 con 0x55847a1551f0 2024-09-12T17:12:33.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdbd6e05640 1 -- 172.21.15.193:0/1391015851 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdcdc024020 con 0x55847a1551f0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdbd6e05640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 0x7fdbd003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdbd6e05640 1 -- 172.21.15.193:0/1391015851 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdcdc04fde0 con 0x55847a1551f0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 0x55847a24f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 0x7fdbd003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a24f610 con 0x55847a159340 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 0x55847a24f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 0x55847a24f0d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 0x7fdbd003bf80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ad000 tx=0x7fdcd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1391015851 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdce40083f0 con 0x55847a159340 2024-09-12T17:12:33.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a24fa40 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1391015851 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdce40083f0 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a251340 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1391015851 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdce40083f0 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a250570 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1391015851 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdce40083f0 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2509c0 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1391015851 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdce40083f0 con 0x55847a159340 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.538+0000 7fdcec7749c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55847a068450 con 0x55847a25f650 2024-09-12T17:12:33.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50140/0 (socket says 172.21.15.193:50140) 2024-09-12T17:12:33.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdce9a79640 1 -- 172.21.15.193:0/1492026165 learned_addr learned my addr 172.21.15.193:0/1492026165 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdce9a79640 1 -- 172.21.15.193:0/1492026165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847a2600b0 con 0x55847a25f650 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ab040 tx=0x7fdcd4018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 -- 172.21.15.193:0/1492026165 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40b3a60 con 0x55847a25f650 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 -- 172.21.15.193:0/1492026165 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40b3c00 con 0x55847a25f650 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55847a260910 con 0x55847a25f650 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 -- 172.21.15.193:0/1492026165 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40c8430 con 0x55847a25f650 2024-09-12T17:12:33.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847a260e20 con 0x55847a25f650 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 -- 172.21.15.193:0/1492026165 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdcd40d1440 con 0x55847a25f650 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 0x7fdbc403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdbcffff640 1 -- 172.21.15.193:0/1492026165 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdcd40edbd0 con 0x55847a25f650 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 0x7fdbc403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 0x7fdbc403bf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55847a250090 tx=0x7fdce4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.542+0000 7fdcec7749c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55847a2410e0 con 0x55847a26be90 2024-09-12T17:12:33.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50152/0 (socket says 172.21.15.193:50152) 2024-09-12T17:12:33.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 -- 172.21.15.193:0/3949238653 learned_addr learned my addr 172.21.15.193:0/3949238653 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 -- 172.21.15.193:0/3949238653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847a26c840 con 0x55847a26be90 2024-09-12T17:12:33.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- 172.21.15.193:0/3949238653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ebf30 tx=0x7fdcd40c7a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9675954ca965f523 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbcdffb640 1 -- 172.21.15.193:0/3949238653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40be540 con 0x55847a26be90 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbcdffb640 1 -- 172.21.15.193:0/3949238653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40bc3b0 con 0x55847a26be90 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbcdffb640 1 -- 172.21.15.193:0/3949238653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40bc740 con 0x55847a26be90 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3949238653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 msgr2=0x55847a26c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/3949238653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ebf30 tx=0x7fdcd40c7a10 comp rx=0 tx=0).stop 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3949238653 shutdown_connections 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/3949238653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a26c270 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3949238653 >> 172.21.15.193:0/3949238653 conn(0x55847a2682c0 msgr2=0x55847a266500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3949238653 shutdown_connections 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/3949238653 wait complete. 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 Processor -- start 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- start start 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55847a26cea0 con 0x55847a26be90 2024-09-12T17:12:33.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50158/0 (socket says 172.21.15.193:50158) 2024-09-12T17:12:33.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 learned_addr learned my addr 172.21.15.193:0/1150851030 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55847a273980 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c7d70 tx=0x7fdcd40ebec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbbbfff640 1 -- 172.21.15.193:0/1150851030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40f2070 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55847a273c10 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbbbfff640 1 -- 172.21.15.193:0/1150851030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40bca80 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55847a2745c0 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.546+0000 7fdbbbfff640 1 -- 172.21.15.193:0/1150851030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcd40bfa20 con 0x55847a26be90 2024-09-12T17:12:33.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdbbbfff640 1 -- 172.21.15.193:0/1150851030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fdcd40f5070 con 0x55847a26be90 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdbbbfff640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbb4039a70 0x7fdbb403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdbbbfff640 1 -- 172.21.15.193:0/1150851030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fdcd40f8d30 con 0x55847a26be90 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbb4039a70 0x7fdbb403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a27e6f0 0x55847a280b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2812d0 con 0x55847a27e6f0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a27e6f0 0x55847a280b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbb4039a70 0x7fdbb403bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdce400f010 tx=0x7fdce401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a27e6f0 0x55847a280b80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 realm 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2816e0 con 0x55847a27e6f0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a281fb0 con 0x55847a27e6f0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a282350 con 0x55847a27e6f0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a282ba0 con 0x55847a27e6f0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 20 searching for the correct realm 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55847a284910 0x55847a286d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.550+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55847a284910 0x55847a286d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55847a284910 0x55847a286d00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdce9a79640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdcd40f7060 0x7fdcd40e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdcd40f7060 0x7fdcd40e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdcd40f7060 0x7fdcd40e4a40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdceaa7b640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdce4019040 0x7fdce4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdce4019040 0x7fdce4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdce4019040 0x7fdce4019930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.554+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.558+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.565 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x7fdce4019040 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc00f070 con 0x55847a27e6f0 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.562+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a284910 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdce4019040 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x55847a27e6f0 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55847a287240 con 0x7fdcd40f7060 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:33.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2834b0 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a283d50 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a287670 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 zone default found 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 4 Realm: () 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 zonegroup default 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.566+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a287690 con 0x7fdce4019040 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2894c0 con 0x55847a284910 2024-09-12T17:12:33.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a289960 con 0x55847a284910 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 started sync module instance, tier type = 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:33.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a288960 con 0x7fdcd40f7060 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94027473522000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2885c0 con 0x7fdcd40f7060 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.570+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28a890 con 0x55847a27e6f0 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94027473522000] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.576 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94027473526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28a890 con 0x55847a27e6f0 2024-09-12T17:12:33.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28b250 con 0x55847a284910 2024-09-12T17:12:33.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94027473526208] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94027473527776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28a800 con 0x55847a284910 2024-09-12T17:12:33.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.574+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28bf50 con 0x7fdcd40f7060 2024-09-12T17:12:33.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94027473533872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28c820 con 0x7fdcd40f7060 2024-09-12T17:12:33.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28d220 con 0x55847a27e6f0 2024-09-12T17:12:33.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94027473527776] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94027473533872] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94027473532400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28c370 con 0x55847a27e6f0 2024-09-12T17:12:33.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.578+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28dac0 con 0x7fdce4019040 2024-09-12T17:12:33.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.582+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94027473532400] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.582+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.582+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94027473538352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28c370 con 0x7fdce4019040 2024-09-12T17:12:33.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.582+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28df30 con 0x7fdce4019040 2024-09-12T17:12:33.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.582+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94027473538352] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94027473541664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28e3a0 con 0x7fdce4019040 2024-09-12T17:12:33.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28d440 con 0x7fdce4019040 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94027473541664] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94027473542896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28e310 con 0x7fdce4019040 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=0 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=1 2024-09-12T17:12:33.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=2 2024-09-12T17:12:33.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=3 2024-09-12T17:12:33.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=4 2024-09-12T17:12:33.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=5 2024-09-12T17:12:33.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.586+0000 7fdcec7749c0 20 add_watcher() i=6 2024-09-12T17:12:33.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94027473542896] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 20 add_watcher() i=7 2024-09-12T17:12:33.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:33.590 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a291e40 con 0x55847a27e6f0 2024-09-12T17:12:33.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94027473545568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a28f2a0 con 0x55847a27e6f0 2024-09-12T17:12:33.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94027473545568] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:33.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:33.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.590+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29a6d0 con 0x55847a27e6f0 2024-09-12T17:12:33.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29a6d0 con 0x7fdce4019040 2024-09-12T17:12:33.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29ab80 con 0x55847a284910 2024-09-12T17:12:33.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.598 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.594+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29af70 con 0x55847a27e6f0 2024-09-12T17:12:33.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29b080 con 0x7fdcd40f7060 2024-09-12T17:12:33.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29b750 con 0x55847a284910 2024-09-12T17:12:33.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.598+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29bb30 con 0x55847a27e6f0 2024-09-12T17:12:33.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.602+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.602+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29bfb0 con 0x7fdce4019040 2024-09-12T17:12:33.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29bca0 con 0x7fdcd40f7060 2024-09-12T17:12:33.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29c0c0 con 0x55847a284910 2024-09-12T17:12:33.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.609 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.606+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29c460 con 0x7fdcd40f7060 2024-09-12T17:12:33.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.610+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.611 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.610+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29c9f0 con 0x7fdce4019040 2024-09-12T17:12:33.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.610+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.610+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29c9d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.614+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.614+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29ccb0 con 0x7fdce4019040 2024-09-12T17:12:33.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.614+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.614+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29ccb0 con 0x55847a27e6f0 2024-09-12T17:12:33.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29ccb0 con 0x55847a284910 2024-09-12T17:12:33.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.620 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29ccb0 con 0x7fdcd40f7060 2024-09-12T17:12:33.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.622 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.618+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cd40 con 0x55847a284910 2024-09-12T17:12:33.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.622+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.623 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.622+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29d1f0 con 0x55847a27e6f0 2024-09-12T17:12:33.625 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.622+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.622+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29d1f0 con 0x55847a27e6f0 2024-09-12T17:12:33.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.626+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.627 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.626+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cd40 con 0x55847a284910 2024-09-12T17:12:33.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.626+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.630 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.626+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cd40 con 0x7fdcd40f7060 2024-09-12T17:12:33.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.630+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.630+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cdb0 con 0x55847a284910 2024-09-12T17:12:33.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.630+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.633 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.630+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29d230 con 0x55847a284910 2024-09-12T17:12:33.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29d020 con 0x55847a284910 2024-09-12T17:12:33.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x55847a284910 2024-09-12T17:12:33.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.634+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x7fdce4019040 2024-09-12T17:12:33.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.638+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.638+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x55847a284910 2024-09-12T17:12:33.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.638+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.638+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x7fdce4019040 2024-09-12T17:12:33.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.642+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.642+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x55847a284910 2024-09-12T17:12:33.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.646+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.646+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x7fdce4019040 2024-09-12T17:12:33.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.646+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.646+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a29cfa0 con 0x7fdcd40f7060 2024-09-12T17:12:33.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.651 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdb1b7fe640 20 reqs_thread_entry: start 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 20 Filter name: none 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdb197fa640 20 reqs_thread_entry: start 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a299e60 con 0x7fdcd40f7060 2024-09-12T17:12:33.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:12:33.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-12T17:12:33.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2998b0 con 0x55847a27e6f0 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fdcdc056040 con 0x55847a27e6f0 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 : miss 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.654 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.650+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:96 8.1 8:87de47dc:root::.bucket.meta.myfoo6%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2ba6d0 con 0x7fdce4019040 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(96 .bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv7 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=388 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x17 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-12T17:12:33.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 2024-09-12T17:12:33.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:97 4.1a 4:5b70d9b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380b0 con 0x7fdcd40f7060 2024-09-12T17:12:33.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(97 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 4.1f 4:fbbbcb00:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(98 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:99 4.19 4:98fa104b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x7fdcd40f7060 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(99 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 4.4 4:23748be6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x7fdce4019040 2024-09-12T17:12:33.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(100 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.654+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:101 4.10 4:0ae012b3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(101 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:102 4.6 4:6115323f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(102 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:103 4.1a 4:598b9631:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x7fdcd40f7060 2024-09-12T17:12:33.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(103 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:104 4.6 4:62ee59c6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(104 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:105 4.1f 4:f98b8f36:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(105 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x55847a284910 2024-09-12T17:12:33.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(106 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [call out=349b] v0'0 uv7 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 10 cls_bucket_list_unordered: got thirteen 2024-09-12T17:12:33.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:107 4.4 4:217f794e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a3380f0 con 0x7fdce4019040 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(107 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdcdc056040 con 0x7fdce4019040 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 20 get_obj_state: octx=0x55847a26c270 obj=myfoo6:thirteen state=0x55847a2bba48 s->prefetch_data=0 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:108 3.ds0 3:b0ed643d:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc870 con 0x55847a284910 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(108 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 10 manifest: total_size = 8 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 20 get_obj_state: setting s->obj_tag to _FQl_Acx3SOrX7SOOxYhvr53CdvLOo2r 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 20 get_obj_state: octx=0x55847a26c270 obj=myfoo6:thirteen state=0x55847a2bba48 s->prefetch_data=0 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 20 prepare_atomic_modification: state is not atomic. state=0x55847a2bba48 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 2024-09-12T17:12:33.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.658+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c1170 con 0x55847a284910 2024-09-12T17:12:33.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.662+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(109 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.662+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:110 3.ds0 3:b0ed643d:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bf150 con 0x55847a284910 2024-09-12T17:12:33.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(110 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c1c00 con 0x55847a284910 2024-09-12T17:12:33.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:12:33.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:12:33.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:112 4.1a 4:5b70d9b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c1c00 con 0x7fdcd40f7060 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:113 4.1f 4:fbbbcb00:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c5ec0 con 0x55847a284910 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:114 4.19 4:98fa104b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c1c00 con 0x7fdcd40f7060 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:115 4.4 4:23748be6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2cacf0 con 0x7fdce4019040 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:116 4.10 4:0ae012b3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2c1c00 con 0x55847a284910 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:117 4.6 4:6115323f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2cfc10 con 0x55847a284910 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:118 4.1a 4:598b9631:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d25f0 con 0x7fdcd40f7060 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:119 4.6 4:62ee59c6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d2630 con 0x55847a284910 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:120 4.1f 4:f98b8f36:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d7590 con 0x55847a284910 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(112 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(114 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:121 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x55847a284910 2024-09-12T17:12:33.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:122 4.4 4:217f794e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb8f0 con 0x7fdce4019040 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(118 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(115 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcdc064070 con 0x7fdce4019040 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(113 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(117 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(116 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(120 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(122 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdcdc064070 con 0x7fdce4019040 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(119 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(111 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdbcd7fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(121 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.666+0000 7fdcec7749c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9])"; uploads.size()=0; is_truncated=0 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:123 4.1a 4:5b70d9b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:124 4.1f 4:fbbbcb00:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bbda0 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:125 4.19 4:98fa104b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d3a80 con 0x7fdcd40f7060 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:126 4.4 4:23748be6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdce4019040 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:127 4.10 4:0ae012b3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bbda0 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:128 4.6 4:6115323f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d3a80 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:129 4.1a 4:598b9631:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:130 4.6 4:62ee59c6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bbda0 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:131 4.1f 4:f98b8f36:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d3a80 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:132 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2ca860 con 0x55847a284910 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:133 4.4 4:217f794e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2cf6b0 con 0x7fdce4019040 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(123 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(125 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(129 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(124 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(126 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcdc064070 con 0x7fdce4019040 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(127 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(128 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(131 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(132 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [call out=128b] v0'0 uv9 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(130 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(133 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fdcdc064070 con 0x7fdce4019040 2024-09-12T17:12:33.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x55847a27e6f0 2024-09-12T17:12:33.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdcdc064070 con 0x55847a27e6f0 2024-09-12T17:12:33.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-12T17:12:33.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x55847a27e6f0 2024-09-12T17:12:33.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fdcdc064070 con 0x55847a27e6f0 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 20 rados_obj.operate() r=0 bl.length=166 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.670+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x55847a27e6f0 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fdcdc064070 con 0x55847a27e6f0 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdcec7749c0 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdcec7749c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94027473812352 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== watch-notify(notify (1) cookie 94027473533872 notify 146028888083 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55847a29cdb0 con 0x7fdcd40f7060 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdbcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94027473533872 notifier 4755 bl.length()=150 2024-09-12T17:12:33.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(137 notify.3 [notify cookie 94027473812352 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdbcd7fa640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdb200032d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== watch-notify(notify_complete (2) cookie 94027473812352 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55847a29b080 con 0x7fdcd40f7060 2024-09-12T17:12:33.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.674+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:139 8.1 8:87de47dc:root::.bucket.meta.myfoo6%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdce4019040 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(139 .bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [call,call,delete] v34'9 uv9 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fdcdc064070 con 0x7fdce4019040 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 from cache 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9, ofs0, ns] 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94027473812352 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== watch-notify(notify (1) cookie 94027473532400 notify 146028888106 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55847a2b9d90 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdbcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888106 cookie 94027473532400 notifier 4755 bl.length()=207 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdbcd7fa640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdb200032d0 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(140 notify.4 [notify cookie 94027473812352 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== watch-notify(notify_complete (2) cookie 94027473812352 notify 146028888106 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55847a293d10 con 0x55847a27e6f0 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:142 4.1a 4:5b70d9b0:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdcd40f7060 2024-09-12T17:12:33.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:143 4.1f 4:fbbbcb00:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2badf0 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:144 4.19 4:98fa104b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bfe10 con 0x7fdcd40f7060 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:145 4.4 4:23748be6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bb3d0 con 0x7fdce4019040 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:146 4.10 4:0ae012b3:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bfe10 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 4.6 4:6115323f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2badf0 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:148 4.1a 4:598b9631:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2b9580 con 0x7fdcd40f7060 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:149 4.6 4:62ee59c6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bfe10 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:150 4.1f 4:f98b8f36:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2badf0 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:151 4.25 4:a63ae63b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2b9580 con 0x55847a284910 2024-09-12T17:12:33.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.678+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:152 4.4 4:217f794e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2d9060 con 0x7fdce4019040 2024-09-12T17:12:33.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(146 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.4 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(142 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.0 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(145 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.3 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(144 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.2 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(152 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.10 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(148 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.6 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(147 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.5 [delete] v34'3 uv3 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== osd_op_reply(151 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.682+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(143 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.1 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(149 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== osd_op_reply(150 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9.8 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 : miss 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:153 6.17 6:eb78ac46:::pubsub..bucket.myfoo6%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(153 pubsub..bucket.myfoo6/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 info.flags=0x0 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 10 adding default.rgw.log++pubsub..bucket.myfoo6/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 to cache LRU end 2024-09-12T17:12:33.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:154 6.17 6:eb78ac46:::pubsub..bucket.myfoo6%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(154 pubsub..bucket.myfoo6/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.9 [delete] v34'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.686+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcec7749c0 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-12T17:12:33.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcec7749c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T17:12:33.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94027473812352 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== watch-notify(notify (1) cookie 94027473538352 notify 146028888086 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55847a293d10 con 0x7fdce4019040 2024-09-12T17:12:33.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdbcd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94027473538352 notifier 4755 bl.length()=170 2024-09-12T17:12:33.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdbcd7fa640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdb200032d0 con 0x7fdce4019040 2024-09-12T17:12:33.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(157 notify.5 [notify cookie 94027473812352 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.690+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== watch-notify(notify_complete (2) cookie 94027473812352 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55847a249100 con 0x7fdce4019040 2024-09-12T17:12:33.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcec7749c0 10 removing email index: 2024-09-12T17:12:33.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcec7749c0 10 removing user buckets index 2024-09-12T17:12:33.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcec7749c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-12T17:12:33.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94027473728256 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== watch-notify(notify (1) cookie 94027473541664 notify 146028888087 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55847a249100 con 0x7fdce4019040 2024-09-12T17:12:33.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdbcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94027473541664 notifier 4755 bl.length()=160 2024-09-12T17:12:33.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(160 notify.6 [notify cookie 94027473728256 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdbcdffb640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdbb0003d70 con 0x7fdce4019040 2024-09-12T17:12:33.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.694+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== watch-notify(notify_complete (2) cookie 94027473728256 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55847a248750 con 0x7fdce4019040 2024-09-12T17:12:33.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcec7749c0 10 removing user index: bud 2024-09-12T17:12:33.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdcd40f7060 2024-09-12T17:12:33.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcec7749c0 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-12T17:12:33.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcec7749c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-12T17:12:33.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94027473812352 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== watch-notify(notify (1) cookie 94027473538352 notify 146028888088 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55847a248750 con 0x7fdce4019040 2024-09-12T17:12:33.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdbcdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94027473538352 notifier 4755 bl.length()=152 2024-09-12T17:12:33.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdbcdffb640 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdbb0003d70 con 0x7fdce4019040 2024-09-12T17:12:33.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(163 notify.5 [notify cookie 94027473812352 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.698+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== watch-notify(notify_complete (2) cookie 94027473812352 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55847a2484c0 con 0x7fdce4019040 2024-09-12T17:12:33.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.702+0000 7fdba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.702+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94027473545568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.702+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94027473545568] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.702+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94027473522000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdcd40f7060 2024-09-12T17:12:33.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94027473522000] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcec7749c0 20 remove_watcher() i=0 2024-09-12T17:12:33.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcec7749c0 2 removed watcher, disabling cache 2024-09-12T17:12:33.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94027473526208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94027473526208] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcec7749c0 20 remove_watcher() i=1 2024-09-12T17:12:33.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.706+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94027473527776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a284910 2024-09-12T17:12:33.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdce9a79640 1 -- 172.21.15.193:0/1150851030 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94027473527776] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcd40f4030 con 0x55847a284910 2024-09-12T17:12:33.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdcec7749c0 20 remove_watcher() i=2 2024-09-12T17:12:33.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94027473533872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdcd40f7060 2024-09-12T17:12:33.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdceaa7b640 1 -- 172.21.15.193:0/1150851030 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94027473533872] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdce402f040 con 0x7fdcd40f7060 2024-09-12T17:12:33.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdcec7749c0 20 remove_watcher() i=3 2024-09-12T17:12:33.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.710+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94027473532400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x55847a27e6f0 2024-09-12T17:12:33.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94027473532400] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x55847a27e6f0 2024-09-12T17:12:33.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcec7749c0 20 remove_watcher() i=4 2024-09-12T17:12:33.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94027473538352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94027473538352] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcec7749c0 20 remove_watcher() i=5 2024-09-12T17:12:33.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.714+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94027473541664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.718+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94027473541664] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.718+0000 7fdcec7749c0 20 remove_watcher() i=6 2024-09-12T17:12:33.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.718+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94027473542896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55847a2bc740 con 0x7fdce4019040 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 <== osd.0 v2:172.21.15.62:6800/4046570222 48 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94027473542896] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcdc06c020 con 0x7fdce4019040 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 20 remove_watcher() i=7 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdce4019040 msgr2=0x7fdce4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdce4019040 0x7fdce4019930 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a27e6f0 msgr2=0x55847a280b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.723 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a27e6f0 0x55847a280b80 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdcd40f7060 msgr2=0x7fdcd40e4a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fdcd40f7060 0x7fdcd40e4a40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55847a284910 msgr2=0x55847a286d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55847a284910 0x55847a286d00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbb4039a70 msgr2=0x7fdbb403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbb4039a70 0x7fdbb403bf30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdce400f010 tx=0x7fdce401b070 comp rx=0 tx=0).stop 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcea27a640 1 -- 172.21.15.193:0/1150851030 reap_dead start 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 msgr2=0x55847a273420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40c7d70 tx=0x7fdcd40ebec0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 shutdown_connections 2024-09-12T17:12:33.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1150851030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a26be90 0x55847a273420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 >> 172.21.15.193:0/1150851030 conn(0x55847a2682c0 msgr2=0x55847a2664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 shutdown_connections 2024-09-12T17:12:33.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1150851030 wait complete. 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 msgr2=0x7fdbc403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 0x7fdbc403bf80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55847a250090 tx=0x7fdce4003070 comp rx=0 tx=0).stop 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 msgr2=0x55847a25fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ab040 tx=0x7fdcd4018170 comp rx=0 tx=0).stop 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 shutdown_connections 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbc4039ac0 0x7fdbc403bf80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1492026165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a25f650 0x55847a25fa70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 >> 172.21.15.193:0/1492026165 conn(0x55847a255000 msgr2=0x55847a2553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 shutdown_connections 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1492026165 wait complete. 2024-09-12T17:12:33.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 msgr2=0x55847a24f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 0x55847a24f0d0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 msgr2=0x7fdbd003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 0x7fdbd003bf80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ad000 tx=0x7fdcd40a6000 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 msgr2=0x55847a247f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55847a241820 tx=0x7fdcdc001260 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 shutdown_connections 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55847a159340 0x55847a24f0d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdbd0039ac0 0x7fdbd003bf80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 --2- 172.21.15.193:0/1391015851 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55847a1551f0 0x55847a247f60 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 >> 172.21.15.193:0/1391015851 conn(0x55847a0c8b00 msgr2=0x55847a23af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 shutdown_connections 2024-09-12T17:12:33.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.722+0000 7fdcec7749c0 1 -- 172.21.15.193:0/1391015851 wait complete. 2024-09-12T17:12:33.739 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T17:12:33.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-12T17:12:33.740 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-12T17:12:33.820 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:12:33.820 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f742a0c39c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5632ad7081f0 0x5632ad7085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f742a0c39c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632ad5ba9c0 con 0x5632ad70b330 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f742a0c39c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5632ad60a6d0 con 0x5632ad7081f0 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f7427bc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5632ad7081f0 0x5632ad7085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f7427bc9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5632ad7081f0 0x5632ad7085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50162/0 (socket says 172.21.15.193:50162) 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f7427bc9640 1 -- 172.21.15.193:0/2722234388 learned_addr learned my addr 172.21.15.193:0/2722234388 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.818+0000 7f74273c8640 1 --1- 172.21.15.193:0/2722234388 >> v1:172.21.15.62:6789/0 conn(0x5632ad70b330 0x5632ad70d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:39122/0 (socket says 172.21.15.193:39122) 2024-09-12T17:12:33.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7426bc7640 1 -- 172.21.15.193:0/2722234388 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196089096 0 0) 0x5632ad5ba9c0 con 0x5632ad70b330 2024-09-12T17:12:33.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7426bc7640 1 -- 172.21.15.193:0/2722234388 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7410001e20 con 0x5632ad70b330 2024-09-12T17:12:33.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7427bc9640 1 -- 172.21.15.193:0/2722234388 >> v1:172.21.15.62:6789/0 conn(0x5632ad70b330 legacy=0x5632ad70d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7427bc9640 1 -- 172.21.15.193:0/2722234388 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad5aeca0 con 0x5632ad7081f0 2024-09-12T17:12:33.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7427bc9640 1 --2- 172.21.15.193:0/2722234388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7085d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f741800a5c0 tx=0x7f741801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ef428028337dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7426bc7640 1 -- 172.21.15.193:0/2722234388 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180a6070 con 0x5632ad7081f0 2024-09-12T17:12:33.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7426bc7640 1 -- 172.21.15.193:0/2722234388 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180af070 con 0x5632ad7081f0 2024-09-12T17:12:33.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f7426bc7640 1 -- 172.21.15.193:0/2722234388 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180aa5a0 con 0x5632ad7081f0 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2722234388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 msgr2=0x5632ad7085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.822+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2722234388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7085d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f741800a5c0 tx=0x7f741801b340 comp rx=0 tx=0).stop 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.826+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2722234388 shutdown_connections 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.826+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2722234388 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7085d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.826+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2722234388 >> 172.21.15.193:0/2722234388 conn(0x5632ad67bb00 msgr2=0x5632ad67bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.826+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2722234388 shutdown_connections 2024-09-12T17:12:33.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.826+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2722234388 wait complete. 2024-09-12T17:12:33.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.838+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632ad60e680 con 0x5632ad7081f0 2024-09-12T17:12:33.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7427bc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7427bc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50164/0 (socket says 172.21.15.193:50164) 2024-09-12T17:12:33.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7427bc9640 1 -- 172.21.15.193:0/1124165923 learned_addr learned my addr 172.21.15.193:0/1124165923 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7427bc9640 1 -- 172.21.15.193:0/1124165923 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad589da0 con 0x5632ad7081f0 2024-09-12T17:12:33.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7427bc9640 1 --2- 172.21.15.193:0/1124165923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f74180ac040 tx=0x7f7418003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd64ab7fc2f7c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7315e0b640 1 -- 172.21.15.193:0/1124165923 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180aa670 con 0x5632ad7081f0 2024-09-12T17:12:33.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7315e0b640 1 -- 172.21.15.193:0/1124165923 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180aa810 con 0x5632ad7081f0 2024-09-12T17:12:33.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f7315e0b640 1 -- 172.21.15.193:0/1124165923 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180aab30 con 0x5632ad7081f0 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- 172.21.15.193:0/1124165923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 msgr2=0x5632ad7f36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/1124165923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f74180ac040 tx=0x7f7418003030 comp rx=0 tx=0).stop 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- 172.21.15.193:0/1124165923 shutdown_connections 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/1124165923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7f36a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- 172.21.15.193:0/1124165923 >> 172.21.15.193:0/1124165923 conn(0x5632ad67bb00 msgr2=0x5632ad7ef320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- 172.21.15.193:0/1124165923 shutdown_connections 2024-09-12T17:12:33.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- 172.21.15.193:0/1124165923 wait complete. 2024-09-12T17:12:33.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.842+0000 7f742a0c39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632ad5b0a50 con 0x5632ad7081f0 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f7427bc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f7427bc9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50178/0 (socket says 172.21.15.193:50178) 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f7427bc9640 1 -- 172.21.15.193:0/2538918274 learned_addr learned my addr 172.21.15.193:0/2538918274 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f7427bc9640 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad7fb2d0 con 0x5632ad7081f0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f7427bc9640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7418005410 tx=0x7f74180180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 -- 172.21.15.193:0/2538918274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180ce070 con 0x5632ad7081f0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ad7fb560 con 0x5632ad7081f0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 -- 172.21.15.193:0/2538918274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74180c5070 con 0x5632ad7081f0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 -- 172.21.15.193:0/2538918274 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74180ab180 con 0x5632ad7081f0 2024-09-12T17:12:33.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ad7fbec0 con 0x5632ad7081f0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 -- 172.21.15.193:0/2538918274 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f74180d1070 con 0x5632ad7081f0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 0x7f731003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f730ffff640 1 -- 172.21.15.193:0/2538918274 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f74180eb1c0 con 0x5632ad7081f0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f74273c8640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 0x7f731003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 0x5632ad801e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8023d0 con 0x5632ad70b330 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.846+0000 7f74283ca640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 0x5632ad801e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 0x7f731003bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f741c001e80 tx=0x7f741c0013e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 0x5632ad801e90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 -- 172.21.15.193:0/2538918274 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f742000a4d0 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad802820 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 -- 172.21.15.193:0/2538918274 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f742000a4d0 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad804120 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 -- 172.21.15.193:0/2538918274 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f742000a4d0 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad803260 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 -- 172.21.15.193:0/2538918274 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f742000a4d0 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad803680 con 0x5632ad70b330 2024-09-12T17:12:33.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74283ca640 1 -- 172.21.15.193:0/2538918274 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f742000a4d0 con 0x5632ad70b330 2024-09-12T17:12:33.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f742a0c39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632ad61b450 con 0x5632ad812450 2024-09-12T17:12:33.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50192/0 (socket says 172.21.15.193:50192) 2024-09-12T17:12:33.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 -- 172.21.15.193:0/302728868 learned_addr learned my addr 172.21.15.193:0/302728868 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 -- 172.21.15.193:0/302728868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad812eb0 con 0x5632ad812450 2024-09-12T17:12:33.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.850+0000 7f74273c8640 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f741c00e640 tx=0x7f741c00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 -- 172.21.15.193:0/302728868 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c022070 con 0x5632ad812450 2024-09-12T17:12:33.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 -- 172.21.15.193:0/302728868 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c00d530 con 0x5632ad812450 2024-09-12T17:12:33.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ad813710 con 0x5632ad812450 2024-09-12T17:12:33.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 -- 172.21.15.193:0/302728868 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c006070 con 0x5632ad812450 2024-09-12T17:12:33.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ad813c80 con 0x5632ad812450 2024-09-12T17:12:33.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 -- 172.21.15.193:0/302728868 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f741c025070 con 0x5632ad812450 2024-09-12T17:12:33.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 0x7f730003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f730d7fa640 1 -- 172.21.15.193:0/302728868 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f741c051b00 con 0x5632ad812450 2024-09-12T17:12:33.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74283ca640 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 0x7f730003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74283ca640 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 0x7f730003bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5632ad803600 tx=0x7f7420005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f742a0c39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632ad7f3e90 con 0x5632ad81fe80 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50202/0 (socket says 172.21.15.193:50202) 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74273c8640 1 -- 172.21.15.193:0/42967931 learned_addr learned my addr 172.21.15.193:0/42967931 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74273c8640 1 -- 172.21.15.193:0/42967931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad820850 con 0x5632ad81fe80 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f74273c8640 1 --2- 172.21.15.193:0/42967931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f741c04fe90 tx=0x7f741c024c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd630a33acf209d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f7306ffd640 1 -- 172.21.15.193:0/42967931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c025c80 con 0x5632ad81fe80 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f7306ffd640 1 -- 172.21.15.193:0/42967931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c025e20 con 0x5632ad81fe80 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.854+0000 7f7306ffd640 1 -- 172.21.15.193:0/42967931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c00d940 con 0x5632ad81fe80 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/42967931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 msgr2=0x5632ad820260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/42967931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f741c04fe90 tx=0x7f741c024c90 comp rx=0 tx=0).stop 2024-09-12T17:12:33.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/42967931 shutdown_connections 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/42967931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad820260 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/42967931 >> 172.21.15.193:0/42967931 conn(0x5632ad81b240 msgr2=0x5632ad819480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/42967931 shutdown_connections 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/42967931 wait complete. 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 Processor -- start 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- start start 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5632ad81ed70 con 0x5632ad81fe80 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f74273c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:50218/0 (socket says 172.21.15.193:50218) 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 learned_addr learned my addr 172.21.15.193:0/3798543058 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632ad8268e0 con 0x5632ad81fe80 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f74273c8640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f741c00eed0 tx=0x7f741c026680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f73057fa640 1 -- 172.21.15.193:0/3798543058 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c00dcd0 con 0x5632ad81fe80 2024-09-12T17:12:33.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632ad8268e0 con 0x5632ad81fe80 2024-09-12T17:12:33.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f73057fa640 1 -- 172.21.15.193:0/3798543058 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c044030 con 0x5632ad81fe80 2024-09-12T17:12:33.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f73057fa640 1 -- 172.21.15.193:0/3798543058 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f741c01a320 con 0x5632ad81fe80 2024-09-12T17:12:33.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.858+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632ad8268e0 con 0x5632ad81fe80 2024-09-12T17:12:33.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f73057fa640 1 -- 172.21.15.193:0/3798543058 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f741c01a4e0 con 0x5632ad81fe80 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f73057fa640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f72f0039a70 0x7f72f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f73057fa640 1 -- 172.21.15.193:0/3798543058 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f741c035d30 con 0x5632ad81fe80 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74283ca640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f72f0039a70 0x7f72f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad831300 0x5632ad8337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad833f10 con 0x5632ad831300 2024-09-12T17:12:33.863 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad831300 0x5632ad8337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad831300 0x5632ad8337c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74283ca640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f72f0039a70 0x7f72f003bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5632ad802d80 tx=0x7f742001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 realm 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad834320 con 0x5632ad831300 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad834bf0 con 0x5632ad831300 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad834f90 con 0x5632ad831300 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8357e0 con 0x5632ad831300 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 20 searching for the correct realm 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5632ad837550 0x5632ad839940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74273c8640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5632ad837550 0x5632ad839940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74273c8640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5632ad837550 0x5632ad839940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74273c8640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f741c040040 0x7f741c010590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.862+0000 7f74283ca640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f741c040040 0x7f741c010590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f74283ca640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f741c040040 0x7f741c010590 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f74283ca640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7420031040 0x7f7420032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7420031040 0x7f7420032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7420031040 0x7f7420032430 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.866+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.870+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.874+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad837550 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f7420031040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x5632ad831300 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5632ad839e80 con 0x7f741c040040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f742001f070 con 0x7f741c040040 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:12:33.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad836190 con 0x5632ad831300 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad836a30 con 0x5632ad831300 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:12:33.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad836a30 con 0x5632ad831300 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 zone default found 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 4 Realm: () 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 zonegroup default 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83a220 con 0x7f7420031040 2024-09-12T17:12:33.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83bd70 con 0x5632ad837550 2024-09-12T17:12:33.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.878+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83c280 con 0x5632ad837550 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 20 started sync module instance, tier type = 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b0b0 con 0x7f741c040040 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775659443360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83cb90 con 0x7f741c040040 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83d3e0 con 0x5632ad831300 2024-09-12T17:12:33.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775659443360] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775659448032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83cfb0 con 0x5632ad831300 2024-09-12T17:12:33.887 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.882+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83dab0 con 0x5632ad837550 2024-09-12T17:12:33.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775659451808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83e350 con 0x5632ad837550 2024-09-12T17:12:33.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83ed50 con 0x7f741c040040 2024-09-12T17:12:33.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775659448032] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775659449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83f170 con 0x7f741c040040 2024-09-12T17:12:33.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.886+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83fb30 con 0x5632ad831300 2024-09-12T17:12:33.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775659451808] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775659449088] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775659456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83f680 con 0x5632ad831300 2024-09-12T17:12:33.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8403d0 con 0x7f7420031040 2024-09-12T17:12:33.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775659456608] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775659454112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83f680 con 0x7f7420031040 2024-09-12T17:12:33.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.890+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad840840 con 0x7f7420031040 2024-09-12T17:12:33.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.894+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775659454112] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.894+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.894+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775659463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad840800 con 0x7f7420031040 2024-09-12T17:12:33.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.894+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad841200 con 0x7f7420031040 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775659466000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad841620 con 0x7f7420031040 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=0 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=1 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=2 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=3 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=4 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=5 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775659463440] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=6 2024-09-12T17:12:33.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775659466000] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 20 add_watcher() i=7 2024-09-12T17:12:33.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:12:33.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83fc10 con 0x5632ad831300 2024-09-12T17:12:33.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.898+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775659461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad841b60 con 0x5632ad831300 2024-09-12T17:12:33.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775659461648] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:33.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f742a0c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:12:33.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f742a0c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:12:33.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84cf10 con 0x5632ad831300 2024-09-12T17:12:33.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.902+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84cf10 con 0x7f7420031040 2024-09-12T17:12:33.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.906+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.906+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84d500 con 0x5632ad837550 2024-09-12T17:12:33.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.906+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.906+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84dd50 con 0x5632ad831300 2024-09-12T17:12:33.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84dd50 con 0x7f741c040040 2024-09-12T17:12:33.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'72 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.912 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84e2c0 con 0x5632ad837550 2024-09-12T17:12:33.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'48 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.910+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84e660 con 0x5632ad831300 2024-09-12T17:12:33.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.914+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.915 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.914+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84eb10 con 0x7f7420031040 2024-09-12T17:12:33.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.914+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.917 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.914+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84eb10 con 0x7f741c040040 2024-09-12T17:12:33.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.919 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84eb10 con 0x5632ad837550 2024-09-12T17:12:33.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84f0c0 con 0x7f741c040040 2024-09-12T17:12:33.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'73 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.918+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84f520 con 0x7f7420031040 2024-09-12T17:12:33.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.922+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.922+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84f4a0 con 0x7f741c040040 2024-09-12T17:12:33.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.922+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.922+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa70 con 0x7f7420031040 2024-09-12T17:12:33.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.926+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.926+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad831300 2024-09-12T17:12:33.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f741c040040 2024-09-12T17:12:33.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'74 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.930+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.934+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.934+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad831300 2024-09-12T17:12:33.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.934+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.934+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad831300 2024-09-12T17:12:33.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.938+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.938+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.938+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.938+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f741c040040 2024-09-12T17:12:33.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.942+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.946+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.946+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.946+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'49 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.946+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f7420031040 2024-09-12T17:12:33.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.950+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.950+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.950+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.950+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f7420031040 2024-09-12T17:12:33.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.954+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.954+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x5632ad837550 2024-09-12T17:12:33.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.954+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.954+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f7420031040 2024-09-12T17:12:33.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.958+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.958+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84fa20 con 0x7f741c040040 2024-09-12T17:12:33.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.958+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f72dcfe1640 20 reqs_thread_entry: start 2024-09-12T17:12:33.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 20 init_complete bucket index max shards: 11 2024-09-12T17:12:33.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 20 Filter name: none 2024-09-12T17:12:33.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f72567fc640 20 reqs_thread_entry: start 2024-09-12T17:12:33.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-12T17:12:33.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad84c670 con 0x7f7420031040 2024-09-12T17:12:33.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=380 2024-09-12T17:12:33.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-12T17:12:33.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-12T17:12:33.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:33.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86d0d0 con 0x7f7420031040 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv8 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 : miss 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.962+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:96 8.1a 8:595b0897:root::.bucket.meta.myfoo7%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86d0b0 con 0x7f7420031040 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=390 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 info.flags=0x17 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 to cache LRU end 2024-09-12T17:12:33.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 4.1f 4:f84c4960:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad837550 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(97 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:98 4.13 4:cba3950b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x7f741c040040 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(98 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:99 4.2b 4:d523ae7f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad831300 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(99 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 4.36 4:6c4f6adc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad831300 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(100 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:101 4.1b 4:dae307ee:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x7f741c040040 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(101 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.966+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:102 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad837550 2024-09-12T17:12:33.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(102 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [call out=382b] v0'0 uv11 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 10 cls_bucket_list_unordered: got fourteen 2024-09-12T17:12:33.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 4.2b 4:d77ec4f6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad831300 2024-09-12T17:12:33.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(103 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f74180d0030 con 0x5632ad831300 2024-09-12T17:12:33.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:104 4.10 4:08f4b230:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(104 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:105 4.5 4:a16f5f80:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(105 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:106 4.34 4:2c2d7dd5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x7f741c040040 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(106 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:107 4.16 4:6952b750:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea940 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(107 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 20 get_obj_state: octx=0x7f74180e5040 obj=myfoo7:fourteen state=0x5632ad8e8d38 s->prefetch_data=0 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:108 3.0s0 3:03b9443c:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e9b60 con 0x7f7420031040 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(108 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 10 manifest: total_size = 8 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.15490146294640372693 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 20 get_obj_state: octx=0x7f74180e5040 obj=myfoo7:fourteen state=0x5632ad8e8d38 s->prefetch_data=0 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 20 prepare_atomic_modification: state is not atomic. state=0x5632ad8e8d38 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.970+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea500 con 0x5632ad837550 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.974+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(109 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.974+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:110 3.0s0 3:03b9443c:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8ea500 con 0x7f7420031040 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(110 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f74180d0030 con 0x7f7420031040 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad871d40 con 0x5632ad837550 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:112 4.1f 4:f84c4960:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873b30 con 0x5632ad837550 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:113 4.13 4:cba3950b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad871d40 con 0x7f741c040040 2024-09-12T17:12:33.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:114 4.2b 4:d523ae7f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad878900 con 0x5632ad831300 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:115 4.36 4:6c4f6adc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad87b210 con 0x5632ad831300 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:116 4.1b 4:dae307ee:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad878900 con 0x7f741c040040 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:117 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad880070 con 0x5632ad837550 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(113 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(112 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(116 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(115 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7418114040 con 0x5632ad831300 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(114 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7418114040 con 0x5632ad831300 2024-09-12T17:12:33.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:118 4.2b 4:d77ec4f6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad880070 con 0x5632ad831300 2024-09-12T17:12:33.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:119 4.10 4:08f4b230:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad878d40 con 0x5632ad837550 2024-09-12T17:12:33.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:120 4.5 4:a16f5f80:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad878d40 con 0x5632ad837550 2024-09-12T17:12:33.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:121 4.34 4:2c2d7dd5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad876be0 con 0x7f741c040040 2024-09-12T17:12:33.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:122 4.16 4:6952b750:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad881540 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(118 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7418114040 con 0x5632ad831300 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(119 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(120 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c03b070 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(121 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(122 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(111 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f73067fc640 20 handle_completion(): completion ok for obj=fourteen 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(117 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10])"; uploads.size()=0; is_truncated=0 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:123 4.1f 4:f84c4960:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad881540 con 0x5632ad837550 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:124 4.13 4:cba3950b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad876be0 con 0x7f741c040040 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:125 4.2b 4:d523ae7f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x5632ad831300 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:126 4.36 4:6c4f6adc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad881540 con 0x5632ad831300 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:127 4.1b 4:dae307ee:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86fd20 con 0x7f741c040040 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:128 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad871630 con 0x5632ad837550 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:129 4.2b 4:d77ec4f6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad876be0 con 0x5632ad831300 2024-09-12T17:12:33.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:130 4.10 4:08f4b230:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.978+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:131 4.5 4:a16f5f80:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86fd20 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:132 4.34 4:2c2d7dd5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad881540 con 0x7f741c040040 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(126 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7418114040 con 0x5632ad831300 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(125 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(127 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(124 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:133 4.16 4:6952b750:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(129 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(132 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(123 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(128 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [call out=128b] v0'0 uv13 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(130 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7 [call out=89b] v0'0 uv6 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(131 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(133 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10 [call out=89b] v0'0 uv5 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86fd20 con 0x7f7420031040 2024-09-12T17:12:33.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(134 fud.buckets [call] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:33.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-12T17:12:33.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.982+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872670 con 0x7f741c040040 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 20 rados_obj.operate() r=0 bl.length=168 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-12T17:12:33.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x7f741c040040 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94775660158784 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x7f741c040040 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== watch-notify(notify (1) cookie 94775659449088 notify 146028888084 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5632ad84e660 con 0x7f741c040040 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f73067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94775659449088 notifier 4762 bl.length()=150 2024-09-12T17:12:33.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(137 notify.3 [notify cookie 94775660158784 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f73067fc640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f725c0032d0 con 0x7f741c040040 2024-09-12T17:12:33.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.986+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== watch-notify(notify_complete (2) cookie 94775660158784 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ad84eeb0 con 0x7f741c040040 2024-09-12T17:12:33.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:139 8.1a 8:595b0897:root::.bucket.meta.myfoo7%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad873680 con 0x7f7420031040 2024-09-12T17:12:33.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(139 .bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:33.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f742a0c39c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 from cache 2024-09-12T17:12:33.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f742a0c39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10, ofs0, ns] 2024-09-12T17:12:33.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.990+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94775660158624 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872b20 con 0x7f7420031040 2024-09-12T17:12:33.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== watch-notify(notify (1) cookie 94775659454112 notify 146028888089 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5632ad86c730 con 0x7f7420031040 2024-09-12T17:12:33.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f73067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94775659454112 notifier 4762 bl.length()=208 2024-09-12T17:12:33.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f73067fc640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f725c0032d0 con 0x7f7420031040 2024-09-12T17:12:33.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(140 notify.5 [notify cookie 94775660158624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:33.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:33.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== watch-notify(notify_complete (2) cookie 94775660158624 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ad846530 con 0x7f7420031040 2024-09-12T17:12:33.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:142 4.1f 4:f84c4960:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86b720 con 0x5632ad837550 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:143 4.13 4:cba3950b:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86bf70 con 0x7f741c040040 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:144 4.2b 4:d523ae7f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86c310 con 0x5632ad831300 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:145 4.36 4:6c4f6adc:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e8fa0 con 0x5632ad831300 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:146 4.1b 4:dae307ee:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872b20 con 0x7f741c040040 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 4.30 4:0fd94ec7:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86b720 con 0x5632ad837550 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:148 4.2b 4:d77ec4f6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86bf70 con 0x5632ad831300 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:149 4.10 4:08f4b230:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872b20 con 0x5632ad837550 2024-09-12T17:12:33.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:150 4.5 4:a16f5f80:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e8fa0 con 0x5632ad837550 2024-09-12T17:12:33.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:151 4.34 4:2c2d7dd5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86bf70 con 0x7f741c040040 2024-09-12T17:12:33.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.994+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:152 4.16 4:6952b750:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e8fa0 con 0x5632ad837550 2024-09-12T17:12:33.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(142 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.0 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(147 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.5 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:33.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(144 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.2 [delete] v34'7 uv7 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:33.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(143 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.1 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:33.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(146 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.4 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:34.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(149 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.7 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(150 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.8 [delete] v34'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(145 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.3 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:34.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:33.998+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(148 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.6 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(152 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.10 [delete] v34'6 uv6 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(151 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10.9 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 : miss 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 20 rados->read ofs=0 len=0 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:153 6.2 6:43bcb904:::pubsub..bucket.myfoo7%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872b20 con 0x5632ad837550 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(153 pubsub..bucket.myfoo7/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 info.flags=0x0 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 10 adding default.rgw.log++pubsub..bucket.myfoo7/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 to cache LRU end 2024-09-12T17:12:34.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:154 6.2 6:43bcb904:::pubsub..bucket.myfoo7%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad86b720 con 0x5632ad837550 2024-09-12T17:12:34.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(154 pubsub..bucket.myfoo7/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.10 [delete] v34'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.002+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad877050 con 0x7f7420031040 2024-09-12T17:12:34.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.006+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(155 fud.buckets [call] v34'11 uv11 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.006+0000 7f742a0c39c0 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-12T17:12:34.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.006+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e8640 con 0x7f7420031040 2024-09-12T17:12:34.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f742a0c39c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-12T17:12:34.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94775660158624 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872670 con 0x5632ad837550 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== watch-notify(notify (1) cookie 94775659451808 notify 146028888071 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5632ad84de80 con 0x5632ad837550 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f73067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888071 cookie 94775659451808 notifier 4762 bl.length()=170 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(157 notify.2 [notify cookie 94775660158624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f73067fc640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f725c0032d0 con 0x5632ad837550 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== watch-notify(notify_complete (2) cookie 94775660158624 notify 146028888071 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ad820850 con 0x5632ad837550 2024-09-12T17:12:34.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f742a0c39c0 10 removing email index: 2024-09-12T17:12:34.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f742a0c39c0 10 removing user buckets index 2024-09-12T17:12:34.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.010+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e8640 con 0x7f7420031040 2024-09-12T17:12:34.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(159 fud.buckets [delete] v34'12 uv12 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f742a0c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-12T17:12:34.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94775660158624 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad872670 con 0x7f7420031040 2024-09-12T17:12:34.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== watch-notify(notify (1) cookie 94775659463440 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5632ad846530 con 0x7f7420031040 2024-09-12T17:12:34.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94775659463440 notifier 4762 bl.length()=160 2024-09-12T17:12:34.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7306ffd640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f72ec003d70 con 0x7f7420031040 2024-09-12T17:12:34.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(160 notify.6 [notify cookie 94775660158624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== watch-notify(notify_complete (2) cookie 94775660158624 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ad7fbec0 con 0x7f7420031040 2024-09-12T17:12:34.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f742a0c39c0 10 removing user index: fud 2024-09-12T17:12:34.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.014+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad878060 con 0x7f7420031040 2024-09-12T17:12:34.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(162 fud [call,call,delete] v34'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f742a0c39c0 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-12T17:12:34.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f742a0c39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-12T17:12:34.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94775660158624 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5632ad877500 con 0x7f7420031040 2024-09-12T17:12:34.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== watch-notify(notify (1) cookie 94775659454112 notify 146028888091 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5632ad7fbec0 con 0x7f7420031040 2024-09-12T17:12:34.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f73067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94775659454112 notifier 4762 bl.length()=152 2024-09-12T17:12:34.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(163 notify.5 [notify cookie 94775660158624 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f73067fc640 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f725c0032d0 con 0x7f7420031040 2024-09-12T17:12:34.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== watch-notify(notify_complete (2) cookie 94775660158624 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632ad7fb560 con 0x7f7420031040 2024-09-12T17:12:34.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.018+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f72ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:12:34.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775659461648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad8e9e60 con 0x5632ad831300 2024-09-12T17:12:34.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94775659461648] v34'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:34.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775659443360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83fc10 con 0x7f741c040040 2024-09-12T17:12:34.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94775659443360] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:34.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f742a0c39c0 20 remove_watcher() i=0 2024-09-12T17:12:34.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f742a0c39c0 2 removed watcher, disabling cache 2024-09-12T17:12:34.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.022+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775659448032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b4a0 con 0x5632ad831300 2024-09-12T17:12:34.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.026+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94775659448032] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:34.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.026+0000 7f742a0c39c0 20 remove_watcher() i=1 2024-09-12T17:12:34.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.026+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775659451808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b4a0 con 0x5632ad837550 2024-09-12T17:12:34.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f74273c8640 1 -- 172.21.15.193:0/3798543058 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94775659451808] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741c076070 con 0x5632ad837550 2024-09-12T17:12:34.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f742a0c39c0 20 remove_watcher() i=2 2024-09-12T17:12:34.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775659449088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b4a0 con 0x7f741c040040 2024-09-12T17:12:34.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f74283ca640 1 -- 172.21.15.193:0/3798543058 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94775659449088] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7420040040 con 0x7f741c040040 2024-09-12T17:12:34.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f742a0c39c0 20 remove_watcher() i=3 2024-09-12T17:12:34.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.030+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775659456608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b4a0 con 0x5632ad831300 2024-09-12T17:12:34.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94775659456608] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x5632ad831300 2024-09-12T17:12:34.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f742a0c39c0 20 remove_watcher() i=4 2024-09-12T17:12:34.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775659454112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83e860 con 0x7f7420031040 2024-09-12T17:12:34.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94775659454112] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f742a0c39c0 20 remove_watcher() i=5 2024-09-12T17:12:34.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.034+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775659463440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83b4a0 con 0x7f7420031040 2024-09-12T17:12:34.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.038+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 48 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94775659463440] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.038+0000 7f742a0c39c0 20 remove_watcher() i=6 2024-09-12T17:12:34.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.038+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775659466000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5632ad83e860 con 0x7f7420031040 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.038+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 <== osd.0 v2:172.21.15.62:6800/4046570222 49 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94775659466000] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f741811b070 con 0x7f7420031040 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.038+0000 7f742a0c39c0 20 remove_watcher() i=7 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7420031040 msgr2=0x7f7420032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f7420031040 0x7f7420032430 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad831300 msgr2=0x5632ad8337c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad831300 0x5632ad8337c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f741c040040 msgr2=0x7f741c010590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f741c040040 0x7f741c010590 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5632ad837550 msgr2=0x5632ad839940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5632ad837550 0x5632ad839940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f72f0039a70 msgr2=0x7f72f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f72f0039a70 0x7f72f003bf30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5632ad802d80 tx=0x7f742001f000 comp rx=0 tx=0).stop 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 msgr2=0x5632ad826380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f7427bc9640 1 -- 172.21.15.193:0/3798543058 reap_dead start 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f741c00eed0 tx=0x7f741c026680 comp rx=0 tx=0).stop 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 shutdown_connections 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/3798543058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad81fe80 0x5632ad826380 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 >> 172.21.15.193:0/3798543058 conn(0x5632ad81b240 msgr2=0x5632ad819450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:34.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 shutdown_connections 2024-09-12T17:12:34.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/3798543058 wait complete. 2024-09-12T17:12:34.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 msgr2=0x7f730003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.046 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 0x7f730003bf30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5632ad803600 tx=0x7f7420005850 comp rx=0 tx=0).stop 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 msgr2=0x5632ad812870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f741c00e640 tx=0x7f741c00ea40 comp rx=0 tx=0).stop 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 shutdown_connections 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7300039a70 0x7f730003bf30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/302728868 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad812450 0x5632ad812870 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 >> 172.21.15.193:0/302728868 conn(0x5632ad807e00 msgr2=0x5632ad8081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:34.047 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 shutdown_connections 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/302728868 wait complete. 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 msgr2=0x5632ad801e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 0x5632ad801e90 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 msgr2=0x7f731003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 0x7f731003bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f741c001e80 tx=0x7f741c0013e0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 msgr2=0x5632ad7fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7418005410 tx=0x7f74180180e0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 shutdown_connections 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5632ad70b330 0x5632ad801e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f7310039a70 0x7f731003bf30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 --2- 172.21.15.193:0/2538918274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5632ad7081f0 0x5632ad7fad70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:12:34.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 >> 172.21.15.193:0/2538918274 conn(0x5632ad67bb00 msgr2=0x5632ad7eddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:12:34.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 shutdown_connections 2024-09-12T17:12:34.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:12:34.042+0000 7f742a0c39c0 1 -- 172.21.15.193:0/2538918274 wait complete. 2024-09-12T17:13:14.061 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-12T17:13:14.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-12T17:13:14.062 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-12T17:13:14.103 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:14.103 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:14.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe772ef49c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fbcbf277b0 0x55fbcbf26380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe772ef49c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fbcbe659c0 con 0x55fbcbf27280 2024-09-12T17:13:14.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe772ef49c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55fbcbeb56d0 con 0x55fbcbf277b0 2024-09-12T17:13:14.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe7701f9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55fbcbf277b0 0x55fbcbf26380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe7709fa640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55fbcbf27280 0x55fbcbf25c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44256/0 (socket says 172.21.15.193:44256) 2024-09-12T17:13:14.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe7709fa640 1 -- 172.21.15.193:0/2687173945 learned_addr learned my addr 172.21.15.193:0/2687173945 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:14.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe7701f9640 1 -- 172.21.15.193:0/2687173945 >> v1:172.21.15.62:6789/0 conn(0x55fbcbf27280 legacy=0x55fbcbf25c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.101+0000 7fe7701f9640 1 -- 172.21.15.193:0/2687173945 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcbe59ca0 con 0x55fbcbf277b0 2024-09-12T17:13:14.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe7701f9640 1 --2- 172.21.15.193:0/2687173945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf277b0 0x55fbcbf26380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe75800a420 tx=0x7fe75801af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd14209c748451e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe76f9f8640 1 -- 172.21.15.193:0/2687173945 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580b0070 con 0x55fbcbf277b0 2024-09-12T17:13:14.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe76f9f8640 1 -- 172.21.15.193:0/2687173945 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580a3e10 con 0x55fbcbf277b0 2024-09-12T17:13:14.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe76f9f8640 1 -- 172.21.15.193:0/2687173945 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580ab570 con 0x55fbcbf277b0 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2687173945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf277b0 msgr2=0x55fbcbf26380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2687173945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf277b0 0x55fbcbf26380 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe75800a420 tx=0x7fe75801af10 comp rx=0 tx=0).stop 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2687173945 shutdown_connections 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2687173945 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf277b0 0x55fbcbf26380 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2687173945 >> 172.21.15.193:0/2687173945 conn(0x55fbcbfacaa0 msgr2=0x55fbcbfaeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2687173945 shutdown_connections 2024-09-12T17:13:14.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.105+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2687173945 wait complete. 2024-09-12T17:13:14.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe772ef49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe772ef49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fbcbeb9680 con 0x55fbcbf27280 2024-09-12T17:13:14.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe7709fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe7709fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45370/0 (socket says 172.21.15.193:45370) 2024-09-12T17:13:14.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe7709fa640 1 -- 172.21.15.193:0/2564449713 learned_addr learned my addr 172.21.15.193:0/2564449713 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.121+0000 7fe7709fa640 1 -- 172.21.15.193:0/2564449713 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcbe34da0 con 0x55fbcbf27280 2024-09-12T17:13:14.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 --2- 172.21.15.193:0/2564449713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe760001e00 tx=0x7fe76000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a73fad25efaace server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65ee0d640 1 -- 172.21.15.193:0/2564449713 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760012020 con 0x55fbcbf27280 2024-09-12T17:13:14.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65ee0d640 1 -- 172.21.15.193:0/2564449713 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe76000e690 con 0x55fbcbf27280 2024-09-12T17:13:14.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65ee0d640 1 -- 172.21.15.193:0/2564449713 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76000ea10 con 0x55fbcbf27280 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2564449713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 msgr2=0x55fbcc09ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2564449713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe760001e00 tx=0x7fe76000b6d0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2564449713 shutdown_connections 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2564449713 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc09ec00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2564449713 >> 172.21.15.193:0/2564449713 conn(0x55fbcbfacaa0 msgr2=0x55fbcc09a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2564449713 shutdown_connections 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2564449713 wait complete. 2024-09-12T17:13:14.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fbcbe5ba50 con 0x55fbcbf27280 2024-09-12T17:13:14.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45380/0 (socket says 172.21.15.193:45380) 2024-09-12T17:13:14.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 -- 172.21.15.193:0/2385196256 learned_addr learned my addr 172.21.15.193:0/2385196256 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcc0a6850 con 0x55fbcbf27280 2024-09-12T17:13:14.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe7709fa640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55fbcc09fb90 tx=0x7fe760000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65d60a640 1 -- 172.21.15.193:0/2385196256 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe760012030 con 0x55fbcbf27280 2024-09-12T17:13:14.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbcc0a6ae0 con 0x55fbcbf27280 2024-09-12T17:13:14.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65d60a640 1 -- 172.21.15.193:0/2385196256 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe760001460 con 0x55fbcbf27280 2024-09-12T17:13:14.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe65d60a640 1 -- 172.21.15.193:0/2385196256 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe76001a7a0 con 0x55fbcbf27280 2024-09-12T17:13:14.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.125+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbcc0a7490 con 0x55fbcbf27280 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe65d60a640 1 -- 172.21.15.193:0/2385196256 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe760015020 con 0x55fbcbf27280 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe65d60a640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 0x7fe65803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe65d60a640 1 -- 172.21.15.193:0/2385196256 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe760020030 con 0x55fbcbf27280 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7701f9640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 0x7fe65803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 0x55fbcc0ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ad9a0 con 0x55fbcbf277b0 2024-09-12T17:13:14.132 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 0x55fbcc0ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7701f9640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 0x7fe65803bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7580ad000 tx=0x7fe7580a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 0x55fbcc0ad460 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 -- 172.21.15.193:0/2385196256 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe7680083f0 con 0x55fbcbf277b0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0a7800 con 0x55fbcbf277b0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 -- 172.21.15.193:0/2385196256 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe7680083f0 con 0x55fbcbf277b0 2024-09-12T17:13:14.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0af780 con 0x55fbcbf277b0 2024-09-12T17:13:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 -- 172.21.15.193:0/2385196256 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe7680083f0 con 0x55fbcbf277b0 2024-09-12T17:13:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ae9b0 con 0x55fbcbf277b0 2024-09-12T17:13:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe7711fb640 1 -- 172.21.15.193:0/2385196256 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe7680083f0 con 0x55fbcbf277b0 2024-09-12T17:13:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.129+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0aee00 con 0x55fbcbf277b0 2024-09-12T17:13:14.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7711fb640 1 -- 172.21.15.193:0/2385196256 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe7680083f0 con 0x55fbcbf277b0 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fbcbec6450 con 0x55fbcc0bda90 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45382/0 (socket says 172.21.15.193:45382) 2024-09-12T17:13:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7701f9640 1 -- 172.21.15.193:0/2628583779 learned_addr learned my addr 172.21.15.193:0/2628583779 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7701f9640 1 -- 172.21.15.193:0/2628583779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcc0be4f0 con 0x55fbcc0bda90 2024-09-12T17:13:14.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe7701f9640 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe758096a00 tx=0x7fe758017cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe6567fc640 1 -- 172.21.15.193:0/2628583779 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580b0040 con 0x55fbcc0bda90 2024-09-12T17:13:14.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbcc0bed50 con 0x55fbcc0bda90 2024-09-12T17:13:14.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe6567fc640 1 -- 172.21.15.193:0/2628583779 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580c5070 con 0x55fbcc0bda90 2024-09-12T17:13:14.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe6567fc640 1 -- 172.21.15.193:0/2628583779 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580ca460 con 0x55fbcc0bda90 2024-09-12T17:13:14.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbcc0bf260 con 0x55fbcc0bda90 2024-09-12T17:13:14.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.133+0000 7fe6567fc640 1 -- 172.21.15.193:0/2628583779 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7580ca600 con 0x55fbcc0bda90 2024-09-12T17:13:14.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe6567fc640 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 0x7fe64803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe6567fc640 1 -- 172.21.15.193:0/2628583779 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe7580ec840 con 0x55fbcc0bda90 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7711fb640 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 0x7fe64803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7711fb640 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 0x7fe64803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e3f0 tx=0x7fe768003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fbcc09f450 con 0x55fbcc0cb340 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45392/0 (socket says 172.21.15.193:45392) 2024-09-12T17:13:14.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 -- 172.21.15.193:0/4109968423 learned_addr learned my addr 172.21.15.193:0/4109968423 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 -- 172.21.15.193:0/4109968423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcc0cbd30 con 0x55fbcc0cb340 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 --2- 172.21.15.193:0/4109968423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe7580bfaf0 tx=0x7fe7580b6db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db9c7cde8f3f4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe647fff640 1 -- 172.21.15.193:0/4109968423 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580b6a80 con 0x55fbcc0cb340 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe647fff640 1 -- 172.21.15.193:0/4109968423 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580bf530 con 0x55fbcc0cb340 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe647fff640 1 -- 172.21.15.193:0/4109968423 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580b6440 con 0x55fbcc0cb340 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- 172.21.15.193:0/4109968423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 msgr2=0x55fbcc0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/4109968423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe7580bfaf0 tx=0x7fe7580b6db0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- 172.21.15.193:0/4109968423 shutdown_connections 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/4109968423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0cb740 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- 172.21.15.193:0/4109968423 >> 172.21.15.193:0/4109968423 conn(0x55fbcc0c6760 msgr2=0x55fbcc0c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- 172.21.15.193:0/4109968423 shutdown_connections 2024-09-12T17:13:14.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- 172.21.15.193:0/4109968423 wait complete. 2024-09-12T17:13:14.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 Processor -- start 2024-09-12T17:13:14.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- start start 2024-09-12T17:13:14.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe772ef49c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55fbcc0ca290 con 0x55fbcc0cb340 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.137+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7701f9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45406/0 (socket says 172.21.15.193:45406) 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 learned_addr learned my addr 172.21.15.193:0/345034203 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbcc0d1e10 con 0x55fbcc0cb340 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7701f9640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0d18b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe75801ad40 tx=0x7fe7580eab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 -- 172.21.15.193:0/345034203 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580e3020 con 0x55fbcc0cb340 2024-09-12T17:13:14.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 -- 172.21.15.193:0/345034203 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7580da040 con 0x55fbcc0cb340 2024-09-12T17:13:14.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fbcc0d20a0 con 0x55fbcc0cb340 2024-09-12T17:13:14.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 -- 172.21.15.193:0/345034203 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7580ecbe0 con 0x55fbcc0cb340 2024-09-12T17:13:14.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbcc0d2a50 con 0x55fbcc0cb340 2024-09-12T17:13:14.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 -- 172.21.15.193:0/345034203 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe7580e8070 con 0x55fbcc0cb340 2024-09-12T17:13:14.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe63c039a70 0x7fe63c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe6467fc640 1 -- 172.21.15.193:0/345034203 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe7580e5070 con 0x55fbcc0cb340 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcc0dcb70 0x55fbcc0df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0df780 con 0x55fbcc0dcb70 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7709fa640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcc0dcb70 0x55fbcc0df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7709fa640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcc0dcb70 0x55fbcc0df030 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 20 realm 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.141+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0dfb90 con 0x55fbcc0dcb70 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e0460 con 0x55fbcc0dcb70 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e0800 con 0x55fbcc0dcb70 2024-09-12T17:13:14.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e1050 con 0x55fbcc0dcb70 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 20 searching for the correct realm 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fbcc0e2dc0 0x55fbcc0e51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7701f9640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fbcc0e2dc0 0x55fbcc0e51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7701f9640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fbcc0e2dc0 0x55fbcc0e51b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7701f9640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe7580aa3a0 0x7fe7580d4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7711fb640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe7580aa3a0 0x7fe7580d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7711fb640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe7580aa3a0 0x7fe7580d4890 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe768022040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7711fb640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe768019040 0x7fe768028960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe768019040 0x7fe768028960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.145+0000 7fe7709fa640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe768019040 0x7fe768028960 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe768022040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.149+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe768022040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.153+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe768022040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe768022040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.157+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe760059040 con 0x55fbcc0dcb70 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe760059040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:14.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e19a0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e2240 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e2240 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:14.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 zone default found 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 4 Realm: () 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 zonegroup default 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e56f0 con 0x7fe768019040 2024-09-12T17:13:14.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e71e0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e76d0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 started sync module instance, tier type = 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.161+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e6580 con 0x7fe7580aa3a0 2024-09-12T17:13:14.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94539948649088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e6580 con 0x7fe7580aa3a0 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e81b0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94539948649088] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94539948653728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e6580 con 0x55fbcc0dcb70 2024-09-12T17:13:14.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.165+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e8bf0 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94539948656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e9440 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e9e40 con 0x7fe7580aa3a0 2024-09-12T17:13:14.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94539948653728] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94539948646608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ea230 con 0x7fe7580aa3a0 2024-09-12T17:13:14.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eabf0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.169+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94539948656448] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94539948646608] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94539948661072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ea740 con 0x55fbcc0dcb70 2024-09-12T17:13:14.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eb490 con 0x7fe768019040 2024-09-12T17:13:14.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94539948661072] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94539948658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ea740 con 0x7fe768019040 2024-09-12T17:13:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.173+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eb8e0 con 0x7fe768019040 2024-09-12T17:13:14.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7711fb640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe63c039a70 0x7fe63c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7711fb640 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe63c039a70 0x7fe63c03bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe760001610 tx=0x7fe76801b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94539948658576] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94539948667856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eb8a0 con 0x7fe768019040 2024-09-12T17:13:14.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ec260 con 0x7fe768019040 2024-09-12T17:13:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94539948670384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ec6c0 con 0x7fe768019040 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=0 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=1 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=2 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=3 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=4 2024-09-12T17:13:14.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=5 2024-09-12T17:13:14.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94539948667856] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.177+0000 7fe772ef49c0 20 add_watcher() i=6 2024-09-12T17:13:14.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94539948670384] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 20 add_watcher() i=7 2024-09-12T17:13:14.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:14.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eacd0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94539948666064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ecbd0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94539948666064] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe626fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:14.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 5 note: GC not initialized 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe625fe3640 20 reqs_thread_entry: start 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.181+0000 7fe772ef49c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 20 Filter name: none 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe5977fe640 20 reqs_thread_entry: start 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc112930 con 0x55fbcc0dcb70 2024-09-12T17:13:14.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:13:14.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:13:14.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:13:14.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:14.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc1153c0 con 0x7fe768019040 2024-09-12T17:13:14.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call] v34'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.185+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc1153c0 con 0x7fe768019040 2024-09-12T17:13:14.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.189+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(64 usage.10 [call] v34'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.189+0000 7fe626fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.189+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94539948666064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0ed440 con 0x55fbcc0dcb70 2024-09-12T17:13:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.189+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94539948666064] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.189+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94539948649088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0eacd0 con 0x7fe7580aa3a0 2024-09-12T17:13:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94539948649088] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe772ef49c0 20 remove_watcher() i=0 2024-09-12T17:13:14.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe772ef49c0 2 removed watcher, disabling cache 2024-09-12T17:13:14.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94539948653728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e6a80 con 0x55fbcc0dcb70 2024-09-12T17:13:14.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94539948653728] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe772ef49c0 20 remove_watcher() i=1 2024-09-12T17:13:14.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.193+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94539948656448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e6a80 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe7701f9640 1 -- 172.21.15.193:0/345034203 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94539948656448] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe7580f2020 con 0x55fbcc0e2dc0 2024-09-12T17:13:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe772ef49c0 20 remove_watcher() i=2 2024-09-12T17:13:14.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94539948646608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e8740 con 0x7fe7580aa3a0 2024-09-12T17:13:14.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe7711fb640 1 -- 172.21.15.193:0/345034203 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94539948646608] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe768035040 con 0x7fe7580aa3a0 2024-09-12T17:13:14.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe772ef49c0 20 remove_watcher() i=3 2024-09-12T17:13:14.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.197+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94539948661072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e60d0 con 0x55fbcc0dcb70 2024-09-12T17:13:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94539948661072] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x55fbcc0dcb70 2024-09-12T17:13:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe772ef49c0 20 remove_watcher() i=4 2024-09-12T17:13:14.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94539948658576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e8740 con 0x7fe768019040 2024-09-12T17:13:14.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94539948658576] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe772ef49c0 20 remove_watcher() i=5 2024-09-12T17:13:14.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.201+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94539948667856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e9950 con 0x7fe768019040 2024-09-12T17:13:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94539948667856] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 20 remove_watcher() i=6 2024-09-12T17:13:14.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94539948670384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55fbcc0e60d0 con 0x7fe768019040 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94539948670384] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe760008030 con 0x7fe768019040 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 20 remove_watcher() i=7 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe768019040 msgr2=0x7fe768028960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe768019040 0x7fe768028960 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcc0dcb70 msgr2=0x55fbcc0df030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcc0dcb70 0x55fbcc0df030 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe7580aa3a0 msgr2=0x7fe7580d4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe7580aa3a0 0x7fe7580d4890 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fbcc0e2dc0 msgr2=0x55fbcc0e51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.205+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55fbcc0e2dc0 0x55fbcc0e51b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe63c039a70 msgr2=0x7fe63c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe63c039a70 0x7fe63c03bf30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe760001610 tx=0x7fe76801b000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 msgr2=0x55fbcc0d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/345034203 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0cb340 0x55fbcc0d18b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe75801ad40 tx=0x7fe7580eab30 comp rx=0 tx=0).stop 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 reap_dead start 2024-09-12T17:13:14.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe7709fa640 1 -- 172.21.15.193:0/345034203 reap_dead start 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 shutdown_connections 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 >> 172.21.15.193:0/345034203 conn(0x55fbcc0c6760 msgr2=0x55fbcc0c4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 shutdown_connections 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/345034203 wait complete. 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 msgr2=0x7fe64803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 0x7fe64803bf30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e3f0 tx=0x7fe768003070 comp rx=0 tx=0).stop 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 msgr2=0x55fbcc0bdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe758096a00 tx=0x7fe758017cb0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 shutdown_connections 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe648039a70 0x7fe64803bf30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2628583779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcc0bda90 0x55fbcc0bdeb0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 >> 172.21.15.193:0/2628583779 conn(0x55fbcc0b3440 msgr2=0x55fbcc0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 shutdown_connections 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2628583779 wait complete. 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 msgr2=0x55fbcc0ad460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 0x55fbcc0ad460 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 msgr2=0x7fe65803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 0x7fe65803bf30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7580ad000 tx=0x7fe7580a5070 comp rx=0 tx=0).stop 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 msgr2=0x55fbcc0a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x55fbcc09fb90 tx=0x7fe760000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 shutdown_connections 2024-09-12T17:13:14.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55fbcbf277b0 0x55fbcc0ad460 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe658039a70 0x7fe65803bf30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 --2- 172.21.15.193:0/2385196256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55fbcbf27280 0x55fbcc0a62f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 >> 172.21.15.193:0/2385196256 conn(0x55fbcbfacaa0 msgr2=0x55fbcc0992d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 shutdown_connections 2024-09-12T17:13:14.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.209+0000 7fe772ef49c0 1 -- 172.21.15.193:0/2385196256 wait complete. 2024-09-12T17:13:14.223 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-12T17:13:14.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-12T17:13:14.223 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-12T17:13:14.299 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:14.299 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:14.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc34bf439c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e66c94d200 0x55e66c9dbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc34bf439c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e66c88d9c0 con 0x55e66c9dc170 2024-09-12T17:13:14.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc34bf439c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55e66c8dd6d0 con 0x55e66c94d200 2024-09-12T17:13:14.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc349a49640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55e66c94d200 0x55e66c9dbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc349248640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55e66c9dc170 0x55e66c9de560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44268/0 (socket says 172.21.15.193:44268) 2024-09-12T17:13:14.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc349248640 1 -- 172.21.15.193:0/858238741 learned_addr learned my addr 172.21.15.193:0/858238741 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:14.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc349a49640 1 -- 172.21.15.193:0/858238741 >> v1:172.21.15.62:6789/0 conn(0x55e66c9dc170 legacy=0x55e66c9de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.297+0000 7fc349a49640 1 -- 172.21.15.193:0/858238741 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66c881ca0 con 0x55e66c94d200 2024-09-12T17:13:14.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc349a49640 1 --2- 172.21.15.193:0/858238741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66c9dbc30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00a480 tx=0x7fc33c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e446335c27fe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc348a47640 1 -- 172.21.15.193:0/858238741 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0af070 con 0x55e66c94d200 2024-09-12T17:13:14.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc348a47640 1 -- 172.21.15.193:0/858238741 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c0aa530 con 0x55e66c94d200 2024-09-12T17:13:14.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc348a47640 1 -- 172.21.15.193:0/858238741 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0aa830 con 0x55e66c94d200 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 -- 172.21.15.193:0/858238741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 msgr2=0x55e66c9dbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/858238741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66c9dbc30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00a480 tx=0x7fc33c01b280 comp rx=0 tx=0).stop 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 -- 172.21.15.193:0/858238741 shutdown_connections 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/858238741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66c9dbc30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 -- 172.21.15.193:0/858238741 >> 172.21.15.193:0/858238741 conn(0x55e66c9d3920 msgr2=0x55e66c9d5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 -- 172.21.15.193:0/858238741 shutdown_connections 2024-09-12T17:13:14.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.301+0000 7fc34bf439c0 1 -- 172.21.15.193:0/858238741 wait complete. 2024-09-12T17:13:14.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.317+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.317+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.317+0000 7fc34bf439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.317+0000 7fc34bf439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66c8e1680 con 0x55e66c94d200 2024-09-12T17:13:14.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45422/0 (socket says 172.21.15.193:45422) 2024-09-12T17:13:14.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 -- 172.21.15.193:0/1889641179 learned_addr learned my addr 172.21.15.193:0/1889641179 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 -- 172.21.15.193:0/1889641179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66c85cda0 con 0x55e66c94d200 2024-09-12T17:13:14.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 --2- 172.21.15.193:0/1889641179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0aa500 tx=0x7fc33c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab0c47ccba73dc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc237e07640 1 -- 172.21.15.193:0/1889641179 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0af070 con 0x55e66c94d200 2024-09-12T17:13:14.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc237e07640 1 -- 172.21.15.193:0/1889641179 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c0bb070 con 0x55e66c94d200 2024-09-12T17:13:14.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc237e07640 1 -- 172.21.15.193:0/1889641179 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0aa850 con 0x55e66c94d200 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- 172.21.15.193:0/1889641179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 msgr2=0x55e66cac47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/1889641179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0aa500 tx=0x7fc33c003030 comp rx=0 tx=0).stop 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- 172.21.15.193:0/1889641179 shutdown_connections 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/1889641179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cac47f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- 172.21.15.193:0/1889641179 >> 172.21.15.193:0/1889641179 conn(0x55e66c9d3920 msgr2=0x55e66cac0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- 172.21.15.193:0/1889641179 shutdown_connections 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- 172.21.15.193:0/1889641179 wait complete. 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc34bf439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66c883a50 con 0x55e66c94d200 2024-09-12T17:13:14.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45428/0 (socket says 172.21.15.193:45428) 2024-09-12T17:13:14.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.321+0000 7fc349a49640 1 -- 172.21.15.193:0/3953945227 learned_addr learned my addr 172.21.15.193:0/3953945227 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc349a49640 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66cacc2b0 con 0x55e66c94d200 2024-09-12T17:13:14.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc349a49640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc33c019930 tx=0x7fc33c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 -- 172.21.15.193:0/3953945227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0b6690 con 0x55e66c94d200 2024-09-12T17:13:14.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 -- 172.21.15.193:0/3953945227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c0c3070 con 0x55e66c94d200 2024-09-12T17:13:14.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66cacc540 con 0x55e66c94d200 2024-09-12T17:13:14.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 -- 172.21.15.193:0/3953945227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc33c0b6960 con 0x55e66c94d200 2024-09-12T17:13:14.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66caccea0 con 0x55e66c94d200 2024-09-12T17:13:14.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 -- 172.21.15.193:0/3953945227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc33c0ce060 con 0x55e66c94d200 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 0x7fc23003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc236604640 1 -- 172.21.15.193:0/3953945227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc33c0eb140 con 0x55e66c94d200 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc349248640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 0x7fc23003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 0x55e66cad2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cad33b0 con 0x55e66c9dc170 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34a24a640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 0x55e66cad2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc349248640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 0x7fc23003bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc340004180 tx=0x7fc340001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34a24a640 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 0x55e66cad2e70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34a24a640 1 -- 172.21.15.193:0/3953945227 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc34400a4d0 con 0x55e66c9dc170 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.325+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cad3800 con 0x55e66c9dc170 2024-09-12T17:13:14.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34a24a640 1 -- 172.21.15.193:0/3953945227 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc34400a4d0 con 0x55e66c9dc170 2024-09-12T17:13:14.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cad5100 con 0x55e66c9dc170 2024-09-12T17:13:14.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34a24a640 1 -- 172.21.15.193:0/3953945227 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc34400a4d0 con 0x55e66c9dc170 2024-09-12T17:13:14.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cad4330 con 0x55e66c9dc170 2024-09-12T17:13:14.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34a24a640 1 -- 172.21.15.193:0/3953945227 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc34400a4d0 con 0x55e66c9dc170 2024-09-12T17:13:14.333 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cad4780 con 0x55e66c9dc170 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34a24a640 1 -- 172.21.15.193:0/3953945227 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc34400a4d0 con 0x55e66c9dc170 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66c8ee450 con 0x55e66c9d9370 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45430/0 (socket says 172.21.15.193:45430) 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc349248640 1 -- 172.21.15.193:0/3983086020 learned_addr learned my addr 172.21.15.193:0/3983086020 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc349248640 1 -- 172.21.15.193:0/3983086020 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66c9d9890 con 0x55e66c9d9370 2024-09-12T17:13:14.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc349248640 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc34000d660 tx=0x7fc34000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc22f7fe640 1 -- 172.21.15.193:0/3983086020 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc34000c6b0 con 0x55e66c9d9370 2024-09-12T17:13:14.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc22f7fe640 1 -- 172.21.15.193:0/3983086020 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34000c850 con 0x55e66c9d9370 2024-09-12T17:13:14.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66c9d8150 con 0x55e66c9d9370 2024-09-12T17:13:14.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.329+0000 7fc22f7fe640 1 -- 172.21.15.193:0/3983086020 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc34000cb30 con 0x55e66c9d9370 2024-09-12T17:13:14.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66c9d86c0 con 0x55e66c9d9370 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc22f7fe640 1 -- 172.21.15.193:0/3983086020 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc340023020 con 0x55e66c9d9370 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc22f7fe640 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 0x7fc22403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc22f7fe640 1 -- 172.21.15.193:0/3983086020 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc340021020 con 0x55e66c9d9370 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34a24a640 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 0x7fc22403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34a24a640 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 0x7fc22403bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55e66cad3e50 tx=0x7fc344005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34bf439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc34bf439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66cac4f80 con 0x55e66caf3040 2024-09-12T17:13:14.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45436/0 (socket says 172.21.15.193:45436) 2024-09-12T17:13:14.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc349248640 1 -- 172.21.15.193:0/870522652 learned_addr learned my addr 172.21.15.193:0/870522652 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc349248640 1 -- 172.21.15.193:0/870522652 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66caf3a10 con 0x55e66caf3040 2024-09-12T17:13:14.339 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc349248640 1 --2- 172.21.15.193:0/870522652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc340050f50 tx=0x7fc340023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c690d487855229 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.333+0000 7fc22d7fa640 1 -- 172.21.15.193:0/870522652 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340047070 con 0x55e66caf3040 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc22d7fa640 1 -- 172.21.15.193:0/870522652 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc34000cd20 con 0x55e66caf3040 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc22d7fa640 1 -- 172.21.15.193:0/870522652 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc34001bcc0 con 0x55e66caf3040 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/870522652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 msgr2=0x55e66caf3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/870522652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc340050f50 tx=0x7fc340023430 comp rx=0 tx=0).stop 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/870522652 shutdown_connections 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/870522652 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf3420 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/870522652 >> 172.21.15.193:0/870522652 conn(0x55e66caee400 msgr2=0x55e66caec640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/870522652 shutdown_connections 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/870522652 wait complete. 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 Processor -- start 2024-09-12T17:13:14.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- start start 2024-09-12T17:13:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e66caf1f30 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc349248640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45448/0 (socket says 172.21.15.193:45448) 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 learned_addr learned my addr 172.21.15.193:0/829962840 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e66caf9ac0 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc349248640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc340023ad0 tx=0x7fc34004d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc21b7fe640 1 -- 172.21.15.193:0/829962840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340034070 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc21b7fe640 1 -- 172.21.15.193:0/829962840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3400196f0 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc21b7fe640 1 -- 172.21.15.193:0/829962840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc340047030 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e66caf9d50 con 0x55e66caf3040 2024-09-12T17:13:14.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.337+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66caf9d50 con 0x55e66caf3040 2024-09-12T17:13:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc21b7fe640 1 -- 172.21.15.193:0/829962840 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc340052d10 con 0x55e66caf3040 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc21b7fe640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc214039a70 0x7fc21403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc21b7fe640 1 -- 172.21.15.193:0/829962840 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc340005030 con 0x55e66caf3040 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34a24a640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc214039a70 0x7fc21403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66cb046a0 0x55e66cb06b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb07280 con 0x55e66cb046a0 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66cb046a0 0x55e66cb06b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34a24a640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc214039a70 0x7fc21403bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e66cacde60 tx=0x7fc34401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66cb046a0 0x55e66cb06b30 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 realm 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb07690 con 0x55e66cb046a0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb07f60 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb08300 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb087a0 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:14.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 20 searching for the correct realm 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66cb0a710 0x55e66cb0cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0d180 con 0x55e66cb0a710 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.341+0000 7fc349248640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66cb0a710 0x55e66cb0cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349248640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66cb0a710 0x55e66cb0cb00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349248640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fc340039070 0x7fc340052520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc34a24a640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fc340039070 0x7fc340052520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc34a24a640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fc340039070 0x7fc340052520 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc34a24a640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fc344031040 0x7fc344032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fc344031040 0x7fc344032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fc344031040 0x7fc344032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.345+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.349+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.353+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb0a710 2024-09-12T17:13:14.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc344031040 2024-09-12T17:13:14.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x55e66cb046a0 2024-09-12T17:13:14.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc34005b040 con 0x7fc340039070 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc34401f070 con 0x7fc340039070 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb091b0 con 0x55e66cb046a0 2024-09-12T17:13:14.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb09a50 con 0x55e66cb046a0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb08df0 con 0x55e66cb046a0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 zone default found 2024-09-12T17:13:14.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 4 Realm: () 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 zonegroup default 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.357+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0d5e0 con 0x7fc344031040 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0f480 con 0x55e66cb0a710 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0f820 con 0x55e66cb0a710 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 started sync module instance, tier type = 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0e8c0 con 0x7fc340039070 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94448154373296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0f0d0 con 0x7fc340039070 2024-09-12T17:13:14.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.361+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb10580 con 0x55e66cb046a0 2024-09-12T17:13:14.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94448154373296] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94448154377152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb10970 con 0x55e66cb046a0 2024-09-12T17:13:14.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb11330 con 0x55e66cb0a710 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94448154381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb11bd0 con 0x55e66cb0a710 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.365+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12590 con 0x7fc340039070 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94448154377152] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94448154378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12590 con 0x7fc340039070 2024-09-12T17:13:14.371 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12f50 con 0x55e66cb046a0 2024-09-12T17:13:14.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94448154381952] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94448154378208] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94448154389152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12590 con 0x55e66cb046a0 2024-09-12T17:13:14.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.369+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12ec0 con 0x7fc344031040 2024-09-12T17:13:14.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94448154389152] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94448154386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12500 con 0x7fc344031040 2024-09-12T17:13:14.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb13dc0 con 0x7fc344031040 2024-09-12T17:13:14.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94448154386656] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94448154391280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb13dc0 con 0x7fc344031040 2024-09-12T17:13:14.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.373+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb14780 con 0x7fc344031040 2024-09-12T17:13:14.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94448154395344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb14ba0 con 0x7fc344031040 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=0 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=1 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=2 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=3 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=4 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=5 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94448154391280] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=6 2024-09-12T17:13:14.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94448154395344] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 20 add_watcher() i=7 2024-09-12T17:13:14.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:14.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.377+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb14ba0 con 0x55e66cb046a0 2024-09-12T17:13:14.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94448154396400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb14b10 con 0x55e66cb046a0 2024-09-12T17:13:14.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94448154396400] v34'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc1fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:14.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:14.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 5 note: GC not initialized 2024-09-12T17:13:14.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc1fa7fc640 20 reqs_thread_entry: start 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 Filter name: none 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc16bfff640 20 reqs_thread_entry: start 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb3a930 con 0x55e66cb046a0 2024-09-12T17:13:14.386 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:13:14.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.381+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb3beb0 con 0x7fc344031040 2024-09-12T17:13:14.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc1fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94448154396400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb15050 con 0x55e66cb046a0 2024-09-12T17:13:14.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94448154396400] v34'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94448154373296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb146f0 con 0x7fc340039070 2024-09-12T17:13:14.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.385+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94448154373296] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc34bf439c0 20 remove_watcher() i=0 2024-09-12T17:13:14.390 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc34bf439c0 2 removed watcher, disabling cache 2024-09-12T17:13:14.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94448154377152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb146f0 con 0x55e66cb046a0 2024-09-12T17:13:14.392 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94448154377152] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc34bf439c0 20 remove_watcher() i=1 2024-09-12T17:13:14.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.389+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94448154381952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb0fbc0 con 0x55e66cb0a710 2024-09-12T17:13:14.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc349248640 1 -- 172.21.15.193:0/829962840 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94448154381952] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc340036030 con 0x55e66cb0a710 2024-09-12T17:13:14.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 20 remove_watcher() i=2 2024-09-12T17:13:14.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94448154378208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb146f0 con 0x7fc340039070 2024-09-12T17:13:14.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34a24a640 1 -- 172.21.15.193:0/829962840 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94448154378208] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc344040040 con 0x7fc340039070 2024-09-12T17:13:14.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 20 remove_watcher() i=3 2024-09-12T17:13:14.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94448154389152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb10e80 con 0x55e66cb046a0 2024-09-12T17:13:14.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94448154389152] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x55e66cb046a0 2024-09-12T17:13:14.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 20 remove_watcher() i=4 2024-09-12T17:13:14.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.393+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94448154386656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb146f0 con 0x7fc344031040 2024-09-12T17:13:14.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.397+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94448154386656] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.397+0000 7fc34bf439c0 20 remove_watcher() i=5 2024-09-12T17:13:14.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.397+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94448154391280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb12aa0 con 0x7fc344031040 2024-09-12T17:13:14.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94448154391280] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 20 remove_watcher() i=6 2024-09-12T17:13:14.402 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94448154395344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e66cb10e80 con 0x7fc344031040 2024-09-12T17:13:14.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94448154395344] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc33c0a8070 con 0x7fc344031040 2024-09-12T17:13:14.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 20 remove_watcher() i=7 2024-09-12T17:13:14.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fc344031040 msgr2=0x7fc344032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fc344031040 0x7fc344032940 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66cb046a0 msgr2=0x55e66cb06b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66cb046a0 0x55e66cb06b30 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fc340039070 msgr2=0x7fc340052520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fc340039070 0x7fc340052520 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66cb0a710 msgr2=0x55e66cb0cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55e66cb0a710 0x55e66cb0cb00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc214039a70 msgr2=0x7fc21403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc214039a70 0x7fc21403bf30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e66cacde60 tx=0x7fc34401f000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc349a49640 1 -- 172.21.15.193:0/829962840 reap_dead start 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 msgr2=0x55e66caf9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc340023ad0 tx=0x7fc34004d040 comp rx=0 tx=0).stop 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 shutdown_connections 2024-09-12T17:13:14.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/829962840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66caf3040 0x55e66caf9560 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 >> 172.21.15.193:0/829962840 conn(0x55e66caee400 msgr2=0x55e66caec610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 shutdown_connections 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/829962840 wait complete. 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 msgr2=0x7fc22403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 0x7fc22403bf30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55e66cad3e50 tx=0x7fc344005850 comp rx=0 tx=0).stop 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 msgr2=0x55e66c9d7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fc34000d660 tx=0x7fc34000da60 comp rx=0 tx=0).stop 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 shutdown_connections 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc224039a70 0x7fc22403bf30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3983086020 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c9d9370 0x55e66c9d7c10 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 >> 172.21.15.193:0/3983086020 conn(0x55e66cad8dc0 msgr2=0x55e66cad91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 shutdown_connections 2024-09-12T17:13:14.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3983086020 wait complete. 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 msgr2=0x55e66cad2e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 0x55e66cad2e70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 msgr2=0x7fc23003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 0x7fc23003bf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc340004180 tx=0x7fc340001340 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 msgr2=0x55e66cacbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fc33c019930 tx=0x7fc33c018020 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 shutdown_connections 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55e66c9dc170 0x55e66cad2e70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc230039ac0 0x7fc23003bf80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 --2- 172.21.15.193:0/3953945227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e66c94d200 0x55e66cacbd50 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.401+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 >> 172.21.15.193:0/3953945227 conn(0x55e66c9d3920 msgr2=0x55e66cabeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.405+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 shutdown_connections 2024-09-12T17:13:14.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.405+0000 7fc34bf439c0 1 -- 172.21.15.193:0/3953945227 wait complete. 2024-09-12T17:13:14.417 INFO:teuthology.orchestra.run.smithi193.stdout:{"entries":[],"summary":[]} 2024-09-12T17:13:14.417 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-12T17:13:14.418 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T17:13:14.418 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-12T17:13:14.418 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-12T17:13:14.493 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:14.493 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:14.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.489+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.489+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250cb869c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ae8e110010 0x55ae8e10eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250cb869c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae8e04d9c0 con 0x55ae8e10fae0 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250cb869c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ae8e09d6d0 con 0x55ae8e110010 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f2509e8b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ae8e110010 0x55ae8e10eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250a68c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ae8e10fae0 0x55ae8e10e480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44274/0 (socket says 172.21.15.193:44274) 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f2509e8b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ae8e110010 0x55ae8e10eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45456/0 (socket says 172.21.15.193:45456) 2024-09-12T17:13:14.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250a68c640 1 -- 172.21.15.193:0/3811340015 learned_addr learned my addr 172.21.15.193:0/3811340015 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:14.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f2509e8b640 1 -- 172.21.15.193:0/3811340015 >> v1:172.21.15.62:6789/0 conn(0x55ae8e10fae0 legacy=0x55ae8e10e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f2509e8b640 1 -- 172.21.15.193:0/3811340015 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e041ca0 con 0x55ae8e110010 2024-09-12T17:13:14.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f2509e8b640 1 --2- 172.21.15.193:0/3811340015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e110010 0x55ae8e10eb90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f250000a480 tx=0x7f250001b220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e099396bd4b05417 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250968a640 1 -- 172.21.15.193:0/3811340015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000af070 con 0x55ae8e110010 2024-09-12T17:13:14.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.493+0000 7f250968a640 1 -- 172.21.15.193:0/3811340015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25000aa570 con 0x55ae8e110010 2024-09-12T17:13:14.498 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250968a640 1 -- 172.21.15.193:0/3811340015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000aa8b0 con 0x55ae8e110010 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 -- 172.21.15.193:0/3811340015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e110010 msgr2=0x55ae8e10eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 --2- 172.21.15.193:0/3811340015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e110010 0x55ae8e10eb90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f250000a480 tx=0x7f250001b220 comp rx=0 tx=0).stop 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 -- 172.21.15.193:0/3811340015 shutdown_connections 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 --2- 172.21.15.193:0/3811340015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e110010 0x55ae8e10eb90 secure :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f250000a480 tx=0x7f250001b220 comp rx=0 tx=0).stop 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 -- 172.21.15.193:0/3811340015 >> 172.21.15.193:0/3811340015 conn(0x55ae8e194ac0 msgr2=0x55ae8e196ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 -- 172.21.15.193:0/3811340015 shutdown_connections 2024-09-12T17:13:14.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.497+0000 7f250cb869c0 1 -- 172.21.15.193:0/3811340015 wait complete. 2024-09-12T17:13:14.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae8e0a1680 con 0x55ae8e10fae0 2024-09-12T17:13:14.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250a68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250a68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45470/0 (socket says 172.21.15.193:45470) 2024-09-12T17:13:14.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250a68c640 1 -- 172.21.15.193:0/1492110174 learned_addr learned my addr 172.21.15.193:0/1492110174 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250a68c640 1 -- 172.21.15.193:0/1492110174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e01cda0 con 0x55ae8e10fae0 2024-09-12T17:13:14.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250a68c640 1 --2- 172.21.15.193:0/1492110174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f24fc001e50 tx=0x7f24fc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4159158b79c92ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f23f8608640 1 -- 172.21.15.193:0/1492110174 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc012020 con 0x55ae8e10fae0 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f23f8608640 1 -- 172.21.15.193:0/1492110174 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc00e7c0 con 0x55ae8e10fae0 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f23f8608640 1 -- 172.21.15.193:0/1492110174 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc00eaa0 con 0x55ae8e10fae0 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- 172.21.15.193:0/1492110174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 msgr2=0x55ae8e286cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1492110174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f24fc001e50 tx=0x7f24fc001e80 comp rx=0 tx=0).stop 2024-09-12T17:13:14.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- 172.21.15.193:0/1492110174 shutdown_connections 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1492110174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e286cf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- 172.21.15.193:0/1492110174 >> 172.21.15.193:0/1492110174 conn(0x55ae8e194ac0 msgr2=0x55ae8e2828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- 172.21.15.193:0/1492110174 shutdown_connections 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- 172.21.15.193:0/1492110174 wait complete. 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.513+0000 7f250cb869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae8e043a50 con 0x55ae8e10fae0 2024-09-12T17:13:14.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250a68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250a68c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45472/0 (socket says 172.21.15.193:45472) 2024-09-12T17:13:14.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250a68c640 1 -- 172.21.15.193:0/471810470 learned_addr learned my addr 172.21.15.193:0/471810470 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250a68c640 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e28e8e0 con 0x55ae8e10fae0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250a68c640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55ae8e287ce0 tx=0x7f24fc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 -- 172.21.15.193:0/471810470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc012030 con 0x55ae8e10fae0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8e28eb70 con 0x55ae8e10fae0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 -- 172.21.15.193:0/471810470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc01a680 con 0x55ae8e10fae0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 -- 172.21.15.193:0/471810470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24fc01a9a0 con 0x55ae8e10fae0 2024-09-12T17:13:14.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8e28f520 con 0x55ae8e10fae0 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 -- 172.21.15.193:0/471810470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f24fc015020 con 0x55ae8e10fae0 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 0x7f23f003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f23f6e05640 1 -- 172.21.15.193:0/471810470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f24fc020070 con 0x55ae8e10fae0 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f2509e8b640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 0x7f23f003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 0x55ae8e2958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e295e10 con 0x55ae8e2934e0 2024-09-12T17:13:14.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.517+0000 7f250ae8d640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 0x55ae8e2958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f2509e8b640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 0x7f23f003bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f25000ac000 tx=0x7f25000a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 0x55ae8e2958d0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 -- 172.21.15.193:0/471810470 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f250400a4d0 con 0x55ae8e2934e0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e296230 con 0x55ae8e2934e0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 -- 172.21.15.193:0/471810470 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f250400a4d0 con 0x55ae8e2934e0 2024-09-12T17:13:14.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e297b30 con 0x55ae8e2934e0 2024-09-12T17:13:14.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 -- 172.21.15.193:0/471810470 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f250400a4d0 con 0x55ae8e2934e0 2024-09-12T17:13:14.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e296c70 con 0x55ae8e2934e0 2024-09-12T17:13:14.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 -- 172.21.15.193:0/471810470 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f250400a4d0 con 0x55ae8e2934e0 2024-09-12T17:13:14.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e297090 con 0x55ae8e2934e0 2024-09-12T17:13:14.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250ae8d640 1 -- 172.21.15.193:0/471810470 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f250400a4d0 con 0x55ae8e2934e0 2024-09-12T17:13:14.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f250cb869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae8e0ae450 con 0x55ae8e2a5e60 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45484/0 (socket says 172.21.15.193:45484) 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f2509e8b640 1 -- 172.21.15.193:0/904763748 learned_addr learned my addr 172.21.15.193:0/904763748 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.521+0000 7f2509e8b640 1 -- 172.21.15.193:0/904763748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e2a68c0 con 0x55ae8e2a5e60 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f2509e8b640 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2500018eb0 tx=0x7f2500018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 -- 172.21.15.193:0/904763748 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000c7070 con 0x55ae8e2a5e60 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 -- 172.21.15.193:0/904763748 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25000b0040 con 0x55ae8e2a5e60 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 -- 172.21.15.193:0/904763748 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000af050 con 0x55ae8e2a5e60 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8e2a7120 con 0x55ae8e2a5e60 2024-09-12T17:13:14.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8e2a7630 con 0x55ae8e2a5e60 2024-09-12T17:13:14.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 -- 172.21.15.193:0/904763748 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f25000ca070 con 0x55ae8e2a5e60 2024-09-12T17:13:14.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 0x7f23e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f23effff640 1 -- 172.21.15.193:0/904763748 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f25000ec560 con 0x55ae8e2a5e60 2024-09-12T17:13:14.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250ae8d640 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 0x7f23e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250ae8d640 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 0x7f23e403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ae8e297010 tx=0x7f2504005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f250cb869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae8e287520 con 0x55ae8e2b3710 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45494/0 (socket says 172.21.15.193:45494) 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.525+0000 7f2509e8b640 1 -- 172.21.15.193:0/1584273653 learned_addr learned my addr 172.21.15.193:0/1584273653 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 -- 172.21.15.193:0/1584273653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e2b4100 con 0x55ae8e2b3710 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 --2- 172.21.15.193:0/1584273653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f25000ea8c0 tx=0x7f25000b6e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7a6ff536b2d4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23edffb640 1 -- 172.21.15.193:0/1584273653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000ca490 con 0x55ae8e2b3710 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23edffb640 1 -- 172.21.15.193:0/1584273653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25000b6480 con 0x55ae8e2b3710 2024-09-12T17:13:14.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23edffb640 1 -- 172.21.15.193:0/1584273653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000ca6e0 con 0x55ae8e2b3710 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1584273653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 msgr2=0x55ae8e2b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1584273653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f25000ea8c0 tx=0x7f25000b6e10 comp rx=0 tx=0).stop 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1584273653 shutdown_connections 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1584273653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b3b10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1584273653 >> 172.21.15.193:0/1584273653 conn(0x55ae8e2aeb30 msgr2=0x55ae8e2acd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1584273653 shutdown_connections 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1584273653 wait complete. 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 Processor -- start 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- start start 2024-09-12T17:13:14.534 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ae8e2b2660 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45496/0 (socket says 172.21.15.193:45496) 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 learned_addr learned my addr 172.21.15.193:0/1092976040 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8e2ba1e0 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f2509e8b640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f25000b5590 tx=0x7f25000ea850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23dbfff640 1 -- 172.21.15.193:0/1092976040 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000e9520 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8e2ba470 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23dbfff640 1 -- 172.21.15.193:0/1092976040 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25000eaa00 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f23dbfff640 1 -- 172.21.15.193:0/1092976040 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25000eace0 con 0x55ae8e2b3710 2024-09-12T17:13:14.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.529+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8e2bae20 con 0x55ae8e2b3710 2024-09-12T17:13:14.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f23dbfff640 1 -- 172.21.15.193:0/1092976040 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f25000b7980 con 0x55ae8e2b3710 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f23dbfff640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23d4039c10 0x7f23d403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f23dbfff640 1 -- 172.21.15.193:0/1092976040 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f25000b82d0 con 0x55ae8e2b3710 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250ae8d640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23d4039c10 0x7f23d403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2c4f40 0x55ae8e2c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c7b50 con 0x55ae8e2c4f40 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2c4f40 0x55ae8e2c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250ae8d640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23d4039c10 0x7f23d403c0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55ae8e296790 tx=0x7f250401f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2c4f40 0x55ae8e2c7400 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc008030 con 0x55ae8e2c4f40 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 realm 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c7f60 con 0x55ae8e2c4f40 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc008030 con 0x55ae8e2c4f40 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c8830 con 0x55ae8e2c4f40 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc008030 con 0x55ae8e2c4f40 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c8bd0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24fc008030 con 0x55ae8e2c4f40 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c9420 con 0x55ae8e2c4f40 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24fc008030 con 0x55ae8e2c4f40 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 20 searching for the correct realm 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ae8e2cb190 0x55ae8e2cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f2509e8b640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ae8e2cb190 0x55ae8e2cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.533+0000 7f2509e8b640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ae8e2cb190 0x55ae8e2cd580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f2509e8b640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f25000cc060 0x7f25000ea280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250ae8d640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f25000cc060 0x7f25000ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250ae8d640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f25000cc060 0x7f25000ea280 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250ae8d640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2504031040 0x7f2504032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2504031040 0x7f2504032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2504031040 0x7f2504032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.537+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.549 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.541+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.545+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2cb190 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f2504031040 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdac0 con 0x7f25000cc060 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f250401f070 con 0x7f25000cc060 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:14.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2c9d60 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ca600 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ca600 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 zone default found 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 4 Realm: () 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 zonegroup default 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cdef0 con 0x7f2504031040 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cf9e0 con 0x55ae8e2cb190 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.549+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cfe20 con 0x55ae8e2cb190 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 20 started sync module instance, tier type = 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ca210 con 0x7f25000cc060 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208197979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d0280 con 0x7f25000cc060 2024-09-12T17:13:14.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d0d40 con 0x55ae8e2c4f40 2024-09-12T17:13:14.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208197979696] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208197986320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d0d00 con 0x55ae8e2c4f40 2024-09-12T17:13:14.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.553+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d1770 con 0x55ae8e2cb190 2024-09-12T17:13:14.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208197986320] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208197989024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d1b60 con 0x55ae8e2cb190 2024-09-12T17:13:14.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d2520 con 0x7f25000cc060 2024-09-12T17:13:14.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208197992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d2bf0 con 0x7f25000cc060 2024-09-12T17:13:14.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.557+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d3710 con 0x55ae8e2c4f40 2024-09-12T17:13:14.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208197989024] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208197992832] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208197997024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d36d0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d3fb0 con 0x7f2504031040 2024-09-12T17:13:14.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.561+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208197997024] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208197980960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d36d0 con 0x7f2504031040 2024-09-12T17:13:14.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d4430 con 0x7f2504031040 2024-09-12T17:13:14.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208197980960] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208197999248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d4360 con 0x7f2504031040 2024-09-12T17:13:14.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.565+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d4e20 con 0x7f2504031040 2024-09-12T17:13:14.570 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208197999248] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208198000304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d42d0 con 0x7f2504031040 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=0 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=1 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=2 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=3 2024-09-12T17:13:14.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=4 2024-09-12T17:13:14.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=5 2024-09-12T17:13:14.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=6 2024-09-12T17:13:14.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208198000304] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 20 add_watcher() i=7 2024-09-12T17:13:14.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:14.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d8300 con 0x55ae8e2c4f40 2024-09-12T17:13:14.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.569+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208198004256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d57c0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208198004256] v34'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f23c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250cb869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:14.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250cb869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:14.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e0bd0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.573+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e0bd0 con 0x7f2504031040 2024-09-12T17:13:14.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e1080 con 0x55ae8e2cb190 2024-09-12T17:13:14.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e16b0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.577+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e16b0 con 0x7f25000cc060 2024-09-12T17:13:14.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.581+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'75 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.581+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e1c20 con 0x55ae8e2cb190 2024-09-12T17:13:14.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.581+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'50 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.585 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.581+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e2000 con 0x55ae8e2c4f40 2024-09-12T17:13:14.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.585+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.587 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.585+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e1fe0 con 0x7f2504031040 2024-09-12T17:13:14.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.585+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.585+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e1fc0 con 0x7f25000cc060 2024-09-12T17:13:14.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e2530 con 0x55ae8e2cb190 2024-09-12T17:13:14.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e28d0 con 0x7f25000cc060 2024-09-12T17:13:14.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'76 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.594 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.589+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e2e40 con 0x7f2504031040 2024-09-12T17:13:14.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.593+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.596 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.593+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e2e40 con 0x7f25000cc060 2024-09-12T17:13:14.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.593+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.593+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f2504031040 2024-09-12T17:13:14.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.597+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.597+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.597+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.597+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f25000cc060 2024-09-12T17:13:14.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'77 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.601+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.605+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.608 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.605+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.605+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.610 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.605+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.609+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.613 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.609+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f25000cc060 2024-09-12T17:13:14.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.609+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.614 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.613+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.613+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.613+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.613+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.618 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.613+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.617+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.619 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.617+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.617+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'51 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.621 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.617+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f2504031040 2024-09-12T17:13:14.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.621+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.624 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.621+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.621+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.626 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.621+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f2504031040 2024-09-12T17:13:14.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.625+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.629 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.625+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.629+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.631 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.629+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f2504031040 2024-09-12T17:13:14.634 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.635 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e32f0 con 0x7f25000cc060 2024-09-12T17:13:14.636 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.637 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f233b7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 20 Filter name: none 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f23397fa640 20 reqs_thread_entry: start 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.633+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2e0480 con 0x55ae8e2c4f40 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=391 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:14.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e3008f0 con 0x7f25000cc060 2024-09-12T17:13:14.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 : miss 2024-09-12T17:13:14.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.640 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:96 8.15 8:a8f9a7e3:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e3008d0 con 0x55ae8e2cb190 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(96 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=387 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 info.flags=0x17 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 adding default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 to cache LRU end 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:14.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 4.28 4:172a3d30:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2c4f40 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 4.31 4:8ddec74c:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2c4f40 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(98 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 4.d 4:b085b7e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2cb190 2024-09-12T17:13:14.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(99 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:100 4.28 4:1461094f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2c4f40 2024-09-12T17:13:14.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(100 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.637+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:101 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2cb190 2024-09-12T17:13:14.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(101 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [call out=430b] v0'0 uv6 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T17:13:14.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:102 4.28 4:150fe845:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2c4f40 2024-09-12T17:13:14.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(102 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 4.2d 4:b5525f33:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x7f2504031040 2024-09-12T17:13:14.644 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(103 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 4.11 4:8a23ab50:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x7f2504031040 2024-09-12T17:13:14.645 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(104 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:105 4.b 4:d13c3bf6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x7f25000cc060 2024-09-12T17:13:14.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(105 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.646 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:106 4.2f 4:f5409aaf:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2c4f40 2024-09-12T17:13:14.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(106 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.641+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:107 4.5 4:a0c4c58e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e160 con 0x55ae8e2cb190 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(107 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 20 get_obj_state: octx=0x7f24fc001590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ae8e37c588 s->prefetch_data=0 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:108 3.3as0 3:5c147dfe:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37d670 con 0x7f25000cc060 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(108 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 10 manifest: total_size = 6 2024-09-12T17:13:14.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 20 get_obj_state: setting s->obj_tag to 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11050277563334593876 2024-09-12T17:13:14.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 20 get_obj_state: octx=0x7f24fc001590 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55ae8e37c588 s->prefetch_data=0 2024-09-12T17:13:14.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 20 prepare_atomic_modification: state is not atomic. state=0x55ae8e37c588 2024-09-12T17:13:14.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 20 bucket index object: :.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 2024-09-12T17:13:14.649 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e1a0 con 0x55ae8e2cb190 2024-09-12T17:13:14.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(109 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.645+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:110 3.3as0 3:5c147dfe:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e37e1a0 con 0x7f25000cc060 2024-09-12T17:13:14.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(110 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e305c50 con 0x55ae8e2cb190 2024-09-12T17:13:14.652 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 20 list_objects_ordered: starting attempt 1 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:112 4.28 4:172a3d30:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e305c50 con 0x55ae8e2c4f40 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:113 4.31 4:8ddec74c:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e309ed0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:114 4.d 4:b085b7e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e30c7b0 con 0x55ae8e2cb190 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:115 4.28 4:1461094f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e305c50 con 0x55ae8e2c4f40 2024-09-12T17:13:14.653 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:116 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e311660 con 0x55ae8e2cb190 2024-09-12T17:13:14.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:117 4.28 4:150fe845:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e314080 con 0x55ae8e2c4f40 2024-09-12T17:13:14.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:118 4.2d 4:b5525f33:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e316e60 con 0x7f2504031040 2024-09-12T17:13:14.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:119 4.11 4:8a23ab50:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x7f2504031040 2024-09-12T17:13:14.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:120 4.b 4:d13c3bf6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31cb10 con 0x7f25000cc060 2024-09-12T17:13:14.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:121 4.2f 4:f5409aaf:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31f750 con 0x55ae8e2c4f40 2024-09-12T17:13:14.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:122 4.5 4:a0c4c58e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31cb10 con 0x55ae8e2cb190 2024-09-12T17:13:14.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(113 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(112 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(115 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(120 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(114 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(122 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(111 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f23edffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(121 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(117 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(116 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(118 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.649+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(119 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7])"; uploads.size()=0; is_truncated=0 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:123 4.28 4:172a3d30:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2c4f40 2024-09-12T17:13:14.662 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:124 4.31 4:8ddec74c:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319500 con 0x55ae8e2c4f40 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:125 4.d 4:b085b7e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31f750 con 0x55ae8e2cb190 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:126 4.28 4:1461094f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e305700 con 0x55ae8e2c4f40 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:127 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2cb190 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:128 4.28 4:150fe845:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e321c40 con 0x55ae8e2c4f40 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:129 4.2d 4:b5525f33:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319500 con 0x7f2504031040 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:130 4.11 4:8a23ab50:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31f750 con 0x7f2504031040 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:131 4.b 4:d13c3bf6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e305700 con 0x7f25000cc060 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:132 4.2f 4:f5409aaf:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e321c40 con 0x55ae8e2c4f40 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:133 4.5 4:a0c4c58e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2cb190 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(131 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(129 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(125 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(127 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [call out=128b] v0'0 uv8 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(124 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(123 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(132 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(126 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3 [call out=89b] v0'0 uv4 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(133 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(128 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(130 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x7f25000cc060 2024-09-12T17:13:14.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x7f25000cc060 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 20 rados_obj.operate() r=0 bl.length=165 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.653+0000 7f250cb869c0 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x7f25000cc060 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250cb869c0 10 removing default.rgw.meta+root+myfoo from cache 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94208198286480 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31f190 con 0x7f2504031040 2024-09-12T17:13:14.668 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== watch-notify(notify (1) cookie 94208197999248 notify 146028888092 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55ae8e2e28d0 con 0x7f2504031040 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(137 notify.6 [notify cookie 94208198286480 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f23ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94208197999248 notifier 4783 bl.length()=149 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f23ed7fa640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23400032d0 con 0x7f2504031040 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.657+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== watch-notify(notify_complete (2) cookie 94208198286480 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e2da210 con 0x7f2504031040 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:139 8.15 8:a8f9a7e3:root::.bucket.meta.myfoo%3a51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2cb190 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(139 .bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 10 removing default.rgw.meta+root+.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 from cache 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7, ofs0, ns] 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94208198204128 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2c4f40 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== watch-notify(notify (1) cookie 94208197986320 notify 146028888107 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55ae8e2da210 con 0x55ae8e2c4f40 2024-09-12T17:13:14.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f23ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94208197986320 notifier 4783 bl.length()=206 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f23ed7fa640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23400032d0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(140 notify.1 [notify cookie 94208198204128 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== watch-notify(notify_complete (2) cookie 94208198204128 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e28f520 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:142 4.28 4:172a3d30:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:143 4.31 4:8ddec74c:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff3f0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:144 4.d 4:b085b7e5:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31a1b0 con 0x55ae8e2cb190 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:145 4.28 4:1461094f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2c4f40 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:146 4.d 4:b0f4200f:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff3f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:147 4.28 4:150fe845:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x55ae8e2c4f40 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:148 4.2d 4:b5525f33:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31a1b0 con 0x7f2504031040 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:149 4.11 4:8a23ab50:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff3f0 con 0x7f2504031040 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:150 4.b 4:d13c3bf6:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c90 con 0x7f25000cc060 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:151 4.2f 4:f5409aaf:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e31a1b0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.661+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:152 4.5 4:a0c4c58e:::.dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff3f0 con 0x55ae8e2cb190 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(142 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.0 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 50 ==== osd_op_reply(143 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.1 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(149 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(148 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.6 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(150 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(144 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.2 [delete] v34'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(152 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.10 [delete] v34'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(146 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.4 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 51 ==== osd_op_reply(151 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.9 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 52 ==== osd_op_reply(145 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.3 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 53 ==== osd_op_reply(147 .dir.51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7.5 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 : miss 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:153 6.3 6:c6bb60bd:::pubsub..bucket.myfoo%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c20 con 0x7f25000cc060 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(153 pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 info.flags=0x0 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 10 adding default.rgw.log++pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 to cache LRU end 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.665+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:154 6.3 6:c6bb60bd:::pubsub..bucket.myfoo%2f51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319c20 con 0x7f25000cc060 2024-09-12T17:13:14.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.669+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(154 pubsub..bucket.myfoo/51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.7 [delete] v34'78 uv56 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.669+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x7f25000cc060 2024-09-12T17:13:14.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.669+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.669+0000 7f250cb869c0 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-12T17:13:14.675 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.669+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x7f2504031040 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94208198286272 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff8e0 con 0x7f25000cc060 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== watch-notify(notify (1) cookie 94208197992832 notify 146028888085 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55ae8e2e0cc0 con 0x7f25000cc060 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f23edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94208197992832 notifier 4783 bl.length()=170 2024-09-12T17:13:14.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(157 notify.3 [notify cookie 94208198286272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f23edffb640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23d0003d70 con 0x7f25000cc060 2024-09-12T17:13:14.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== watch-notify(notify_complete (2) cookie 94208198286272 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e2e2c70 con 0x7f25000cc060 2024-09-12T17:13:14.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250cb869c0 10 removing email index: foo@foo.com 2024-09-12T17:13:14.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.673+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 54 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94208198286272 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff8e0 con 0x7f25000cc060 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== watch-notify(notify (1) cookie 94208197992832 notify 146028888086 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55ae8e2e2c70 con 0x7f25000cc060 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f23ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94208197992832 notifier 4783 bl.length()=162 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(160 notify.3 [notify cookie 94208198286272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f23ed7fa640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23400032d0 con 0x7f25000cc060 2024-09-12T17:13:14.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 38 ==== watch-notify(notify_complete (2) cookie 94208198286272 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e2e16b0 con 0x7f25000cc060 2024-09-12T17:13:14.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250cb869c0 10 removing user buckets index 2024-09-12T17:13:14.681 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.677+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x7f25000cc060 2024-09-12T17:13:14.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 39 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-12T17:13:14.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94208198286272 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff8e0 con 0x7f2504031040 2024-09-12T17:13:14.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== watch-notify(notify (1) cookie 94208197980960 notify 146028888093 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ae8e28f520 con 0x7f2504031040 2024-09-12T17:13:14.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f23edffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94208197980960 notifier 4783 bl.length()=160 2024-09-12T17:13:14.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f23edffb640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23d0003d70 con 0x7f2504031040 2024-09-12T17:13:14.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(163 notify.5 [notify cookie 94208198286272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== watch-notify(notify_complete (2) cookie 94208198286272 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e28eb70 con 0x7f2504031040 2024-09-12T17:13:14.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250cb869c0 10 removing user index: foo 2024-09-12T17:13:14.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.681+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff8e0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 55 ==== osd_op_reply(165 foo [call,call,delete] v34'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250cb869c0 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250cb869c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94208198286272 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2ff8e0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 56 ==== watch-notify(notify (1) cookie 94208197997024 notify 146028888108 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55ae8e28eb70 con 0x55ae8e2c4f40 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f23ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 94208197997024 notifier 4783 bl.length()=152 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f23ed7fa640 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f23400032b0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 57 ==== osd_op_reply(166 notify.4 [notify cookie 94208198286272 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 58 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 59 ==== watch-notify(notify_complete (2) cookie 94208198286272 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ae8e28e8e0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f23c0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.685+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208198004256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 60 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94208198004256] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208197979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x7f25000cc060 2024-09-12T17:13:14.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 40 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94208197979696] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250cb869c0 20 remove_watcher() i=0 2024-09-12T17:13:14.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250cb869c0 2 removed watcher, disabling cache 2024-09-12T17:13:14.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.689+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208197986320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cee30 con 0x55ae8e2c4f40 2024-09-12T17:13:14.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 61 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94208197986320] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f250cb869c0 20 remove_watcher() i=1 2024-09-12T17:13:14.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208197989024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x55ae8e2cb190 2024-09-12T17:13:14.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f2509e8b640 1 -- 172.21.15.193:0/1092976040 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94208197989024] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25000c9030 con 0x55ae8e2cb190 2024-09-12T17:13:14.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f250cb869c0 20 remove_watcher() i=2 2024-09-12T17:13:14.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.693+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208197992832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cee30 con 0x7f25000cc060 2024-09-12T17:13:14.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.697+0000 7f250ae8d640 1 -- 172.21.15.193:0/1092976040 <== osd.2 v2:172.21.15.193:6800/1491583795 41 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94208197992832] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2504040040 con 0x7f25000cc060 2024-09-12T17:13:14.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.697+0000 7f250cb869c0 20 remove_watcher() i=3 2024-09-12T17:13:14.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.697+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208197997024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d12a0 con 0x55ae8e2c4f40 2024-09-12T17:13:14.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.697+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.1 v2:172.21.15.193:6808/1040547927 62 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94208197997024] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x55ae8e2c4f40 2024-09-12T17:13:14.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.701+0000 7f250cb869c0 20 remove_watcher() i=4 2024-09-12T17:13:14.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.701+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208197980960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e319bc0 con 0x7f2504031040 2024-09-12T17:13:14.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.701+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94208197980960] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.701+0000 7f250cb869c0 20 remove_watcher() i=5 2024-09-12T17:13:14.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.701+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208197999248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2d2180 con 0x7f2504031040 2024-09-12T17:13:14.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94208197999248] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 20 remove_watcher() i=6 2024-09-12T17:13:14.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208198000304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ae8e2cee30 con 0x7f2504031040 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94208198000304] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24fc04c040 con 0x7f2504031040 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 20 remove_watcher() i=7 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2504031040 msgr2=0x7f2504032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f2504031040 0x7f2504032940 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2c4f40 msgr2=0x55ae8e2c7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2c4f40 0x55ae8e2c7400 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f25000cc060 msgr2=0x7f25000ea280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f25000cc060 0x7f25000ea280 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ae8e2cb190 msgr2=0x55ae8e2cd580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ae8e2cb190 0x55ae8e2cd580 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23d4039c10 msgr2=0x7f23d403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23d4039c10 0x7f23d403c0d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55ae8e296790 tx=0x7f250401f000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 msgr2=0x55ae8e2b9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f25000b5590 tx=0x7f25000ea850 comp rx=0 tx=0).stop 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250a68c640 1 -- 172.21.15.193:0/1092976040 reap_dead start 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 shutdown_connections 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/1092976040 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2b3710 0x55ae8e2b9c80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 >> 172.21.15.193:0/1092976040 conn(0x55ae8e2aeb30 msgr2=0x55ae8e2acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 shutdown_connections 2024-09-12T17:13:14.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/1092976040 wait complete. 2024-09-12T17:13:14.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 msgr2=0x7f23e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 0x7f23e403bf30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55ae8e297010 tx=0x7f2504005850 comp rx=0 tx=0).stop 2024-09-12T17:13:14.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 msgr2=0x55ae8e2a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2500018eb0 tx=0x7f2500018020 comp rx=0 tx=0).stop 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 shutdown_connections 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23e4039a70 0x7f23e403bf30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.705+0000 7f250cb869c0 1 --2- 172.21.15.193:0/904763748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e2a5e60 0x55ae8e2a6280 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 >> 172.21.15.193:0/904763748 conn(0x55ae8e29b810 msgr2=0x55ae8e29bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 shutdown_connections 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/904763748 wait complete. 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 msgr2=0x55ae8e2958d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 0x55ae8e2958d0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 msgr2=0x7f23f003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 0x7f23f003bf30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f25000ac000 tx=0x7f25000a5000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 msgr2=0x55ae8e28e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x55ae8e287ce0 tx=0x7f24fc000ee0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 shutdown_connections 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ae8e2934e0 0x55ae8e2958d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f23f0039a70 0x7f23f003bf30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 --2- 172.21.15.193:0/471810470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ae8e10fae0 0x55ae8e28e380 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 >> 172.21.15.193:0/471810470 conn(0x55ae8e194ac0 msgr2=0x55ae8e281380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 shutdown_connections 2024-09-12T17:13:14.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.709+0000 7f250cb869c0 1 -- 172.21.15.193:0/471810470 wait complete. 2024-09-12T17:13:14.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-12T17:13:14.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-12T17:13:14.724 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-12T17:13:14.800 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:14.800 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:14.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8256ae19c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ea97e35350 0x55ea97e37740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8256ae19c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ea97ce39c0 con 0x55ea97e31200 2024-09-12T17:13:14.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8256ae19c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55ea97d336d0 con 0x55ea97e35350 2024-09-12T17:13:14.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8253de6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55ea97e35350 0x55ea97e37740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f82545e7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55ea97e31200 0x55ea97e315e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44290/0 (socket says 172.21.15.193:44290) 2024-09-12T17:13:14.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f82545e7640 1 -- 172.21.15.193:0/3750308554 learned_addr learned my addr 172.21.15.193:0/3750308554 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:14.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8253de6640 1 -- 172.21.15.193:0/3750308554 >> v1:172.21.15.62:6789/0 conn(0x55ea97e31200 legacy=0x55ea97e315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.797+0000 7f8253de6640 1 -- 172.21.15.193:0/3750308554 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97cd7ca0 con 0x55ea97e35350 2024-09-12T17:13:14.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8253de6640 1 --2- 172.21.15.193:0/3750308554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e35350 0x55ea97e37740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f824800a480 tx=0x7f824801b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c208fc10afb185b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f82535e5640 1 -- 172.21.15.193:0/3750308554 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480aa570 con 0x55ea97e35350 2024-09-12T17:13:14.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f82535e5640 1 -- 172.21.15.193:0/3750308554 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82480af070 con 0x55ea97e35350 2024-09-12T17:13:14.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f82535e5640 1 -- 172.21.15.193:0/3750308554 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480aa860 con 0x55ea97e35350 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3750308554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e35350 msgr2=0x55ea97e37740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3750308554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e35350 0x55ea97e37740 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f824800a480 tx=0x7f824801b310 comp rx=0 tx=0).stop 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3750308554 shutdown_connections 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3750308554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e35350 0x55ea97e37740 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3750308554 >> 172.21.15.193:0/3750308554 conn(0x55ea97da4b10 msgr2=0x55ea97da4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3750308554 shutdown_connections 2024-09-12T17:13:14.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.801+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3750308554 wait complete. 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.817+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.817+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.817+0000 7f8256ae19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.817+0000 7f8256ae19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea97d37680 con 0x55ea97e31200 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.817+0000 7f82545e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45508/0 (socket says 172.21.15.193:45508) 2024-09-12T17:13:14.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 -- 172.21.15.193:0/496319113 learned_addr learned my addr 172.21.15.193:0/496319113 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 -- 172.21.15.193:0/496319113 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97cb2da0 con 0x55ea97e31200 2024-09-12T17:13:14.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 --2- 172.21.15.193:0/496319113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8244001e00 tx=0x7f824400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3665d7d156e15228 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f814260c640 1 -- 172.21.15.193:0/496319113 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8244012020 con 0x55ea97e31200 2024-09-12T17:13:14.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f814260c640 1 -- 172.21.15.193:0/496319113 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824400e690 con 0x55ea97e31200 2024-09-12T17:13:14.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f814260c640 1 -- 172.21.15.193:0/496319113 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824400ea10 con 0x55ea97e31200 2024-09-12T17:13:14.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- 172.21.15.193:0/496319113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 msgr2=0x55ea97f1c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/496319113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8244001e00 tx=0x7f824400b6d0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- 172.21.15.193:0/496319113 shutdown_connections 2024-09-12T17:13:14.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/496319113 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f1c8a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- 172.21.15.193:0/496319113 >> 172.21.15.193:0/496319113 conn(0x55ea97da4b10 msgr2=0x55ea97f184e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- 172.21.15.193:0/496319113 shutdown_connections 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- 172.21.15.193:0/496319113 wait complete. 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f8256ae19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea97cd9a50 con 0x55ea97e31200 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45524/0 (socket says 172.21.15.193:45524) 2024-09-12T17:13:14.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 -- 172.21.15.193:0/3675297146 learned_addr learned my addr 172.21.15.193:0/3675297146 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.821+0000 7f82545e7640 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97f244a0 con 0x55ea97e31200 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f82545e7640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55ea97f1d830 tx=0x7f8244000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 -- 172.21.15.193:0/3675297146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8244012030 con 0x55ea97e31200 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea97f24730 con 0x55ea97e31200 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 -- 172.21.15.193:0/3675297146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824401a750 con 0x55ea97e31200 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea97f250e0 con 0x55ea97e31200 2024-09-12T17:13:14.828 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 -- 172.21.15.193:0/3675297146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f824401aa30 con 0x55ea97e31200 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 -- 172.21.15.193:0/3675297146 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8244015020 con 0x55ea97e31200 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 0x7f813c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8140e09640 1 -- 172.21.15.193:0/3675297146 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8244020030 con 0x55ea97e31200 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8253de6640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 0x7f813c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 0x55ea97f2b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f2b5f0 con 0x55ea97e35350 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8254de8640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 0x55ea97f2b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8253de6640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 0x7f813c03bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82480ae000 tx=0x7f82480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8254de8640 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 0x55ea97f2b0b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8254de8640 1 -- 172.21.15.193:0/3675297146 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f824c00a4d0 con 0x55ea97e35350 2024-09-12T17:13:14.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f2b9b0 con 0x55ea97e35350 2024-09-12T17:13:14.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8254de8640 1 -- 172.21.15.193:0/3675297146 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f824c00a4d0 con 0x55ea97e35350 2024-09-12T17:13:14.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f2d2b0 con 0x55ea97e35350 2024-09-12T17:13:14.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8254de8640 1 -- 172.21.15.193:0/3675297146 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f824c00a4d0 con 0x55ea97e35350 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.825+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f2c4b0 con 0x55ea97e35350 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8254de8640 1 -- 172.21.15.193:0/3675297146 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f824c00a4d0 con 0x55ea97e35350 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f2c900 con 0x55ea97e35350 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8254de8640 1 -- 172.21.15.193:0/3675297146 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f824c00a4d0 con 0x55ea97e35350 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea97d44450 con 0x55ea97f3b600 2024-09-12T17:13:14.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45534/0 (socket says 172.21.15.193:45534) 2024-09-12T17:13:14.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8253de6640 1 -- 172.21.15.193:0/163489907 learned_addr learned my addr 172.21.15.193:0/163489907 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8253de6640 1 -- 172.21.15.193:0/163489907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97f3c060 con 0x55ea97f3b600 2024-09-12T17:13:14.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8253de6640 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8248000c10 tx=0x7f82480180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8139ffb640 1 -- 172.21.15.193:0/163489907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480c5030 con 0x55ea97f3b600 2024-09-12T17:13:14.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea97f3c8c0 con 0x55ea97f3b600 2024-09-12T17:13:14.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8139ffb640 1 -- 172.21.15.193:0/163489907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82480b5950 con 0x55ea97f3b600 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8139ffb640 1 -- 172.21.15.193:0/163489907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480b5c50 con 0x55ea97f3b600 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.829+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea97f3ce30 con 0x55ea97f3b600 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8139ffb640 1 -- 172.21.15.193:0/163489907 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f82480c8030 con 0x55ea97f3b600 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8139ffb640 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 0x7f812c03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8139ffb640 1 -- 172.21.15.193:0/163489907 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f82480c6070 con 0x55ea97f3b600 2024-09-12T17:13:14.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8254de8640 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 0x7f812c03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8254de8640 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 0x7f812c03bf80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55ea97f2bfd0 tx=0x7f824c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea97f1d0f0 con 0x55ea97f48e90 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45548/0 (socket says 172.21.15.193:45548) 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8253de6640 1 -- 172.21.15.193:0/2359581375 learned_addr learned my addr 172.21.15.193:0/2359581375 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8253de6640 1 -- 172.21.15.193:0/2359581375 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97f49860 con 0x55ea97f48e90 2024-09-12T17:13:14.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8253de6640 1 --2- 172.21.15.193:0/2359581375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f82480eb760 tx=0x7f82480b5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeceb8e0d0605b22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f81337fe640 1 -- 172.21.15.193:0/2359581375 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480d8070 con 0x55ea97f48e90 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f81337fe640 1 -- 172.21.15.193:0/2359581375 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8248006390 con 0x55ea97f48e90 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f81337fe640 1 -- 172.21.15.193:0/2359581375 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480c1440 con 0x55ea97f48e90 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- 172.21.15.193:0/2359581375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 msgr2=0x55ea97f49270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/2359581375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f82480eb760 tx=0x7f82480b5f60 comp rx=0 tx=0).stop 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- 172.21.15.193:0/2359581375 shutdown_connections 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/2359581375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f49270 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- 172.21.15.193:0/2359581375 >> 172.21.15.193:0/2359581375 conn(0x55ea97f44250 msgr2=0x55ea97f42490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- 172.21.15.193:0/2359581375 shutdown_connections 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.833+0000 7f8256ae19c0 1 -- 172.21.15.193:0/2359581375 wait complete. 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 Processor -- start 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 -- start start 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f4f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55ea97f47d80 con 0x55ea97f48e90 2024-09-12T17:13:14.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f4f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8253de6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f4f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45556/0 (socket says 172.21.15.193:45556) 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 learned_addr learned my addr 172.21.15.193:0/3845318530 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea97f4f8e0 con 0x55ea97f48e90 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8253de6640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f4f380 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8248006fc0 tx=0x7f82480eb6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8131ffb640 1 -- 172.21.15.193:0/3845318530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480f2070 con 0x55ea97f48e90 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8131ffb640 1 -- 172.21.15.193:0/3845318530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82480eba80 con 0x55ea97f48e90 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea97f4fb70 con 0x55ea97f48e90 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8131ffb640 1 -- 172.21.15.193:0/3845318530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82480ebd60 con 0x55ea97f48e90 2024-09-12T17:13:14.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea97f50520 con 0x55ea97f48e90 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.837+0000 7f8131ffb640 1 -- 172.21.15.193:0/3845318530 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f82480f5070 con 0x55ea97f48e90 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8131ffb640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8124039ac0 0x7f812403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8131ffb640 1 -- 172.21.15.193:0/3845318530 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f82480e7030 con 0x55ea97f48e90 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8254de8640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8124039ac0 0x7f812403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97f5a630 0x55ea97f5caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5d1f0 con 0x55ea97f5a630 2024-09-12T17:13:14.844 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97f5a630 0x55ea97f5caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8254de8640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8124039ac0 0x7f812403bf80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ea97f26020 tx=0x7f824c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97f5a630 0x55ea97f5caa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 realm 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5d650 con 0x55ea97f5a630 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5df20 con 0x55ea97f5a630 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5e2c0 con 0x55ea97f5a630 2024-09-12T17:13:14.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5e760 con 0x55ea97f5a630 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 20 searching for the correct realm 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea97f606d0 0x55ea97f62ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8253de6640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea97f606d0 0x55ea97f62ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8253de6640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea97f606d0 0x55ea97f62ac0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8253de6640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f82480f7060 0x7f82480f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8254de8640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f82480f7060 0x7f82480f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.841+0000 7f8254de8640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f82480f7060 0x7f82480f69d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f8254de8640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f824c031040 0x7f824c032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f824c031040 0x7f824c032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f824c031040 0x7f824c032430 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.845+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.849+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f606d0 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.853+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f824c031040 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.864 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x55ea97f5a630 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f630f0 con 0x7f82480f7060 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f824c01f070 con 0x7f82480f7060 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5f1a0 con 0x55ea97f5a630 2024-09-12T17:13:14.865 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5fa40 con 0x55ea97f5a630 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5ede0 con 0x55ea97f5a630 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 zone default found 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 4 Realm: () 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:14.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 zonegroup default 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f5fa40 con 0x7f824c031040 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f64f60 con 0x55ea97f606d0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f65300 con 0x55ea97f606d0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 started sync module instance, tier type = 2024-09-12T17:13:14.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:14.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.857+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f64400 con 0x7f82480f7060 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94466060208160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f65ba0 con 0x7f82480f7060 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f663f0 con 0x55ea97f5a630 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94466060208160] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94466060211952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f66080 con 0x55ea97f5a630 2024-09-12T17:13:14.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.861+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f66ba0 con 0x55ea97f606d0 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94466060211952] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94466060215920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f66f90 con 0x55ea97f606d0 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f67950 con 0x7f82480f7060 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94466060219824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f68060 con 0x7f82480f7060 2024-09-12T17:13:14.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.865+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f68b80 con 0x55ea97f5a630 2024-09-12T17:13:14.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94466060215920] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94466060219824] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94466060224080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f68b40 con 0x55ea97f5a630 2024-09-12T17:13:14.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f69420 con 0x7f824c031040 2024-09-12T17:13:14.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94466060224080] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94466060213008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f68ff0 con 0x7f824c031040 2024-09-12T17:13:14.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.869+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f698c0 con 0x7f824c031040 2024-09-12T17:13:14.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.873+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94466060213008] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.873+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.873+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94466060225344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f69aa0 con 0x7f824c031040 2024-09-12T17:13:14.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.873+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f6a2f0 con 0x7f824c031040 2024-09-12T17:13:14.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94466060225344] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94466060229280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f6a370 con 0x7f824c031040 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=0 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=1 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=2 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=3 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=4 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=5 2024-09-12T17:13:14.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=6 2024-09-12T17:13:14.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94466060229280] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 20 add_watcher() i=7 2024-09-12T17:13:14.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:14.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f6d630 con 0x55ea97f5a630 2024-09-12T17:13:14.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.877+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94466060230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f6a900 con 0x55ea97f5a630 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94466060230704] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f810a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 5 note: GC not initialized 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f81097e2640 20 reqs_thread_entry: start 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 Filter name: none 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f807affd640 20 reqs_thread_entry: start 2024-09-12T17:13:14.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:14.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f90420 con 0x55ea97f5a630 2024-09-12T17:13:14.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:14.885 INFO:teuthology.orchestra.run.smithi193.stderr:could not fetch user info: no user info saved 2024-09-12T17:13:14.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f810a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:14.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.881+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94466060230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f903e0 con 0x55ea97f5a630 2024-09-12T17:13:14.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94466060230704] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94466060208160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f903e0 con 0x7f82480f7060 2024-09-12T17:13:14.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94466060208160] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 20 remove_watcher() i=0 2024-09-12T17:13:14.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 2 removed watcher, disabling cache 2024-09-12T17:13:14.888 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94466060211952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f903e0 con 0x55ea97f5a630 2024-09-12T17:13:14.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94466060211952] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 20 remove_watcher() i=1 2024-09-12T17:13:14.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.885+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94466060215920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f903e0 con 0x55ea97f606d0 2024-09-12T17:13:14.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8253de6640 1 -- 172.21.15.193:0/3845318530 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94466060215920] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82480f4030 con 0x55ea97f606d0 2024-09-12T17:13:14.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8256ae19c0 20 remove_watcher() i=2 2024-09-12T17:13:14.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94466060219824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f64820 con 0x7f82480f7060 2024-09-12T17:13:14.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8254de8640 1 -- 172.21.15.193:0/3845318530 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94466060219824] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f824c040040 con 0x7f82480f7060 2024-09-12T17:13:14.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8256ae19c0 20 remove_watcher() i=3 2024-09-12T17:13:14.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.889+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94466060224080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f656f0 con 0x55ea97f5a630 2024-09-12T17:13:14.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94466060224080] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x55ea97f5a630 2024-09-12T17:13:14.895 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f8256ae19c0 20 remove_watcher() i=4 2024-09-12T17:13:14.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94466060213008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f64820 con 0x7f824c031040 2024-09-12T17:13:14.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94466060213008] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f8256ae19c0 20 remove_watcher() i=5 2024-09-12T17:13:14.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.893+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94466060225344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f64820 con 0x7f824c031040 2024-09-12T17:13:14.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94466060225344] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 20 remove_watcher() i=6 2024-09-12T17:13:14.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94466060229280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ea97f68b40 con 0x7f824c031040 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94466060229280] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8244008030 con 0x7f824c031040 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 20 remove_watcher() i=7 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f824c031040 msgr2=0x7f824c032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f824c031040 0x7f824c032430 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97f5a630 msgr2=0x55ea97f5caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97f5a630 0x55ea97f5caa0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f82480f7060 msgr2=0x7f82480f69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f82480f7060 0x7f82480f69d0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea97f606d0 msgr2=0x55ea97f62ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55ea97f606d0 0x55ea97f62ac0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8124039ac0 msgr2=0x7f812403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8124039ac0 0x7f812403bf80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ea97f26020 tx=0x7f824c01f000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 msgr2=0x55ea97f4f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3845318530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f48e90 0x55ea97f4f380 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8248006fc0 tx=0x7f82480eb6c0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 reap_dead start 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f82545e7640 1 -- 172.21.15.193:0/3845318530 reap_dead start 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 shutdown_connections 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 >> 172.21.15.193:0/3845318530 conn(0x55ea97f44250 msgr2=0x55ea97f42460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.897+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 shutdown_connections 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3845318530 wait complete. 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 msgr2=0x7f812c03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 0x7f812c03bf80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x55ea97f2bfd0 tx=0x7f824c005850 comp rx=0 tx=0).stop 2024-09-12T17:13:14.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 msgr2=0x55ea97f3ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8248000c10 tx=0x7f82480180b0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 shutdown_connections 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f812c039ac0 0x7f812c03bf80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/163489907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97f3b600 0x55ea97f3ba20 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 >> 172.21.15.193:0/163489907 conn(0x55ea97f30fb0 msgr2=0x55ea97f31390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 shutdown_connections 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/163489907 wait complete. 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 msgr2=0x55ea97f2b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 0x55ea97f2b0b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 msgr2=0x7f813c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 0x7f813c03bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82480ae000 tx=0x7f82480a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 msgr2=0x55ea97f23f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:14.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x55ea97f1d830 tx=0x7f8244000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 shutdown_connections 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55ea97e35350 0x55ea97f2b0b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f813c039a70 0x7f813c03bf30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 --2- 172.21.15.193:0/3675297146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ea97e31200 0x55ea97f23f40 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 >> 172.21.15.193:0/3675297146 conn(0x55ea97da4b10 msgr2=0x55ea97f16f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 shutdown_connections 2024-09-12T17:13:14.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.901+0000 7f8256ae19c0 1 -- 172.21.15.193:0/3675297146 wait complete. 2024-09-12T17:13:14.914 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-12T17:13:14.915 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-12T17:13:14.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-12T17:13:14.915 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-12T17:13:14.994 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:14.995 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:14.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:14.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:14.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fedb19c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559019bf9730 0x559019c8d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:14.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fedb19c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559019b399c0 con 0x559019bf9350 2024-09-12T17:13:14.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fedb19c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559019b896d0 con 0x559019bf9730 2024-09-12T17:13:14.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc0b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559019bf9730 0x559019c8d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:14.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc8b7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x559019bf9350 0x559019c8a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44304/0 (socket says 172.21.15.193:44304) 2024-09-12T17:13:14.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc0b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559019bf9730 0x559019c8d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45572/0 (socket says 172.21.15.193:45572) 2024-09-12T17:13:14.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc8b7640 1 -- 172.21.15.193:0/515439755 learned_addr learned my addr 172.21.15.193:0/515439755 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:14.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc0b6640 1 -- 172.21.15.193:0/515439755 >> v1:172.21.15.62:6789/0 conn(0x559019bf9350 legacy=0x559019c8a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.993+0000 7f32fc0b6640 1 -- 172.21.15.193:0/515439755 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019b2dca0 con 0x559019bf9730 2024-09-12T17:13:15.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fc0b6640 1 --2- 172.21.15.193:0/515439755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9730 0x559019c8d860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f32f000a480 tx=0x7f32f001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb89215781b6cb0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fb8b5640 1 -- 172.21.15.193:0/515439755 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f00b0070 con 0x559019bf9730 2024-09-12T17:13:15.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fb8b5640 1 -- 172.21.15.193:0/515439755 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f00ab540 con 0x559019bf9730 2024-09-12T17:13:15.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fb8b5640 1 -- 172.21.15.193:0/515439755 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f00ab840 con 0x559019bf9730 2024-09-12T17:13:15.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 -- 172.21.15.193:0/515439755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9730 msgr2=0x559019c8d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/515439755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9730 0x559019c8d860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f32f000a480 tx=0x7f32f001b280 comp rx=0 tx=0).stop 2024-09-12T17:13:15.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 -- 172.21.15.193:0/515439755 shutdown_connections 2024-09-12T17:13:15.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/515439755 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9730 0x559019c8d860 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 -- 172.21.15.193:0/515439755 >> 172.21.15.193:0/515439755 conn(0x559019c7fa20 msgr2=0x559019c81e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 -- 172.21.15.193:0/515439755 shutdown_connections 2024-09-12T17:13:15.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:14.997+0000 7f32fedb19c0 1 -- 172.21.15.193:0/515439755 wait complete. 2024-09-12T17:13:15.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:15.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:15.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559019b8d680 con 0x559019bf9350 2024-09-12T17:13:15.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45578/0 (socket says 172.21.15.193:45578) 2024-09-12T17:13:15.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fc8b7640 1 -- 172.21.15.193:0/2943936765 learned_addr learned my addr 172.21.15.193:0/2943936765 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fc8b7640 1 -- 172.21.15.193:0/2943936765 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019b08da0 con 0x559019bf9350 2024-09-12T17:13:15.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fc8b7640 1 --2- 172.21.15.193:0/2943936765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001810 tx=0x7f32f4001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5542c74fd31e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f31eae0d640 1 -- 172.21.15.193:0/2943936765 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4004530 con 0x559019bf9350 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f31eae0d640 1 -- 172.21.15.193:0/2943936765 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40046d0 con 0x559019bf9350 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f31eae0d640 1 -- 172.21.15.193:0/2943936765 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f40049f0 con 0x559019bf9350 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- 172.21.15.193:0/2943936765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 msgr2=0x559019d72a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/2943936765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f32f4001810 tx=0x7f32f4001cd0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- 172.21.15.193:0/2943936765 shutdown_connections 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/2943936765 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d72a10 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- 172.21.15.193:0/2943936765 >> 172.21.15.193:0/2943936765 conn(0x559019c7fa20 msgr2=0x559019d6e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- 172.21.15.193:0/2943936765 shutdown_connections 2024-09-12T17:13:15.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.013+0000 7f32fedb19c0 1 -- 172.21.15.193:0/2943936765 wait complete. 2024-09-12T17:13:15.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:15.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559019b2fa50 con 0x559019bf9350 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45592/0 (socket says 172.21.15.193:45592) 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 -- 172.21.15.193:0/560824614 learned_addr learned my addr 172.21.15.193:0/560824614 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 -- 172.21.15.193:0/560824614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019d7a600 con 0x559019bf9350 2024-09-12T17:13:15.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000f90 tx=0x7f32f4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 -- 172.21.15.193:0/560824614 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4013820 con 0x559019bf9350 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559019d7a890 con 0x559019bf9350 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 -- 172.21.15.193:0/560824614 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f40139c0 con 0x559019bf9350 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 -- 172.21.15.193:0/560824614 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4013ce0 con 0x559019bf9350 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559019d7b240 con 0x559019bf9350 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:15.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:15.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fedb19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559019b9a450 con 0x559019d86cc0 2024-09-12T17:13:15.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 -- 172.21.15.193:0/560824614 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32f4010070 con 0x559019bf9350 2024-09-12T17:13:15.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fd0b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fd0b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45602/0 (socket says 172.21.15.193:45602) 2024-09-12T17:13:15.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fd0b8640 1 -- 172.21.15.193:0/3436665169 learned_addr learned my addr 172.21.15.193:0/3436665169 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 0x7f31e403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f31e960a640 1 -- 172.21.15.193:0/560824614 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32f4018070 con 0x559019bf9350 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fc8b7640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 0x7f31e403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.017+0000 7f32fd0b8640 1 -- 172.21.15.193:0/3436665169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019d876b0 con 0x559019d86cc0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fc8b7640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 0x7f31e403bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006a00 tx=0x7f32f4006990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/3436665169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00a440 tx=0x7f32ec00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bc36c5306f5a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e2ffd640 1 -- 172.21.15.193:0/3436665169 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec008850 con 0x559019d86cc0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e2ffd640 1 -- 172.21.15.193:0/3436665169 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec008a10 con 0x559019d86cc0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e2ffd640 1 -- 172.21.15.193:0/3436665169 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec008d30 con 0x559019d86cc0 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/3436665169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 msgr2=0x559019d870c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/3436665169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00a440 tx=0x7f32ec00a900 comp rx=0 tx=0).stop 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/3436665169 shutdown_connections 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/3436665169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d870c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/3436665169 >> 172.21.15.193:0/3436665169 conn(0x559019bf9730 msgr2=0x559019d82700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/3436665169 shutdown_connections 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/3436665169 wait complete. 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559019d87ea0 con 0x559019d86cc0 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45608/0 (socket says 172.21.15.193:45608) 2024-09-12T17:13:15.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 -- 172.21.15.193:0/4218975336 learned_addr learned my addr 172.21.15.193:0/4218975336 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 -- 172.21.15.193:0/4218975336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019d8e5e0 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x559019d87bc0 tx=0x7f32ec003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e17fa640 1 -- 172.21.15.193:0/4218975336 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec013a70 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559019d8e870 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e17fa640 1 -- 172.21.15.193:0/4218975336 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ec023070 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f31e17fa640 1 -- 172.21.15.193:0/4218975336 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32ec013d80 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.021+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559019d8f220 con 0x559019d86cc0 2024-09-12T17:13:15.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31e17fa640 1 -- 172.21.15.193:0/4218975336 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32ec028460 con 0x559019d86cc0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31e17fa640 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 0x7f31d403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 Processor -- start 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31e17fa640 1 -- 172.21.15.193:0/4218975336 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32ec050740 con 0x559019d86cc0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 0x7f31d403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 -- start start 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559019d73240 con 0x559019da77b0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 0x7f31d403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32ec01df90 tx=0x7f32ec01dea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fc8b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45610/0 (socket says 172.21.15.193:45610) 2024-09-12T17:13:15.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fc8b7640 1 -- 172.21.15.193:0/1592203970 learned_addr learned my addr 172.21.15.193:0/1592203970 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fc8b7640 1 -- 172.21.15.193:0/1592203970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559019da8210 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fc8b7640 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f32f4011ff0 tx=0x7f32f401d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31c17e2640 1 -- 172.21.15.193:0/1592203970 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f4045070 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559019da89b0 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31c17e2640 1 -- 172.21.15.193:0/1592203970 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4010df0 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f31c17e2640 1 -- 172.21.15.193:0/1592203970 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32f40123c0 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.025+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559019da8f20 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f31c17e2640 1 -- 172.21.15.193:0/1592203970 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32f4048070 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f31c17e2640 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 0x7f313803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f31c17e2640 1 -- 172.21.15.193:0/1592203970 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32f404bd40 con 0x559019da77b0 2024-09-12T17:13:15.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fc0b6640 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 0x7f313803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.032 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f3142ffd640 20 reqs_thread_entry: start 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 0x559019daf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559019dafdc0 con 0x559019dad230 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fc0b6640 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 0x7f313803bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32f00ad000 tx=0x7f32f00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 0x559019daf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fd0b8640 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 0x559019daf6f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fd0b8640 1 -- 172.21.15.193:0/560824614 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32ec01e7a0 con 0x559019dad230 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559019db1680 con 0x559019dad230 2024-09-12T17:13:15.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fd0b8640 1 -- 172.21.15.193:0/560824614 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32ec01e7a0 con 0x559019dad230 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 msgr2=0x7f31d403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 0x7f31d403bf30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f32ec01df90 tx=0x7f32ec01dea0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 msgr2=0x559019d8e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x559019d87bc0 tx=0x7f32ec003000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 shutdown_connections 2024-09-12T17:13:15.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d4039a70 0x7f31d403bf30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/4218975336 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019d86cc0 0x559019d8e080 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 >> 172.21.15.193:0/4218975336 conn(0x559019bf9730 msgr2=0x559019d821f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 shutdown_connections 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/4218975336 wait complete. 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 msgr2=0x7f313803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 0x7f313803bf30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f32f00ad000 tx=0x7f32f00a5040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 msgr2=0x559019da7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f32f4011ff0 tx=0x7f32f401d900 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 shutdown_connections 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f3138039a70 0x7f313803bf30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/1592203970 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019da77b0 0x559019da7bd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 >> 172.21.15.193:0/1592203970 conn(0x559019d9cdb0 msgr2=0x559019d9d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.029+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 shutdown_connections 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/1592203970 wait complete. 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 msgr2=0x559019daf6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 0x559019daf6f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 msgr2=0x7f31e403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 0x7f31e403bf30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f32f4006a00 tx=0x7f32f4006990 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 msgr2=0x559019d7a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f32f4000f90 tx=0x7f32f4001260 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 shutdown_connections 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559019dad230 0x559019daf6f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31e4039a70 0x7f31e403bf30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 --2- 172.21.15.193:0/560824614 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559019bf9350 0x559019d7a0a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 >> 172.21.15.193:0/560824614 conn(0x559019c7fa20 msgr2=0x559019d6d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 shutdown_connections 2024-09-12T17:13:15.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.033+0000 7f32fedb19c0 1 -- 172.21.15.193:0/560824614 wait complete. 2024-09-12T17:13:15.046 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:13:15.046 DEBUG:tasks.util.rgw: json result: {'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:13:15.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-12T17:13:15.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-12T17:13:15.047 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-12T17:13:15.123 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.123 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfdab39c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c015af01f0 0x55c015af25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfdab39c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c01599e9c0 con 0x55c015aec6e0 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfdab39c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c0159ee6d0 con 0x55c015af01f0 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfadb8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c015af01f0 0x55c015af25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfb5b9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c015aec6e0 0x55c015aeead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44314/0 (socket says 172.21.15.193:44314) 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfb5b9640 1 -- 172.21.15.193:0/384286861 learned_addr learned my addr 172.21.15.193:0/384286861 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfadb8640 1 -- 172.21.15.193:0/384286861 >> v1:172.21.15.62:6789/0 conn(0x55c015aec6e0 legacy=0x55c015aeead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.121+0000 7fddfadb8640 1 -- 172.21.15.193:0/384286861 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c015992ca0 con 0x55c015af01f0 2024-09-12T17:13:15.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfadb8640 1 --2- 172.21.15.193:0/384286861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015af01f0 0x55c015af25e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdde400a480 tx=0x7fdde401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0e926d67261236 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfa5b7640 1 -- 172.21.15.193:0/384286861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde40b0070 con 0x55c015af01f0 2024-09-12T17:13:15.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfa5b7640 1 -- 172.21.15.193:0/384286861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde40ab540 con 0x55c015af01f0 2024-09-12T17:13:15.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfa5b7640 1 -- 172.21.15.193:0/384286861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde40ab840 con 0x55c015af01f0 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 -- 172.21.15.193:0/384286861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015af01f0 msgr2=0x55c015af25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/384286861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015af01f0 0x55c015af25e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdde400a480 tx=0x7fdde401b280 comp rx=0 tx=0).stop 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 -- 172.21.15.193:0/384286861 shutdown_connections 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/384286861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015af01f0 0x55c015af25e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 -- 172.21.15.193:0/384286861 >> 172.21.15.193:0/384286861 conn(0x55c015a5fa70 msgr2=0x55c015a5fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 -- 172.21.15.193:0/384286861 shutdown_connections 2024-09-12T17:13:15.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.125+0000 7fddfdab39c0 1 -- 172.21.15.193:0/384286861 wait complete. 2024-09-12T17:13:15.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfdab39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfdab39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c0159f2680 con 0x55c015aec6e0 2024-09-12T17:13:15.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45630/0 (socket says 172.21.15.193:45630) 2024-09-12T17:13:15.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfb5b9640 1 -- 172.21.15.193:0/4053570850 learned_addr learned my addr 172.21.15.193:0/4053570850 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfb5b9640 1 -- 172.21.15.193:0/4053570850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c01596dda0 con 0x55c015aec6e0 2024-09-12T17:13:15.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/4053570850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fddec001810 tx=0x7fddec001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c51eb99fb3f3d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fdce960a640 1 -- 172.21.15.193:0/4053570850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec004530 con 0x55c015aec6e0 2024-09-12T17:13:15.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fdce960a640 1 -- 172.21.15.193:0/4053570850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec0046d0 con 0x55c015aec6e0 2024-09-12T17:13:15.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.141+0000 7fdce960a640 1 -- 172.21.15.193:0/4053570850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec0049f0 con 0x55c015aec6e0 2024-09-12T17:13:15.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/4053570850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 msgr2=0x55c015bd78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/4053570850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fddec001810 tx=0x7fddec001cd0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/4053570850 shutdown_connections 2024-09-12T17:13:15.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/4053570850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bd78c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/4053570850 >> 172.21.15.193:0/4053570850 conn(0x55c015a5fa70 msgr2=0x55c015bd3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/4053570850 shutdown_connections 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/4053570850 wait complete. 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c015994a50 con 0x55c015aec6e0 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45642/0 (socket says 172.21.15.193:45642) 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 learned_addr learned my addr 172.21.15.193:0/187648930 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c015bdf510 con 0x55c015aec6e0 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fddec000f90 tx=0x7fddec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fdce7e07640 1 -- 172.21.15.193:0/187648930 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec013630 con 0x55c015aec6e0 2024-09-12T17:13:15.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c015bdf7a0 con 0x55c015aec6e0 2024-09-12T17:13:15.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fdce7e07640 1 -- 172.21.15.193:0/187648930 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec0137d0 con 0x55c015aec6e0 2024-09-12T17:13:15.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fdce7e07640 1 -- 172.21.15.193:0/187648930 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec013ad0 con 0x55c015aec6e0 2024-09-12T17:13:15.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c015be0150 con 0x55c015aec6e0 2024-09-12T17:13:15.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfdab39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c0159ff450 con 0x55c015bebbd0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.145+0000 7fddfbdba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce7e07640 1 -- 172.21.15.193:0/187648930 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fddec010070 con 0x55c015aec6e0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45648/0 (socket says 172.21.15.193:45648) 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 -- 172.21.15.193:0/3031721502 learned_addr learned my addr 172.21.15.193:0/3031721502 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce7e07640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdce0039a70 0x7fdce003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce7e07640 1 -- 172.21.15.193:0/187648930 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fddec018070 con 0x55c015aec6e0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdce0039a70 0x7fdce003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 -- 172.21.15.193:0/3031721502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c015bec5c0 con 0x55c015bebbd0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdce0039a70 0x7fdce003bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fddec01ffd0 tx=0x7fddec013f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 --2- 172.21.15.193:0/3031721502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fddf400a440 tx=0x7fddf400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c367649c671a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce5e03640 1 -- 172.21.15.193:0/3031721502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf4008850 con 0x55c015bebbd0 2024-09-12T17:13:15.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce5e03640 1 -- 172.21.15.193:0/3031721502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf4008a10 con 0x55c015bebbd0 2024-09-12T17:13:15.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdce5e03640 1 -- 172.21.15.193:0/3031721502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf4008d30 con 0x55c015bebbd0 2024-09-12T17:13:15.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3031721502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 msgr2=0x55c015bebfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3031721502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fddf400a440 tx=0x7fddf400a900 comp rx=0 tx=0).stop 2024-09-12T17:13:15.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3031721502 shutdown_connections 2024-09-12T17:13:15.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3031721502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bebfd0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3031721502 >> 172.21.15.193:0/3031721502 conn(0x55c015af01f0 msgr2=0x55c015be7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3031721502 shutdown_connections 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3031721502 wait complete. 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c015becdb0 con 0x55c015bebbd0 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45654/0 (socket says 172.21.15.193:45654) 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 -- 172.21.15.193:0/123489141 learned_addr learned my addr 172.21.15.193:0/123489141 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 -- 172.21.15.193:0/123489141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c015bf3510 con 0x55c015bebbd0 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfbdba640 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55c015becad0 tx=0x7fddf4003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fdcd7fff640 1 -- 172.21.15.193:0/123489141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf4013a70 con 0x55c015bebbd0 2024-09-12T17:13:15.155 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c015bf37a0 con 0x55c015bebbd0 2024-09-12T17:13:15.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.149+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c015bf4150 con 0x55c015bebbd0 2024-09-12T17:13:15.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcd7fff640 1 -- 172.21.15.193:0/123489141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf4023070 con 0x55c015bebbd0 2024-09-12T17:13:15.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcd7fff640 1 -- 172.21.15.193:0/123489141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddf4013c10 con 0x55c015bebbd0 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 Processor -- start 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcd7fff640 1 -- 172.21.15.193:0/123489141 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fddf401e420 con 0x55c015bebbd0 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 -- start start 2024-09-12T17:13:15.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcd7fff640 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 0x7fdcdc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c015bd8110 con 0x55c015c0c6c0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcd7fff640 1 -- 172.21.15.193:0/123489141 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fddf4050570 con 0x55c015bebbd0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfbdba640 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 0x7fdcdc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfb5b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45660/0 (socket says 172.21.15.193:45660) 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfb5b9640 1 -- 172.21.15.193:0/3423987403 learned_addr learned my addr 172.21.15.193:0/3423987403 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfbdba640 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 0x7fdcdc03bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fddf40128e0 tx=0x7fddf404a040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfb5b9640 1 -- 172.21.15.193:0/3423987403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c015c0d120 con 0x55c015c0c6c0 2024-09-12T17:13:15.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fddec012c40 tx=0x7fddec029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcc0fe1640 1 -- 172.21.15.193:0/3423987403 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec045070 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c015c0d980 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcc0fe1640 1 -- 172.21.15.193:0/3423987403 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec01d7b0 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fdcc0fe1640 1 -- 172.21.15.193:0/3423987403 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec039070 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.153+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c015c0dea0 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fdcc0fe1640 1 -- 172.21.15.193:0/3423987403 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fddec048070 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fdcc0fe1640 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 0x7fdc3403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fdcc0fe1640 1 -- 172.21.15.193:0/3423987403 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fddec04bd40 con 0x55c015c0c6c0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfadb8640 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 0x7fdc3403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fdcb9ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c015c12240 0x55c015c146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c14d50 con 0x55c015c12240 2024-09-12T17:13:15.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c015c12240 0x55c015c146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfadb8640 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 0x7fdc3403bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdde40ad000 tx=0x7fdde40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c015c12240 0x55c015c146d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c155e0 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c16990 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1d2d0 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:NOTICE: set zone's realm_id= 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c015c21330 0x55c015c1d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c015c21330 0x55c015c1d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.157+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c015c21330 0x55c015c1d750 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfb5b9640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fddec04a070 0x7fddec026320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfadb8640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fddec04a070 0x7fddec026320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfadb8640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fddec04a070 0x7fddec026320 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfadb8640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdde40ab030 0x7fdde40b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdde40ab030 0x7fdde40b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdde40ab030 0x7fdde40b7930 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.161+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.170 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.165+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.169+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c21330 2024-09-12T17:13:15.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddec047030 con 0x55c015c21330 2024-09-12T17:13:15.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfb5b9640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fdde40ab030 2024-09-12T17:13:15.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddf404d240 con 0x7fdde40ab030 2024-09-12T17:13:15.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x55c015c12240 2024-09-12T17:13:15.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1cb60 con 0x7fddec04a070 2024-09-12T17:13:15.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfadb8640 1 -- 172.21.15.193:0/187648930 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdde40b3040 con 0x7fddec04a070 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1e900 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddf404d240 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1f180 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddf4059420 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1be20 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.173+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7fddf4059040 con 0x55c015c12240 2024-09-12T17:13:15.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c015c1be20 con 0x55c015c12240 2024-09-12T17:13:15.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fddf4059040 con 0x55c015c12240 2024-09-12T17:13:15.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c015c22d00 con 0x55c015c12240 2024-09-12T17:13:15.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7fddf4059040 con 0x55c015c12240 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 msgr2=0x7fdcdc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 0x7fdcdc03bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fddf40128e0 tx=0x7fddf404a040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 msgr2=0x55c015bf2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x55c015becad0 tx=0x7fddf4003000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 shutdown_connections 2024-09-12T17:13:15.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdcdc039a70 0x7fdcdc03bf30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/123489141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015bebbd0 0x55c015bf2fb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 >> 172.21.15.193:0/123489141 conn(0x55c015af01f0 msgr2=0x55c015be7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 shutdown_connections 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.177+0000 7fddfdab39c0 1 -- 172.21.15.193:0/123489141 wait complete. 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 msgr2=0x7fdc3403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 0x7fdc3403bf30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdde40ad000 tx=0x7fdde40a5040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 msgr2=0x55c015c0cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fddec012c40 tx=0x7fddec029840 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 shutdown_connections 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdc34039a70 0x7fdc3403bf30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/3423987403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015c0c6c0 0x55c015c0cae0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 >> 172.21.15.193:0/3423987403 conn(0x55c015c01cc0 msgr2=0x55c015c020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 shutdown_connections 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/3423987403 wait complete. 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdde40ab030 msgr2=0x7fdde40b7930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fdde40ab030 0x7fdde40b7930 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c015c12240 msgr2=0x55c015c146d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c015c12240 0x55c015c146d0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fddec04a070 msgr2=0x7fddec026320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fddec04a070 0x7fddec026320 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c015c21330 msgr2=0x55c015c1d750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c015c21330 0x55c015c1d750 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdce0039a70 msgr2=0x7fdce003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fdce0039a70 0x7fdce003bf30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fddec01ffd0 tx=0x7fddec013f20 comp rx=0 tx=0).stop 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfbdba640 1 -- 172.21.15.193:0/187648930 reap_dead start 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 msgr2=0x55c015bdefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fddec000f90 tx=0x7fddec001260 comp rx=0 tx=0).stop 2024-09-12T17:13:15.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 shutdown_connections 2024-09-12T17:13:15.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 --2- 172.21.15.193:0/187648930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c015aec6e0 0x55c015bdefb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 >> 172.21.15.193:0/187648930 conn(0x55c015a5fa70 msgr2=0x55c015bd1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 shutdown_connections 2024-09-12T17:13:15.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.181+0000 7fddfdab39c0 1 -- 172.21.15.193:0/187648930 wait complete. 2024-09-12T17:13:15.193 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:13:15.193 DEBUG:tasks.util.rgw: json result: {'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:13:15.194 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-12T17:13:15.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-12T17:13:15.194 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-12T17:13:15.264 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.264 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf336ba9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d878cc32e0 0x55d878cc56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf336ba9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d878b739c0 con 0x55d878c33210 2024-09-12T17:13:15.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf336ba9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d878bc36d0 con 0x55d878cc32e0 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf309bf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d878cc32e0 0x55d878cc56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf309bf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d878cc32e0 0x55d878cc56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45676/0 (socket says 172.21.15.193:45676) 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf309bf640 1 -- 172.21.15.193:0/4149621435 learned_addr learned my addr 172.21.15.193:0/4149621435 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf311c0640 1 --1- 172.21.15.193:0/4149621435 >> v1:172.21.15.62:6789/0 conn(0x55d878c33210 0x55d878cc1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44320/0 (socket says 172.21.15.193:44320) 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf309bf640 1 -- 172.21.15.193:0/4149621435 >> v1:172.21.15.62:6789/0 conn(0x55d878c33210 legacy=0x55d878cc1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.266 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.261+0000 7faf309bf640 1 -- 172.21.15.193:0/4149621435 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878b67ca0 con 0x55d878cc32e0 2024-09-12T17:13:15.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf309bf640 1 --2- 172.21.15.193:0/4149621435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878cc32e0 0x55d878cc56d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faf2400a4e0 tx=0x7faf2401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93ba97692fa718a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf2bfff640 1 -- 172.21.15.193:0/4149621435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf240aa540 con 0x55d878cc32e0 2024-09-12T17:13:15.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf2bfff640 1 -- 172.21.15.193:0/4149621435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf240aa6e0 con 0x55d878cc32e0 2024-09-12T17:13:15.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf2bfff640 1 -- 172.21.15.193:0/4149621435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf240aaa40 con 0x55d878cc32e0 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4149621435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878cc32e0 msgr2=0x55d878cc56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4149621435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878cc32e0 0x55d878cc56d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faf2400a4e0 tx=0x7faf2401b090 comp rx=0 tx=0).stop 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4149621435 shutdown_connections 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4149621435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878cc32e0 0x55d878cc56d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4149621435 >> 172.21.15.193:0/4149621435 conn(0x55d878cb98f0 msgr2=0x55d878cbbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4149621435 shutdown_connections 2024-09-12T17:13:15.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.265+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4149621435 wait complete. 2024-09-12T17:13:15.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf336ba9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf336ba9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d878bc7680 con 0x55d878c33210 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45688/0 (socket says 172.21.15.193:45688) 2024-09-12T17:13:15.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf311c0640 1 -- 172.21.15.193:0/672865180 learned_addr learned my addr 172.21.15.193:0/672865180 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf311c0640 1 -- 172.21.15.193:0/672865180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878b42da0 con 0x55d878c33210 2024-09-12T17:13:15.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7faf311c0640 1 --2- 172.21.15.193:0/672865180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7faf1c001ec0 tx=0x7faf1c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d64d52cd848f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7fae1f606640 1 -- 172.21.15.193:0/672865180 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c00e5d0 con 0x55d878c33210 2024-09-12T17:13:15.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7fae1f606640 1 -- 172.21.15.193:0/672865180 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c00e770 con 0x55d878c33210 2024-09-12T17:13:15.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.281+0000 7fae1f606640 1 -- 172.21.15.193:0/672865180 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c00ea70 con 0x55d878c33210 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/672865180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 msgr2=0x55d878daa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/672865180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7faf1c001ec0 tx=0x7faf1c00b6d0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/672865180 shutdown_connections 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/672865180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878daa790 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/672865180 >> 172.21.15.193:0/672865180 conn(0x55d878cb98f0 msgr2=0x55d878da63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/672865180 shutdown_connections 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/672865180 wait complete. 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d878b69a50 con 0x55d878c33210 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45698/0 (socket says 172.21.15.193:45698) 2024-09-12T17:13:15.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf311c0640 1 -- 172.21.15.193:0/750958759 learned_addr learned my addr 172.21.15.193:0/750958759 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf311c0640 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878db23c0 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf311c0640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55d878dab720 tx=0x7faf1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7fae1de03640 1 -- 172.21.15.193:0/750958759 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c00f8e0 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7fae1de03640 1 -- 172.21.15.193:0/750958759 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c00fa80 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d878db2650 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7fae1de03640 1 -- 172.21.15.193:0/750958759 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c00fda0 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d878db3000 con 0x55d878c33210 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf336ba9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d878bd4450 con 0x55d878dbea80 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.285+0000 7faf319c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45708/0 (socket says 172.21.15.193:45708) 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 -- 172.21.15.193:0/486422488 learned_addr learned my addr 172.21.15.193:0/486422488 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae1de03640 1 -- 172.21.15.193:0/750958759 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf1c017070 con 0x55d878c33210 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae1de03640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 0x7fae1803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae1de03640 1 -- 172.21.15.193:0/750958759 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf1c015020 con 0x55d878c33210 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf311c0640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 0x7fae1803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 -- 172.21.15.193:0/486422488 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878dbf470 con 0x55d878dbea80 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 --2- 172.21.15.193:0/486422488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00a440 tx=0x7faf2c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51e57bf01af74e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf311c0640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 0x7fae1803bf80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf1c01c7b0 tx=0x7faf1c035040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae177fe640 1 -- 172.21.15.193:0/486422488 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf2c008850 con 0x55d878dbea80 2024-09-12T17:13:15.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae177fe640 1 -- 172.21.15.193:0/486422488 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2c008a10 con 0x55d878dbea80 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae177fe640 1 -- 172.21.15.193:0/486422488 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf2c008d30 con 0x55d878dbea80 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/486422488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 msgr2=0x55d878dbee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/486422488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00a440 tx=0x7faf2c00a900 comp rx=0 tx=0).stop 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/486422488 shutdown_connections 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/486422488 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dbee80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/486422488 >> 172.21.15.193:0/486422488 conn(0x55d878cc32e0 msgr2=0x55d878dba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/486422488 shutdown_connections 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/486422488 wait complete. 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d878dbfc60 con 0x55d878dbea80 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45714/0 (socket says 172.21.15.193:45714) 2024-09-12T17:13:15.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 -- 172.21.15.193:0/4273756758 learned_addr learned my addr 172.21.15.193:0/4273756758 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 -- 172.21.15.193:0/4273756758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878dc6480 con 0x55d878dbea80 2024-09-12T17:13:15.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf319c1640 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55d878dbf980 tx=0x7faf2c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae15ffb640 1 -- 172.21.15.193:0/4273756758 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf2c013a20 con 0x55d878dbea80 2024-09-12T17:13:15.296 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d878dc6710 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae15ffb640 1 -- 172.21.15.193:0/4273756758 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2c023070 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7fae15ffb640 1 -- 172.21.15.193:0/4273756758 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf2c013d30 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.289+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d878dc70c0 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fae15ffb640 1 -- 172.21.15.193:0/4273756758 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf2c028460 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 Processor -- start 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fae15ffb640 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 -- start start 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fae15ffb640 1 -- 172.21.15.193:0/4273756758 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf2c0506f0 con 0x55d878dbea80 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d878daafe0 con 0x55d878de1810 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf319c1640 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.297 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf319c1640 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf2c028e20 tx=0x7faf2c042040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf311c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45718/0 (socket says 172.21.15.193:45718) 2024-09-12T17:13:15.298 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf311c0640 1 -- 172.21.15.193:0/2339402901 learned_addr learned my addr 172.21.15.193:0/2339402901 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf311c0640 1 -- 172.21.15.193:0/2339402901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d878de2270 con 0x55d878de1810 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf311c0640 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faf1c017aa0 tx=0x7faf1c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fadf5fe3640 1 -- 172.21.15.193:0/2339402901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c0198a0 con 0x55d878de1810 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d878de29d0 con 0x55d878de1810 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fadf5fe3640 1 -- 172.21.15.193:0/2339402901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf1c017d40 con 0x55d878de1810 2024-09-12T17:13:15.299 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7fadf5fe3640 1 -- 172.21.15.193:0/2339402901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf1c01ae50 con 0x55d878de1810 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.293+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d878de29d0 con 0x55d878de1810 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7fadf5fe3640 1 -- 172.21.15.193:0/2339402901 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf1c01b3d0 con 0x55d878de1810 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7fadf5fe3640 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 0x7fad7403c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7fadf5fe3640 1 -- 172.21.15.193:0/2339402901 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf1c04acf0 con 0x55d878de1810 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf309bf640 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 0x7fad7403c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7fad6f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 0x55d878de9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.300 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d878de9b10 con 0x55d878de7020 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf319c1640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 0x55d878de9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf309bf640 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 0x7fad7403c0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faf240ab000 tx=0x7faf240a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf319c1640 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 0x55d878de9490 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf319c1640 1 -- 172.21.15.193:0/750958759 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf2c011a80 con 0x55d878de7020 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d878dea3c0 con 0x55d878de7020 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf319c1640 1 -- 172.21.15.193:0/750958759 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf2c011a80 con 0x55d878de7020 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d878deb770 con 0x55d878de7020 2024-09-12T17:13:15.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf319c1640 1 -- 172.21.15.193:0/750958759 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7faf2c011a80 con 0x55d878de7020 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 msgr2=0x7fae0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7faf2c028e20 tx=0x7faf2c042040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 msgr2=0x55d878dc5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x55d878dbf980 tx=0x7faf2c003000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 shutdown_connections 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/4273756758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878dbea80 0x55d878dc5f20 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 >> 172.21.15.193:0/4273756758 conn(0x55d878cc32e0 msgr2=0x55d878db9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 shutdown_connections 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.297+0000 7faf336ba9c0 1 -- 172.21.15.193:0/4273756758 wait complete. 2024-09-12T17:13:15.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 msgr2=0x7fad7403c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 0x7fad7403c0d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7faf240ab000 tx=0x7faf240a5000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 msgr2=0x55d878de1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7faf1c017aa0 tx=0x7faf1c01c640 comp rx=0 tx=0).stop 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 shutdown_connections 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fad74039c10 0x7fad7403c0d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/2339402901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878de1810 0x55d878de1c30 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 >> 172.21.15.193:0/2339402901 conn(0x55d878dd6e50 msgr2=0x55d878dd7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 shutdown_connections 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/2339402901 wait complete. 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 msgr2=0x55d878de9490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 0x55d878de9490 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 msgr2=0x7fae1803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 0x7fae1803bf80 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf1c01c7b0 tx=0x7faf1c035040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 msgr2=0x55d878db1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55d878dab720 tx=0x7faf1c000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 shutdown_connections 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d878de7020 0x55d878de9490 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae18039ac0 0x7fae1803bf80 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 --2- 172.21.15.193:0/750958759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d878c33210 0x55d878db1e60 secure :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55d878dab720 tx=0x7faf1c000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 >> 172.21.15.193:0/750958759 conn(0x55d878cb98f0 msgr2=0x55d878da4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 shutdown_connections 2024-09-12T17:13:15.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.301+0000 7faf336ba9c0 1 -- 172.21.15.193:0/750958759 wait complete. 2024-09-12T17:13:15.313 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T17:13:15.313 DEBUG:tasks.util.rgw: json result: {'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T17:13:15.314 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:13:15.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-12T17:13:15.314 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-12T17:13:15.392 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.392 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3aab079c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5575e6672180 0x5575e6674570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3aab079c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5575e65229c0 con 0x5575e666dfe0 2024-09-12T17:13:15.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3aab079c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5575e65726d0 con 0x5575e6672180 2024-09-12T17:13:15.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3a7e0c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5575e6672180 0x5575e6674570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3a860d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5575e666dfe0 0x5575e666e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44322/0 (socket says 172.21.15.193:44322) 2024-09-12T17:13:15.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.389+0000 7fc3a860d640 1 -- 172.21.15.193:0/3329304414 learned_addr learned my addr 172.21.15.193:0/3329304414 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:15.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a760b640 1 -- 172.21.15.193:0/3329304414 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 820291679 0 0) 0x5575e65229c0 con 0x5575e666dfe0 2024-09-12T17:13:15.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a760b640 1 -- 172.21.15.193:0/3329304414 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc394001e20 con 0x5575e666dfe0 2024-09-12T17:13:15.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a7e0c640 1 -- 172.21.15.193:0/3329304414 >> v1:172.21.15.62:6789/0 conn(0x5575e666dfe0 legacy=0x5575e666e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a7e0c640 1 -- 172.21.15.193:0/3329304414 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e6516ca0 con 0x5575e6672180 2024-09-12T17:13:15.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a7e0c640 1 --2- 172.21.15.193:0/3329304414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e6672180 0x5575e6674570 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc39000a480 tx=0x7fc39001b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e77a3dc07709abd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a760b640 1 -- 172.21.15.193:0/3329304414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3900aa570 con 0x5575e6672180 2024-09-12T17:13:15.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a760b640 1 -- 172.21.15.193:0/3329304414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3900af070 con 0x5575e6672180 2024-09-12T17:13:15.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3a760b640 1 -- 172.21.15.193:0/3329304414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3900aa860 con 0x5575e6672180 2024-09-12T17:13:15.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3329304414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e6672180 msgr2=0x5575e6674570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3329304414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e6672180 0x5575e6674570 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc39000a480 tx=0x7fc39001b310 comp rx=0 tx=0).stop 2024-09-12T17:13:15.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3329304414 shutdown_connections 2024-09-12T17:13:15.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3329304414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e6672180 0x5575e6674570 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3329304414 >> 172.21.15.193:0/3329304414 conn(0x5575e6669b00 msgr2=0x5575e666bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3329304414 shutdown_connections 2024-09-12T17:13:15.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.393+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3329304414 wait complete. 2024-09-12T17:13:15.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3aab079c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.413 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3aab079c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5575e6576680 con 0x5575e666dfe0 2024-09-12T17:13:15.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45736/0 (socket says 172.21.15.193:45736) 2024-09-12T17:13:15.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3a860d640 1 -- 172.21.15.193:0/1908647011 learned_addr learned my addr 172.21.15.193:0/1908647011 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3a860d640 1 -- 172.21.15.193:0/1908647011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e64f1da0 con 0x5575e666dfe0 2024-09-12T17:13:15.414 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.409+0000 7fc3a860d640 1 --2- 172.21.15.193:0/1908647011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc398001e40 tx=0x7fc39800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fe4e693fa519bb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc29660c640 1 -- 172.21.15.193:0/1908647011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc398012020 con 0x5575e666dfe0 2024-09-12T17:13:15.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc29660c640 1 -- 172.21.15.193:0/1908647011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39800e690 con 0x5575e666dfe0 2024-09-12T17:13:15.415 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc29660c640 1 -- 172.21.15.193:0/1908647011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39800e9b0 con 0x5575e666dfe0 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/1908647011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 msgr2=0x5575e6759650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/1908647011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc398001e40 tx=0x7fc39800b790 comp rx=0 tx=0).stop 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/1908647011 shutdown_connections 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/1908647011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6759650 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/1908647011 >> 172.21.15.193:0/1908647011 conn(0x5575e6669b00 msgr2=0x5575e67552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/1908647011 shutdown_connections 2024-09-12T17:13:15.416 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/1908647011 wait complete. 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5575e6518a50 con 0x5575e666dfe0 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.417 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45746/0 (socket says 172.21.15.193:45746) 2024-09-12T17:13:15.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3a860d640 1 -- 172.21.15.193:0/4182518206 learned_addr learned my addr 172.21.15.193:0/4182518206 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.418 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3a860d640 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e6761240 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3a860d640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c10 tx=0x7fc3980040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc294e09640 1 -- 172.21.15.193:0/4182518206 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc398012030 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575e67614d0 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc294e09640 1 -- 172.21.15.193:0/4182518206 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39801a6d0 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc294e09640 1 -- 172.21.15.193:0/4182518206 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39801a9b0 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.413+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e6761e80 con 0x5575e666dfe0 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.419 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5575e6583450 con 0x5575e676d900 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45754/0 (socket says 172.21.15.193:45754) 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/97095322 learned_addr learned my addr 172.21.15.193:0/97095322 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc294e09640 1 -- 172.21.15.193:0/4182518206 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc398015020 con 0x5575e666dfe0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc294e09640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 0x7fc29003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/97095322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e676e2f0 con 0x5575e676d900 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc294e09640 1 -- 172.21.15.193:0/4182518206 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc398020070 con 0x5575e666dfe0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a860d640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 0x7fc29003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/97095322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000a430 tx=0x7fc3a000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddde719c767360cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a860d640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 0x7fc29003bf80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc398017fd0 tx=0x7fc39803f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc28e7fc640 1 -- 172.21.15.193:0/97095322 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a000f6e0 con 0x5575e676d900 2024-09-12T17:13:15.422 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc28e7fc640 1 -- 172.21.15.193:0/97095322 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0015070 con 0x5575e676d900 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc28e7fc640 1 -- 172.21.15.193:0/97095322 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a000fa10 con 0x5575e676d900 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- 172.21.15.193:0/97095322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 msgr2=0x5575e676dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/97095322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000a430 tx=0x7fc3a000a8f0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- 172.21.15.193:0/97095322 shutdown_connections 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/97095322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e676dd00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- 172.21.15.193:0/97095322 >> 172.21.15.193:0/97095322 conn(0x5575e6672180 msgr2=0x5575e6769340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- 172.21.15.193:0/97095322 shutdown_connections 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- 172.21.15.193:0/97095322 wait complete. 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3aab079c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5575e676eae0 con 0x5575e676d900 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.423 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45770/0 (socket says 172.21.15.193:45770) 2024-09-12T17:13:15.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.417+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/2729412192 learned_addr learned my addr 172.21.15.193:0/2729412192 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/2729412192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e67751f0 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000adf0 tx=0x7fc3a0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 -- 172.21.15.193:0/2729412192 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0010a10 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575e6775480 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 -- 172.21.15.193:0/2729412192 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a0020070 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e6775e30 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 -- 172.21.15.193:0/2729412192 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3a0010d00 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 -- 172.21.15.193:0/2729412192 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc3a0025470 con 0x5575e676d900 2024-09-12T17:13:15.426 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 Processor -- start 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 -- start start 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 0x7fc28003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3aab079c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5575e6759e80 con 0x5575e65e4d60 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc28cff9640 1 -- 172.21.15.193:0/2729412192 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc3a00510a0 con 0x5575e676d900 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 0x7fc28003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a860d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45784/0 (socket says 172.21.15.193:45784) 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a860d640 1 -- 172.21.15.193:0/3825767091 learned_addr learned my addr 172.21.15.193:0/3825767091 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 0x7fc28003bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3a001b920 tx=0x7fc3a001b7b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a860d640 1 -- 172.21.15.193:0/3825767091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e65e5260 con 0x5575e65e4d60 2024-09-12T17:13:15.427 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.421+0000 7fc3a860d640 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc39802dfd0 tx=0x7fc39800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 -- 172.21.15.193:0/3825767091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39804b440 con 0x5575e65e4d60 2024-09-12T17:13:15.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 -- 172.21.15.193:0/3825767091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39804b5e0 con 0x5575e65e4d60 2024-09-12T17:13:15.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5575e65e3b40 con 0x5575e65e4d60 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 -- 172.21.15.193:0/3825767091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc39802c800 con 0x5575e65e4d60 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e65e3b40 con 0x5575e65e4d60 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 -- 172.21.15.193:0/3825767091 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc398049040 con 0x5575e65e4d60 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 0x7fc1e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc26d7e2640 1 -- 172.21.15.193:0/3825767091 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc398005050 con 0x5575e65e4d60 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a7e0c640 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 0x7fc1e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc2667fc640 20 reqs_thread_entry: start 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 0x5575e6798240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5575e6798910 con 0x5575e6795d80 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a7e0c640 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 0x7fc1e003bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3900ae000 tx=0x7fc3900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 0x5575e6798240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a8e0e640 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 0x5575e6798240 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/4182518206 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3a0046040 con 0x5575e6795d80 2024-09-12T17:13:15.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5575e679a1d0 con 0x5575e6795d80 2024-09-12T17:13:15.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/4182518206 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fc3a0046040 con 0x5575e6795d80 2024-09-12T17:13:15.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.425+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5575e679ed20 con 0x5575e6795d80 2024-09-12T17:13:15.431 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3a8e0e640 1 -- 172.21.15.193:0/4182518206 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fc3a0046040 con 0x5575e6795d80 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 msgr2=0x7fc28003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 0x7fc28003bf30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc3a001b920 tx=0x7fc3a001b7b0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 msgr2=0x5575e6774c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc3a000adf0 tx=0x7fc3a0003380 comp rx=0 tx=0).stop 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 shutdown_connections 2024-09-12T17:13:15.433 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc280039a70 0x7fc28003bf30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/2729412192 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e676d900 0x5575e6774c90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 >> 172.21.15.193:0/2729412192 conn(0x5575e6672180 msgr2=0x5575e6768e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 shutdown_connections 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/2729412192 wait complete. 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 msgr2=0x7fc1e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 0x7fc1e003bf30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc3900ae000 tx=0x7fc3900a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 msgr2=0x5575e65e3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc39802dfd0 tx=0x7fc39800ded0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 shutdown_connections 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc1e0039a70 0x7fc1e003bf30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/3825767091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e65e4d60 0x5575e65e3600 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 >> 172.21.15.193:0/3825767091 conn(0x5575e6783980 msgr2=0x5575e6783d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.434 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 shutdown_connections 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/3825767091 wait complete. 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 msgr2=0x5575e6798240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 0x5575e6798240 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 msgr2=0x7fc29003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 0x7fc29003bf80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc398017fd0 tx=0x7fc39803f040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 msgr2=0x5575e6760ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc398000c10 tx=0x7fc3980040f0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 shutdown_connections 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5575e6795d80 0x5575e6798240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc290039ac0 0x7fc29003bf80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 --2- 172.21.15.193:0/4182518206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5575e666dfe0 0x5575e6760ce0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 >> 172.21.15.193:0/4182518206 conn(0x5575e6669b00 msgr2=0x5575e6753d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 shutdown_connections 2024-09-12T17:13:15.435 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.429+0000 7fc3aab079c0 1 -- 172.21.15.193:0/4182518206 wait complete. 2024-09-12T17:13:15.443 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T17:13:15.443 DEBUG:tasks.util.rgw: json result: {'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T17:13:15.444 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-12T17:13:15.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-12T17:13:15.444 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-12T17:13:15.517 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.518 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecd8779c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5555cdb59120 0x5555cdb5b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecd8779c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555cda099c0 con 0x5555cdb54f80 2024-09-12T17:13:15.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecd8779c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5555cda596d0 con 0x5555cdb59120 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ec2b7c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5555cdb59120 0x5555cdb5b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecb37d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5555cdb54f80 0x5555cdb55360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44326/0 (socket says 172.21.15.193:44326) 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecb37d640 1 -- 172.21.15.193:0/3026804599 learned_addr learned my addr 172.21.15.193:0/3026804599 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ec2b7c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5555cdb59120 0x5555cdb5b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45798/0 (socket says 172.21.15.193:45798) 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ec2b7c640 1 -- 172.21.15.193:0/3026804599 >> v1:172.21.15.62:6789/0 conn(0x5555cdb54f80 legacy=0x5555cdb55360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ecab7c640 1 -- 172.21.15.193:0/3026804599 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2351963169 0 0) 0x5555cda099c0 con 0x5555cdb54f80 2024-09-12T17:13:15.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.517+0000 7f0ec2b7c640 1 -- 172.21.15.193:0/3026804599 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cd9fdca0 con 0x5555cdb59120 2024-09-12T17:13:15.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ec2b7c640 1 --2- 172.21.15.193:0/3026804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb59120 0x5555cdb5b510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400a480 tx=0x7f0eb401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc1f3430d8f626f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecab7c640 1 -- 172.21.15.193:0/3026804599 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb40aa570 con 0x5555cdb59120 2024-09-12T17:13:15.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecab7c640 1 -- 172.21.15.193:0/3026804599 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb40af070 con 0x5555cdb59120 2024-09-12T17:13:15.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecab7c640 1 -- 172.21.15.193:0/3026804599 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0eb40aa860 con 0x5555cdb59120 2024-09-12T17:13:15.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3026804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb59120 msgr2=0x5555cdb5b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3026804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb59120 0x5555cdb5b510 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400a480 tx=0x7f0eb401b310 comp rx=0 tx=0).stop 2024-09-12T17:13:15.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3026804599 shutdown_connections 2024-09-12T17:13:15.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3026804599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb59120 0x5555cdb5b510 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3026804599 >> 172.21.15.193:0/3026804599 conn(0x5555cdb50aa0 msgr2=0x5555cdb52ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3026804599 shutdown_connections 2024-09-12T17:13:15.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.521+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3026804599 wait complete. 2024-09-12T17:13:15.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.533+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.533+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.533+0000 7f0ecd8779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.533+0000 7f0ecd8779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5555cda5d680 con 0x5555cdb54f80 2024-09-12T17:13:15.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45814/0 (socket says 172.21.15.193:45814) 2024-09-12T17:13:15.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 -- 172.21.15.193:0/1106712865 learned_addr learned my addr 172.21.15.193:0/1106712865 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 -- 172.21.15.193:0/1106712865 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cd9d8da0 con 0x5555cdb54f80 2024-09-12T17:13:15.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 --2- 172.21.15.193:0/1106712865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc001eb0 tx=0x7f0ebc00b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ebd82173c6a5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0db960a640 1 -- 172.21.15.193:0/1106712865 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc00d640 con 0x5555cdb54f80 2024-09-12T17:13:15.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0db960a640 1 -- 172.21.15.193:0/1106712865 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc008070 con 0x5555cdb54f80 2024-09-12T17:13:15.540 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0db960a640 1 -- 172.21.15.193:0/1106712865 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc00d970 con 0x5555cdb54f80 2024-09-12T17:13:15.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/1106712865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 msgr2=0x5555cdc40480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/1106712865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc001eb0 tx=0x7f0ebc00b6b0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/1106712865 shutdown_connections 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/1106712865 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc40480 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/1106712865 >> 172.21.15.193:0/1106712865 conn(0x5555cdb50aa0 msgr2=0x5555cdc3c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/1106712865 shutdown_connections 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/1106712865 wait complete. 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecd8779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5555cd9ffa50 con 0x5555cdb54f80 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45816/0 (socket says 172.21.15.193:45816) 2024-09-12T17:13:15.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 -- 172.21.15.193:0/2437963917 learned_addr learned my addr 172.21.15.193:0/2437963917 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.537+0000 7f0ecb37d640 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cdc480a0 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecb37d640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00bbb0 tx=0x7f0ebc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 -- 172.21.15.193:0/2437963917 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc01a880 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 -- 172.21.15.193:0/2437963917 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc01aa20 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555cdc48330 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 -- 172.21.15.193:0/2437963917 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc01ad20 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cdc48ce0 con 0x5555cdb54f80 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5555cda6a450 con 0x5555cdc54760 2024-09-12T17:13:15.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecbb7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecbb7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45832/0 (socket says 172.21.15.193:45832) 2024-09-12T17:13:15.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/3110838427 learned_addr learned my addr 172.21.15.193:0/3110838427 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 -- 172.21.15.193:0/2437963917 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ebc017070 con 0x5555cdb54f80 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 0x7f0db003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db7e07640 1 -- 172.21.15.193:0/2437963917 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0ebc015020 con 0x5555cdb54f80 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecb37d640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 0x7f0db003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/3110838427 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cdc55150 con 0x5555cdc54760 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/3110838427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400a430 tx=0x7f0ec400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aedbb73afa651df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecb37d640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 0x7f0db003bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00bc50 tx=0x7f0ebc00bbe0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db5e03640 1 -- 172.21.15.193:0/3110838427 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec400f6e0 con 0x5555cdc54760 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db5e03640 1 -- 172.21.15.193:0/3110838427 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4015070 con 0x5555cdc54760 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0db5e03640 1 -- 172.21.15.193:0/3110838427 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec400fa10 con 0x5555cdc54760 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3110838427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 msgr2=0x5555cdc54b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3110838427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400a430 tx=0x7f0ec400a8f0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3110838427 shutdown_connections 2024-09-12T17:13:15.547 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3110838427 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc54b60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3110838427 >> 172.21.15.193:0/3110838427 conn(0x5555cdb59120 msgr2=0x5555cdc501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3110838427 shutdown_connections 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3110838427 wait complete. 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.541+0000 7f0ecd8779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5555cdc55940 con 0x5555cdc54760 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45840/0 (socket says 172.21.15.193:45840) 2024-09-12T17:13:15.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/2950582696 learned_addr learned my addr 172.21.15.193:0/2950582696 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/2950582696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cdc5c180 con 0x5555cdc54760 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5555cdc55660 tx=0x7f0ec4003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 -- 172.21.15.193:0/2950582696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec4010a20 con 0x5555cdc54760 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 -- 172.21.15.193:0/2950582696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec4020070 con 0x5555cdc54760 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555cdc5c410 con 0x5555cdc54760 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 -- 172.21.15.193:0/2950582696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ec4010d50 con 0x5555cdc54760 2024-09-12T17:13:15.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cdc5cdc0 con 0x5555cdc54760 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 -- 172.21.15.193:0/2950582696 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ec401b420 con 0x5555cdc54760 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 Processor -- start 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 0x7f0dac03bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0da7fff640 1 -- 172.21.15.193:0/2950582696 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0ec4050ba0 con 0x5555cdc54760 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 -- start start 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 0x7f0dac03bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.551 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.545+0000 7f0ecd8779c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5555cdc40cb0 con 0x5555cdc75310 2024-09-12T17:13:15.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 0x7f0dac03bfd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4010fd0 tx=0x7f0ec4050040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecb37d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45842/0 (socket says 172.21.15.193:45842) 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecb37d640 1 -- 172.21.15.193:0/3402654818 learned_addr learned my addr 172.21.15.193:0/3402654818 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecb37d640 1 -- 172.21.15.193:0/3402654818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555cdc75d70 con 0x5555cdc75310 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecb37d640 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc04f260 tx=0x7f0ebc01bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 -- 172.21.15.193:0/3402654818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc0248c0 con 0x5555cdc75310 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555cdc76520 con 0x5555cdc75310 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 -- 172.21.15.193:0/3402654818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ebc024b00 con 0x5555cdc75310 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 -- 172.21.15.193:0/3402654818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ebc01ce20 con 0x5555cdc75310 2024-09-12T17:13:15.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555cdc76a90 con 0x5555cdc75310 2024-09-12T17:13:15.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 -- 172.21.15.193:0/3402654818 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0ebc01bcf0 con 0x5555cdc75310 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 0x7f0d0c03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d3bfff640 1 -- 172.21.15.193:0/3402654818 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0ebc038070 con 0x5555cdc75310 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ec2b7c640 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 0x7f0d0c03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0d39ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 0x5555cdc7d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555cdc7d770 con 0x5555cdc7aca0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 0x5555cdc7d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ec2b7c640 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 0x7f0d0c03bee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40ae000 tx=0x7f0eb40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.549+0000 7f0ecbb7e640 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 0x5555cdc7d110 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/2437963917 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ec400e070 con 0x5555cdc7aca0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555cdc7e020 con 0x5555cdc7aca0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/2437963917 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ec400e070 con 0x5555cdc7aca0 2024-09-12T17:13:15.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5555cdc7f3d0 con 0x5555cdc7aca0 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecbb7e640 1 -- 172.21.15.193:0/2437963917 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ec400e070 con 0x5555cdc7aca0 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 msgr2=0x7f0dac03bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 0x7f0dac03bfd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4010fd0 tx=0x7f0ec4050040 comp rx=0 tx=0).stop 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 msgr2=0x5555cdc5bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x5555cdc55660 tx=0x7f0ec4003380 comp rx=0 tx=0).stop 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 shutdown_connections 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0dac039b10 0x7f0dac03bfd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2950582696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc54760 0x5555cdc5bc20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 >> 172.21.15.193:0/2950582696 conn(0x5555cdb59120 msgr2=0x5555cdc4fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 shutdown_connections 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2950582696 wait complete. 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 msgr2=0x7f0d0c03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.558 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 0x7f0d0c03bee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0eb40ae000 tx=0x7f0eb40a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 msgr2=0x5555cdc75730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc04f260 tx=0x7f0ebc01bb30 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 shutdown_connections 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d0c039a20 0x7f0d0c03bee0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/3402654818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdc75310 0x5555cdc75730 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 >> 172.21.15.193:0/3402654818 conn(0x5555cdc6a910 msgr2=0x5555cdc6acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 shutdown_connections 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/3402654818 wait complete. 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 msgr2=0x5555cdc7d110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 0x5555cdc7d110 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 msgr2=0x7f0db003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 0x7f0db003bf30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00bc50 tx=0x7f0ebc00bbe0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.559 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 msgr2=0x5555cdc47b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00bbb0 tx=0x7f0ebc000ee0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 shutdown_connections 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5555cdc7aca0 0x5555cdc7d110 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0db0039a70 0x7f0db003bf30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 --2- 172.21.15.193:0/2437963917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5555cdb54f80 0x5555cdc47b40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 >> 172.21.15.193:0/2437963917 conn(0x5555cdb50aa0 msgr2=0x5555cdc3abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 shutdown_connections 2024-09-12T17:13:15.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.553+0000 7f0ecd8779c0 1 -- 172.21.15.193:0/2437963917 wait complete. 2024-09-12T17:13:15.567 INFO:teuthology.orchestra.run.smithi193.stdout:{"id":"8d996106-34ba-42aa-8283-014f90bfb7e7","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"51a3b7d9-97a7-414a-8656-afb65faf6acb","zones":[{"id":"51a3b7d9-97a7-414a-8656-afb65faf6acb","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-12T17:13:15.568 DEBUG:tasks.util.rgw: json result: {'id': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'zones': [{'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-12T17:13:15.570 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-12T17:13:15.590 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T17:13:15.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-12T17:13:15.591 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-12T17:13:15.664 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.664 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c83a19c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555d3ab27f00 0x555d3ab282e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c83a19c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d3a9dc9c0 con 0x555d3ab2b040 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c83a19c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x555d3aa2c6d0 con 0x555d3ab27f00 2024-09-12T17:13:15.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c5ea7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555d3ab27f00 0x555d3ab282e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c5ea7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x555d3ab27f00 0x555d3ab282e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45852/0 (socket says 172.21.15.193:45852) 2024-09-12T17:13:15.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c56a6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x555d3ab2b040 0x555d3ab2d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44342/0 (socket says 172.21.15.193:44342) 2024-09-12T17:13:15.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c5ea7640 1 -- 172.21.15.193:0/2564618180 learned_addr learned my addr 172.21.15.193:0/2564618180 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c5ea7640 1 -- 172.21.15.193:0/2564618180 >> v1:172.21.15.62:6789/0 conn(0x555d3ab2b040 legacy=0x555d3ab2d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c4ea5640 1 -- 172.21.15.193:0/2564618180 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709109268 0 0) 0x555d3a9dc9c0 con 0x555d3ab2b040 2024-09-12T17:13:15.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.661+0000 7f85c5ea7640 1 -- 172.21.15.193:0/2564618180 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3a9d0ca0 con 0x555d3ab27f00 2024-09-12T17:13:15.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/2564618180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ab282e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f85b800a5c0 tx=0x7f85b801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8346957549918 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c4ea5640 1 -- 172.21.15.193:0/2564618180 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80a6070 con 0x555d3ab27f00 2024-09-12T17:13:15.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c4ea5640 1 -- 172.21.15.193:0/2564618180 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b80af070 con 0x555d3ab27f00 2024-09-12T17:13:15.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c4ea5640 1 -- 172.21.15.193:0/2564618180 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80aa5c0 con 0x555d3ab27f00 2024-09-12T17:13:15.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 -- 172.21.15.193:0/2564618180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 msgr2=0x555d3ab282e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/2564618180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ab282e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f85b800a5c0 tx=0x7f85b801b340 comp rx=0 tx=0).stop 2024-09-12T17:13:15.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 -- 172.21.15.193:0/2564618180 shutdown_connections 2024-09-12T17:13:15.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/2564618180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ab282e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 -- 172.21.15.193:0/2564618180 >> 172.21.15.193:0/2564618180 conn(0x555d3ab23a20 msgr2=0x555d3ab25e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 -- 172.21.15.193:0/2564618180 shutdown_connections 2024-09-12T17:13:15.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.665+0000 7f85c83a19c0 1 -- 172.21.15.193:0/2564618180 wait complete. 2024-09-12T17:13:15.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c83a19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c83a19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555d3aa30680 con 0x555d3ab27f00 2024-09-12T17:13:15.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c5ea7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c5ea7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45858/0 (socket says 172.21.15.193:45858) 2024-09-12T17:13:15.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1859026825 learned_addr learned my addr 172.21.15.193:0/1859026825 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1859026825 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3a9abda0 con 0x555d3ab27f00 2024-09-12T17:13:15.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.681+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1859026825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f85b80ac040 tx=0x7f85b8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f29578569be67c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b3e07640 1 -- 172.21.15.193:0/1859026825 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80aa970 con 0x555d3ab27f00 2024-09-12T17:13:15.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b3e07640 1 -- 172.21.15.193:0/1859026825 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b80aab10 con 0x555d3ab27f00 2024-09-12T17:13:15.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b3e07640 1 -- 172.21.15.193:0/1859026825 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80aae30 con 0x555d3ab27f00 2024-09-12T17:13:15.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1859026825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 msgr2=0x555d3ac135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1859026825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f85b80ac040 tx=0x7f85b8003030 comp rx=0 tx=0).stop 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1859026825 shutdown_connections 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1859026825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac135e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1859026825 >> 172.21.15.193:0/1859026825 conn(0x555d3ab23a20 msgr2=0x555d3ac0f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1859026825 shutdown_connections 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1859026825 wait complete. 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555d3a9d2a50 con 0x555d3ab27f00 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c5ea7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c5ea7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45860/0 (socket says 172.21.15.193:45860) 2024-09-12T17:13:15.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1207152119 learned_addr learned my addr 172.21.15.193:0/1207152119 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3ac1b110 con 0x555d3ab27f00 2024-09-12T17:13:15.690 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f85b801b170 tx=0x7f85b80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b2604640 1 -- 172.21.15.193:0/1207152119 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80c6690 con 0x555d3ab27f00 2024-09-12T17:13:15.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d3ac1b3a0 con 0x555d3ab27f00 2024-09-12T17:13:15.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b2604640 1 -- 172.21.15.193:0/1207152119 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b80cc070 con 0x555d3ab27f00 2024-09-12T17:13:15.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f84b2604640 1 -- 172.21.15.193:0/1207152119 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85b80c69a0 con 0x555d3ab27f00 2024-09-12T17:13:15.691 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.685+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3ac1bd50 con 0x555d3ab27f00 2024-09-12T17:13:15.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f84b2604640 1 -- 172.21.15.193:0/1207152119 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85b80c6c10 con 0x555d3ab27f00 2024-09-12T17:13:15.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f84b2604640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 0x7f84ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f84b2604640 1 -- 172.21.15.193:0/1207152119 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f85b80ebd70 con 0x555d3ab27f00 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 0x7f84ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 0x555d3ac21d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac22260 con 0x555d3ab2b040 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 0x555d3ac21d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 0x7f84ac03bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f85bc000c10 tx=0x7f85bc0013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 0x555d3ac21d20 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 -- 172.21.15.193:0/1207152119 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85c000a4d0 con 0x555d3ab2b040 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac22620 con 0x555d3ab2b040 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 -- 172.21.15.193:0/1207152119 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85c000a4d0 con 0x555d3ab2b040 2024-09-12T17:13:15.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac23f20 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 -- 172.21.15.193:0/1207152119 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85c000a4d0 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac23150 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 -- 172.21.15.193:0/1207152119 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85c000a4d0 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac23570 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c66a8640 1 -- 172.21.15.193:0/1207152119 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85c000a4d0 con 0x555d3ab2b040 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.689+0000 7f85c83a19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555d3aa3d450 con 0x555d3ac322c0 2024-09-12T17:13:15.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45862/0 (socket says 172.21.15.193:45862) 2024-09-12T17:13:15.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c56a6640 1 -- 172.21.15.193:0/3277435514 learned_addr learned my addr 172.21.15.193:0/3277435514 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c56a6640 1 -- 172.21.15.193:0/3277435514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3ac32d20 con 0x555d3ac322c0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c56a6640 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00e620 tx=0x7f85bc00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 -- 172.21.15.193:0/3277435514 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc022070 con 0x555d3ac322c0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d3ac33580 con 0x555d3ac322c0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 -- 172.21.15.193:0/3277435514 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc01b380 con 0x555d3ac322c0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 -- 172.21.15.193:0/3277435514 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc01b660 con 0x555d3ac322c0 2024-09-12T17:13:15.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3ac33af0 con 0x555d3ac322c0 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 -- 172.21.15.193:0/3277435514 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85bc025070 con 0x555d3ac322c0 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 0x7f84a003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f84ab7fe640 1 -- 172.21.15.193:0/3277435514 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f85bc0517d0 con 0x555d3ac322c0 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c66a8640 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 0x7f84a003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.698 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c66a8640 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 0x7f84a003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x555d3ac234f0 tx=0x7f85c0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.693+0000 7f85c83a19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555d3ac13d70 con 0x555d3ac3fc90 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45866/0 (socket says 172.21.15.193:45866) 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 -- 172.21.15.193:0/3714874523 learned_addr learned my addr 172.21.15.193:0/3714874523 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 -- 172.21.15.193:0/3714874523 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3ac40660 con 0x555d3ac3fc90 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- 172.21.15.193:0/3714874523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f85bc04fb30 tx=0x7f85bc0247b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b762f642a6a241ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84a97fa640 1 -- 172.21.15.193:0/3714874523 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc00d300 con 0x555d3ac3fc90 2024-09-12T17:13:15.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84a97fa640 1 -- 172.21.15.193:0/3714874523 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc024c40 con 0x555d3ac3fc90 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84a97fa640 1 -- 172.21.15.193:0/3714874523 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc00d4a0 con 0x555d3ac3fc90 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3714874523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 msgr2=0x555d3ac40070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3714874523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f85bc04fb30 tx=0x7f85bc0247b0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3714874523 shutdown_connections 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3714874523 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac40070 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3714874523 >> 172.21.15.193:0/3714874523 conn(0x555d3ac3b050 msgr2=0x555d3ac39290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3714874523 shutdown_connections 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3714874523 wait complete. 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 Processor -- start 2024-09-12T17:13:15.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- start start 2024-09-12T17:13:15.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac46150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555d3ac3eb80 con 0x555d3ac3fc90 2024-09-12T17:13:15.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac46150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac46150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45882/0 (socket says 172.21.15.193:45882) 2024-09-12T17:13:15.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 learned_addr learned my addr 172.21.15.193:0/1714275016 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3ac466b0 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac46150 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f85bc04ea00 tx=0x7f85bc04fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84977fe640 1 -- 172.21.15.193:0/1714275016 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc04e3e0 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d3ac46940 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84977fe640 1 -- 172.21.15.193:0/1714275016 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc04e580 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.697+0000 7f84977fe640 1 -- 172.21.15.193:0/1714275016 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85bc01b800 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3ac46940 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f84977fe640 1 -- 172.21.15.193:0/1714275016 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f85bc051b70 con 0x555d3ac3fc90 2024-09-12T17:13:15.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f84977fe640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8490039a70 0x7f849003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f84977fe640 1 -- 172.21.15.193:0/1714275016 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f85bc04b040 con 0x555d3ac3fc90 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8490039a70 0x7f849003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ac512d0 0x555d3ac53760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac53eb0 con 0x555d3ac512d0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ac512d0 0x555d3ac53760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8490039a70 0x7f849003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x555d3ac22c70 tx=0x7f85c001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ac512d0 0x555d3ac53760 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 realm 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac542c0 con 0x555d3ac512d0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac54b90 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac54f30 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac55780 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 20 searching for the correct realm 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555d3ac574f0 0x555d3ac598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.701+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555d3ac574f0 0x555d3ac598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555d3ac574f0 0x555d3ac598e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c56a6640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85bc027060 0x7f85bc027660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85bc027060 0x7f85bc027660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85bc027060 0x7f85bc027660 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c66a8640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85c0031040 0x7f85c0032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85c0031040 0x7f85c0032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85c0031040 0x7f85c0032430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.705+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.709+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc03c070 con 0x555d3ac574f0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.713+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac574f0 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85c0031040 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x555d3ac512d0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac59e20 con 0x7f85bc027060 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85c001f070 con 0x7f85bc027060 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac56130 con 0x555d3ac512d0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac56980 con 0x555d3ac512d0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac56980 con 0x555d3ac512d0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 zone default found 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 4 Realm: () 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:15.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 zonegroup default 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5a250 con 0x7f85c0031040 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5bd40 con 0x555d3ac574f0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.717+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5c1b0 con 0x555d3ac574f0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 20 started sync module instance, tier type = 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5b0e0 con 0x7f85bc027060 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858906354896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5ad40 con 0x7f85bc027060 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5d0e0 con 0x555d3ac512d0 2024-09-12T17:13:15.729 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858906354896] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858906359312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5d0e0 con 0x555d3ac512d0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.721+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5daa0 con 0x555d3ac574f0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858906359312] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858906360880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5d050 con 0x555d3ac574f0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5e7a0 con 0x7f85bc027060 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858906367008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5f040 con 0x7f85bc027060 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.725+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5fa40 con 0x555d3ac512d0 2024-09-12T17:13:15.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858906360880] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858906367008] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858906365504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5eb90 con 0x555d3ac512d0 2024-09-12T17:13:15.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac602e0 con 0x7f85c0031040 2024-09-12T17:13:15.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858906365504] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858906371408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5eb90 con 0x7f85c0031040 2024-09-12T17:13:15.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.729+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac60750 con 0x7f85c0031040 2024-09-12T17:13:15.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.733+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.733+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858906374720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac60bc0 con 0x7f85c0031040 2024-09-12T17:13:15.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.733+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac61680 con 0x7f85c0031040 2024-09-12T17:13:15.737 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.733+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858906371408] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858906374720] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858906378544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac60750 con 0x7f85c0031040 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=0 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=1 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=2 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=3 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=4 2024-09-12T17:13:15.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=5 2024-09-12T17:13:15.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=6 2024-09-12T17:13:15.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858906378544] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 20 add_watcher() i=7 2024-09-12T17:13:15.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:15.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac64780 con 0x555d3ac512d0 2024-09-12T17:13:15.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.737+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858906373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac61c00 con 0x555d3ac512d0 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858906373072] v34'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f84777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 5 note: GC not initialized 2024-09-12T17:13:15.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f84767fc640 20 reqs_thread_entry: start 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 Filter name: none 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f83e7fff640 20 reqs_thread_entry: start 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac87800 con 0x7f85c0031040 2024-09-12T17:13:15.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-12T17:13:15.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac85ea0 con 0x555d3ac512d0 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-12T17:13:15.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.741+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac86860 con 0x7f85c0031040 2024-09-12T17:13:15.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:15.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.750 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93858906531936 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac8b2a0 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== watch-notify(notify (1) cookie 93858906365504 notify 146028888109 ret 0) ==== 691+0+0 (crc 0 0 0) 0x555d3ac87320 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888109 cookie 93858906365504 notifier 4832 bl.length()=649 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a97fa640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f8488003eb0 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify cookie 93858906531936 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== watch-notify(notify_complete (2) cookie 93858906531936 notify 146028888109 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f85b80e6040 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac86860 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93858906531936 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac8b2a0 con 0x555d3ac574f0 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== watch-notify(notify (1) cookie 93858906360880 notify 146028888072 ret 0) ==== 219+0+0 (crc 0 0 0) 0x555d3ac466b0 con 0x555d3ac574f0 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888072 cookie 93858906360880 notifier 4832 bl.length()=177 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f84a8ff9640 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f83f0003410 con 0x555d3ac574f0 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(68 notify.2 [notify cookie 93858906531936 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.745+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== watch-notify(notify_complete (2) cookie 93858906531936 notify 146028888072 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555d3ac40660 con 0x555d3ac574f0 2024-09-12T17:13:15.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.753 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:15.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f84777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:15.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858906373072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac85550 con 0x555d3ac512d0 2024-09-12T17:13:15.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93858906373072] v34'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858906354896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac85550 con 0x7f85bc027060 2024-09-12T17:13:15.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93858906354896] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c83a19c0 20 remove_watcher() i=0 2024-09-12T17:13:15.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c83a19c0 2 removed watcher, disabling cache 2024-09-12T17:13:15.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.749+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858906359312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5b4d0 con 0x555d3ac512d0 2024-09-12T17:13:15.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93858906359312] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c83a19c0 20 remove_watcher() i=1 2024-09-12T17:13:15.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858906360880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac85550 con 0x555d3ac574f0 2024-09-12T17:13:15.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c56a6640 1 -- 172.21.15.193:0/1714275016 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93858906360880] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85bc05c040 con 0x555d3ac574f0 2024-09-12T17:13:15.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c83a19c0 20 remove_watcher() i=2 2024-09-12T17:13:15.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.753+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858906367008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5b4d0 con 0x7f85bc027060 2024-09-12T17:13:15.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c66a8640 1 -- 172.21.15.193:0/1714275016 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93858906367008] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85c0040040 con 0x7f85bc027060 2024-09-12T17:13:15.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c83a19c0 20 remove_watcher() i=3 2024-09-12T17:13:15.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858906365504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5cc30 con 0x555d3ac512d0 2024-09-12T17:13:15.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93858906365504] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x555d3ac512d0 2024-09-12T17:13:15.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c83a19c0 20 remove_watcher() i=4 2024-09-12T17:13:15.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.757+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858906371408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac85550 con 0x7f85c0031040 2024-09-12T17:13:15.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93858906371408] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c83a19c0 20 remove_watcher() i=5 2024-09-12T17:13:15.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858906374720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5e420 con 0x7f85c0031040 2024-09-12T17:13:15.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93858906374720] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c83a19c0 20 remove_watcher() i=6 2024-09-12T17:13:15.765 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.761+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858906378544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555d3ac5b4d0 con 0x7f85c0031040 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93858906378544] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85b80bd3f0 con 0x7f85c0031040 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 20 remove_watcher() i=7 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85c0031040 msgr2=0x7f85c0032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f85c0031040 0x7f85c0032430 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ac512d0 msgr2=0x555d3ac53760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ac512d0 0x555d3ac53760 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85bc027060 msgr2=0x7f85bc027660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f85bc027060 0x7f85bc027660 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555d3ac574f0 msgr2=0x555d3ac598e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x555d3ac574f0 0x555d3ac598e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8490039a70 msgr2=0x7f849003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8490039a70 0x7f849003bf30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x555d3ac22c70 tx=0x7f85c001f000 comp rx=0 tx=0).stop 2024-09-12T17:13:15.769 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 msgr2=0x555d3ac46150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1714275016 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac3fc90 0x555d3ac46150 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f85bc04ea00 tx=0x7f85bc04fac0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c5ea7640 1 -- 172.21.15.193:0/1714275016 reap_dead start 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 shutdown_connections 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 >> 172.21.15.193:0/1714275016 conn(0x555d3ac3b050 msgr2=0x555d3ac39260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 shutdown_connections 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1714275016 wait complete. 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 msgr2=0x7f84a003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 0x7f84a003bf30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x555d3ac234f0 tx=0x7f85c0005850 comp rx=0 tx=0).stop 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 msgr2=0x555d3ac326e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00e620 tx=0x7f85bc00e650 comp rx=0 tx=0).stop 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 shutdown_connections 2024-09-12T17:13:15.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84a0039a70 0x7f84a003bf30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/3277435514 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ac322c0 0x555d3ac326e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 >> 172.21.15.193:0/3277435514 conn(0x555d3ac27c70 msgr2=0x555d3ac28050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 shutdown_connections 2024-09-12T17:13:15.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/3277435514 wait complete. 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 msgr2=0x555d3ac21d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 0x555d3ac21d20 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 msgr2=0x7f84ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 0x7f84ac03bf30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f85bc000c10 tx=0x7f85bc0013c0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 msgr2=0x555d3ac1abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f85b801b170 tx=0x7f85b80180e0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 shutdown_connections 2024-09-12T17:13:15.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x555d3ab2b040 0x555d3ac21d20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f84ac039a70 0x7f84ac03bf30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 --2- 172.21.15.193:0/1207152119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555d3ab27f00 0x555d3ac1abb0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 >> 172.21.15.193:0/1207152119 conn(0x555d3ab23a20 msgr2=0x555d3ac0dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 shutdown_connections 2024-09-12T17:13:15.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.765+0000 7f85c83a19c0 1 -- 172.21.15.193:0/1207152119 wait complete. 2024-09-12T17:13:15.780 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:15.781 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:15.781 ERROR:root:0 2024-09-12T17:13:15.782 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:15.789 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000002c81b2c8bbfaf867-0066e3212b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:13:15.789 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-12T17:13:15.802 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:15.803 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-12T17:13:15.820 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-12T17:13:15.821 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-12T17:13:15.843 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T17:13:15.844 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-12T17:13:15.855 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-12T17:13:15.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:15.859 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:15.859 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-12T17:13:15.863 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:15.864 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:15.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:15.864 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-12T17:13:15.901 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:15.901 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:15.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.897+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.897+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.897+0000 7f1ff35699c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56166f78bfa0 0x56166f78c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.897+0000 7f1ff35699c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56166f6409c0 con 0x56166f78f130 2024-09-12T17:13:15.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.897+0000 7f1ff35699c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x56166f6906d0 con 0x56166f78bfa0 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff106f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56166f78bfa0 0x56166f78c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff086e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x56166f78f130 0x56166f791520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44358/0 (socket says 172.21.15.193:44358) 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff106f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x56166f78bfa0 0x56166f78c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45892/0 (socket says 172.21.15.193:45892) 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff086e640 1 -- 172.21.15.193:0/1938572939 learned_addr learned my addr 172.21.15.193:0/1938572939 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff106f640 1 -- 172.21.15.193:0/1938572939 >> v1:172.21.15.62:6789/0 conn(0x56166f78f130 legacy=0x56166f791520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff106f640 1 -- 172.21.15.193:0/1938572939 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f634ca0 con 0x56166f78bfa0 2024-09-12T17:13:15.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff106f640 1 --2- 172.21.15.193:0/1938572939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f78c380 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00a420 tx=0x7f1fec01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2d5b5d24dea7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1fe3fff640 1 -- 172.21.15.193:0/1938572939 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0af070 con 0x56166f78bfa0 2024-09-12T17:13:15.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1fe3fff640 1 -- 172.21.15.193:0/1938572939 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0aa530 con 0x56166f78bfa0 2024-09-12T17:13:15.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1fe3fff640 1 -- 172.21.15.193:0/1938572939 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0aa850 con 0x56166f78bfa0 2024-09-12T17:13:15.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1938572939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 msgr2=0x56166f78c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/1938572939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f78c380 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00a420 tx=0x7f1fec01afd0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1938572939 shutdown_connections 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/1938572939 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f78c380 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1938572939 >> 172.21.15.193:0/1938572939 conn(0x56166f787ac0 msgr2=0x56166f789ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.901+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1938572939 shutdown_connections 2024-09-12T17:13:15.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.905+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1938572939 wait complete. 2024-09-12T17:13:15.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.917+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.917+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56166f694680 con 0x56166f78bfa0 2024-09-12T17:13:15.923 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45900/0 (socket says 172.21.15.193:45900) 2024-09-12T17:13:15.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 -- 172.21.15.193:0/1846855167 learned_addr learned my addr 172.21.15.193:0/1846855167 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 -- 172.21.15.193:0/1846855167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f60fda0 con 0x56166f78bfa0 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 --2- 172.21.15.193:0/1846855167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0ad040 tx=0x7f1fec0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e29efb4adcff4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1edf606640 1 -- 172.21.15.193:0/1846855167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0af040 con 0x56166f78bfa0 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1edf606640 1 -- 172.21.15.193:0/1846855167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0aaa60 con 0x56166f78bfa0 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1edf606640 1 -- 172.21.15.193:0/1846855167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0aad40 con 0x56166f78bfa0 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1846855167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 msgr2=0x56166f877720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/1846855167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0ad040 tx=0x7f1fec0033b0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1846855167 shutdown_connections 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/1846855167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f877720 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1846855167 >> 172.21.15.193:0/1846855167 conn(0x56166f787ac0 msgr2=0x56166f8733c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1846855167 shutdown_connections 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- 172.21.15.193:0/1846855167 wait complete. 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff35699c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56166f636a50 con 0x56166f78bfa0 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45910/0 (socket says 172.21.15.193:45910) 2024-09-12T17:13:15.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.921+0000 7f1ff106f640 1 -- 172.21.15.193:0/2045571973 learned_addr learned my addr 172.21.15.193:0/2045571973 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff106f640 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f87f170 con 0x56166f78bfa0 2024-09-12T17:13:15.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff106f640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0b8040 tx=0x7f1fec017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.928 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 -- 172.21.15.193:0/2045571973 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0c5070 con 0x56166f78bfa0 2024-09-12T17:13:15.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 -- 172.21.15.193:0/2045571973 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0c1690 con 0x56166f78bfa0 2024-09-12T17:13:15.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56166f87f400 con 0x56166f78bfa0 2024-09-12T17:13:15.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 -- 172.21.15.193:0/2045571973 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fec0c1970 con 0x56166f78bfa0 2024-09-12T17:13:15.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166f87fe30 con 0x56166f78bfa0 2024-09-12T17:13:15.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 -- 172.21.15.193:0/2045571973 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1fec0c8070 con 0x56166f78bfa0 2024-09-12T17:13:15.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 0x7f1ed803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1edde03640 1 -- 172.21.15.193:0/2045571973 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1fec0bb070 con 0x56166f78bfa0 2024-09-12T17:13:15.930 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 0x7f1ed803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 0x56166f885d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8862c0 con 0x56166f78f130 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 0x56166f885d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 0x7f1ed803bf80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8004180 tx=0x7f1fe8001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 0x56166f885d80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff1870640 1 -- 172.21.15.193:0/2045571973 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fe40083f0 con 0x56166f78f130 2024-09-12T17:13:15.931 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.925+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f880160 con 0x56166f78f130 2024-09-12T17:13:15.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff1870640 1 -- 172.21.15.193:0/2045571973 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fe40083f0 con 0x56166f78f130 2024-09-12T17:13:15.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f888070 con 0x56166f78f130 2024-09-12T17:13:15.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff1870640 1 -- 172.21.15.193:0/2045571973 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1fe40083f0 con 0x56166f78f130 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8872d0 con 0x56166f78f130 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff1870640 1 -- 172.21.15.193:0/2045571973 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fe40083f0 con 0x56166f78f130 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8876f0 con 0x56166f78f130 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff1870640 1 -- 172.21.15.193:0/2045571973 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1fe40083f0 con 0x56166f78f130 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56166f6a1450 con 0x56166f896370 2024-09-12T17:13:15.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45926/0 (socket says 172.21.15.193:45926) 2024-09-12T17:13:15.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff086e640 1 -- 172.21.15.193:0/2971972720 learned_addr learned my addr 172.21.15.193:0/2971972720 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff086e640 1 -- 172.21.15.193:0/2971972720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f896dd0 con 0x56166f896370 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d660 tx=0x7f1fe800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ed6ffd640 1 -- 172.21.15.193:0/2971972720 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe800c6b0 con 0x56166f896370 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ed6ffd640 1 -- 172.21.15.193:0/2971972720 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe800c850 con 0x56166f896370 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56166f897630 con 0x56166f896370 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.929+0000 7f1ed6ffd640 1 -- 172.21.15.193:0/2971972720 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe800cb30 con 0x56166f896370 2024-09-12T17:13:15.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166f897ba0 con 0x56166f896370 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed6ffd640 1 -- 172.21.15.193:0/2971972720 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1fe8023020 con 0x56166f896370 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed6ffd640 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 0x7f1ec803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed6ffd640 1 -- 172.21.15.193:0/2971972720 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1fe8021020 con 0x56166f896370 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 0x7f1ec803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.936 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 0x7f1ec803bf30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56166f887670 tx=0x7f1fe4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff35699c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff35699c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56166f877e90 con 0x56166f7014e0 2024-09-12T17:13:15.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45936/0 (socket says 172.21.15.193:45936) 2024-09-12T17:13:15.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff086e640 1 -- 172.21.15.193:0/823846252 learned_addr learned my addr 172.21.15.193:0/823846252 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff086e640 1 -- 172.21.15.193:0/823846252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f701e00 con 0x56166f7014e0 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ff086e640 1 --2- 172.21.15.193:0/823846252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8050f50 tx=0x7f1fe8023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e950a83db76bdbbc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed4ff9640 1 -- 172.21.15.193:0/823846252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8047070 con 0x56166f7014e0 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed4ff9640 1 -- 172.21.15.193:0/823846252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe800cd20 con 0x56166f7014e0 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.933+0000 7f1ed4ff9640 1 -- 172.21.15.193:0/823846252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe801bcc0 con 0x56166f7014e0 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/823846252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 msgr2=0x56166f7018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/823846252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8050f50 tx=0x7f1fe8023430 comp rx=0 tx=0).stop 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/823846252 shutdown_connections 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/823846252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f7018c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/823846252 >> 172.21.15.193:0/823846252 conn(0x56166f89f160 msgr2=0x56166f89d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:15.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/823846252 shutdown_connections 2024-09-12T17:13:15.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/823846252 wait complete. 2024-09-12T17:13:15.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 Processor -- start 2024-09-12T17:13:15.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- start start 2024-09-12T17:13:15.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56166f7023f0 con 0x56166f7014e0 2024-09-12T17:13:15.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff086e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45944/0 (socket says 172.21.15.193:45944) 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 learned_addr learned my addr 172.21.15.193:0/2290449377 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56166f8aca20 con 0x56166f7014e0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8023ad0 tx=0x7f1fe804d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ec6ffd640 1 -- 172.21.15.193:0/2290449377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8034070 con 0x56166f7014e0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ec6ffd640 1 -- 172.21.15.193:0/2290449377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe80196f0 con 0x56166f7014e0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56166f8accb0 con 0x56166f7014e0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ec6ffd640 1 -- 172.21.15.193:0/2290449377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1fe8047030 con 0x56166f7014e0 2024-09-12T17:13:15.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56166f8accb0 con 0x56166f7014e0 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ec6ffd640 1 -- 172.21.15.193:0/2290449377 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f1fe8037070 con 0x56166f7014e0 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.937+0000 7f1ec6ffd640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ebc039a20 0x7f1ebc03bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ec6ffd640 1 -- 172.21.15.193:0/2290449377 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f1fe8005030 con 0x56166f7014e0 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ebc039a20 0x7f1ebc03bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ebc039a20 0x7f1ebc03bee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f010 tx=0x7f1fe401c070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f8b7610 0x56166f8b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8ba220 con 0x56166f8b7610 2024-09-12T17:13:15.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f8b7610 0x56166f8b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f8b7610 0x56166f8b9ad0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 realm 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8ba630 con 0x56166f8b7610 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8baf00 con 0x56166f8b7610 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bb2a0 con 0x56166f8b7610 2024-09-12T17:13:15.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 20 searching for the correct realm 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56166f8bd860 0x56166f8bfc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c0190 con 0x56166f8bd860 2024-09-12T17:13:15.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56166f8bd860 0x56166f8bfc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56166f8bd860 0x56166f8bfc50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.948 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff086e640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1fe8039070 0x7f1fe801a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.941+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c0190 con 0x7f1fe8039070 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1fe8039070 0x7f1fe801a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1fe8039070 0x7f1fe801a590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff1870640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1fe401a940 0x7f1fe4011430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c0190 con 0x7f1fe401a940 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1fe401a940 0x7f1fe4011430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1fe401a940 0x7f1fe4011430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.945+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe8039070 2024-09-12T17:13:15.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe8039070 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.954 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.949+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8bd860 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe8039070 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x56166f8b7610 2024-09-12T17:13:15.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bbaf0 con 0x7f1fe401a940 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x56166f8bd860 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.953+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x7f1fe401a940 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x7f1fe8039070 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x56166f8bd860 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x7f1fe401a940 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x56166f8b7610 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f1fec0fd040 con 0x7f1fe8039070 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:15.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bc0b0 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bc950 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bc4a0 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:15.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 zone default found 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 4 Realm: () 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 zonegroup default 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.957+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8bc8d0 con 0x7f1fe401a940 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c1b80 con 0x56166f8bd860 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c1f20 con 0x56166f8bd860 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 started sync module instance, tier type = 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:15.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c1020 con 0x7f1fe8039070 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94654360720400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c0c80 con 0x7f1fe8039070 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c2de0 con 0x56166f8b7610 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.961+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94654360720400] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94654360725808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c3200 con 0x56166f8b7610 2024-09-12T17:13:15.967 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c3a90 con 0x56166f8bd860 2024-09-12T17:13:15.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94654360725808] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94654360727136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c3e80 con 0x56166f8bd860 2024-09-12T17:13:15.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.965+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c4840 con 0x7f1fe8039070 2024-09-12T17:13:15.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94654360732864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c50e0 con 0x7f1fe8039070 2024-09-12T17:13:15.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c5aa0 con 0x56166f8b7610 2024-09-12T17:13:15.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94654360727136] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94654360732864] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94654360734768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c5aa0 con 0x56166f8b7610 2024-09-12T17:13:15.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.969+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c5050 con 0x7f1fe401a940 2024-09-12T17:13:15.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94654360734768] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94654360737264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c5ec0 con 0x7f1fe401a940 2024-09-12T17:13:15.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c6880 con 0x7f1fe401a940 2024-09-12T17:13:15.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94654360740816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c6ca0 con 0x7f1fe401a940 2024-09-12T17:13:15.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c7740 con 0x7f1fe401a940 2024-09-12T17:13:15.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.973+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94654360737264] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94654360740816] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94654360744496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c67f0 con 0x7f1fe401a940 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=0 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=1 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=2 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=3 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=4 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=5 2024-09-12T17:13:15.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=6 2024-09-12T17:13:15.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94654360744496] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 20 add_watcher() i=7 2024-09-12T17:13:15.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:15.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c67f0 con 0x56166f8b7610 2024-09-12T17:13:15.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.977+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94654360738320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c67f0 con 0x56166f8b7610 2024-09-12T17:13:15.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94654360738320] v34'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ea77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:15.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:15.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:15.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 5 note: GC not initialized 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ea67e4640 20 reqs_thread_entry: start 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 Filter name: none 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1e17fff640 20 reqs_thread_entry: start 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:15.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8ed890 con 0x7f1fe401a940 2024-09-12T17:13:15.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T17:13:15.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:15.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:15.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.981+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8f40d0 con 0x7f1fe401a940 2024-09-12T17:13:15.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:15.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff35699c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:15.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff35699c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff35699c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94654360927104 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56166f8ef820 con 0x56166f8b7610 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94654360734768 notify 146028888111 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56166f87fe30 con 0x56166f8b7610 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ed4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888111 cookie 94654360734768 notifier 4839 bl.length()=636 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ed4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ed4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94654360927104 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ed4ff9640 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1eb4003eb0 con 0x56166f8b7610 2024-09-12T17:13:15.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.985+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94654360927104 notify 146028888111 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56166f87f400 con 0x56166f8b7610 2024-09-12T17:13:15.991 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:15.991 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ea77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:15.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94654360738320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8eb640 con 0x56166f8b7610 2024-09-12T17:13:15.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94654360738320] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94654360720400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8eb640 con 0x7f1fe8039070 2024-09-12T17:13:15.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94654360720400] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:15.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff35699c0 20 remove_watcher() i=0 2024-09-12T17:13:15.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff35699c0 2 removed watcher, disabling cache 2024-09-12T17:13:15.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.989+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94654360725808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c1410 con 0x56166f8b7610 2024-09-12T17:13:15.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94654360725808] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:15.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff35699c0 20 remove_watcher() i=1 2024-09-12T17:13:15.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94654360727136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8eb640 con 0x56166f8bd860 2024-09-12T17:13:15.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff086e640 1 -- 172.21.15.193:0/2290449377 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94654360727136] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe8036030 con 0x56166f8bd860 2024-09-12T17:13:15.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff35699c0 20 remove_watcher() i=2 2024-09-12T17:13:15.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.993+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94654360732864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c2930 con 0x7f1fe8039070 2024-09-12T17:13:15.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff1870640 1 -- 172.21.15.193:0/2290449377 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94654360732864] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fe4030040 con 0x7f1fe8039070 2024-09-12T17:13:16.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff35699c0 20 remove_watcher() i=3 2024-09-12T17:13:16.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94654360734768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c1410 con 0x56166f8b7610 2024-09-12T17:13:16.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94654360734768] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x56166f8b7610 2024-09-12T17:13:16.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff35699c0 20 remove_watcher() i=4 2024-09-12T17:13:16.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:15.997+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94654360737264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c2e60 con 0x7f1fe401a940 2024-09-12T17:13:16.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94654360737264] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:16.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff35699c0 20 remove_watcher() i=5 2024-09-12T17:13:16.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94654360740816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8eb640 con 0x7f1fe401a940 2024-09-12T17:13:16.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94654360740816] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:16.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff35699c0 20 remove_watcher() i=6 2024-09-12T17:13:16.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.001+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94654360744496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56166f8c2930 con 0x7f1fe401a940 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94654360744496] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1fec0d1070 con 0x7f1fe401a940 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 20 remove_watcher() i=7 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1fe401a940 msgr2=0x7f1fe4011430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f1fe401a940 0x7f1fe4011430 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f8b7610 msgr2=0x56166f8b9ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f8b7610 0x56166f8b9ad0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1fe8039070 msgr2=0x7f1fe801a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f1fe8039070 0x7f1fe801a590 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56166f8bd860 msgr2=0x56166f8bfc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x56166f8bd860 0x56166f8bfc50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ebc039a20 msgr2=0x7f1ebc03bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ebc039a20 0x7f1ebc03bee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400f010 tx=0x7f1fe401c070 comp rx=0 tx=0).stop 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 msgr2=0x56166f8ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8023ad0 tx=0x7f1fe804d040 comp rx=0 tx=0).stop 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff106f640 1 -- 172.21.15.193:0/2290449377 reap_dead start 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 shutdown_connections 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2290449377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f7014e0 0x56166f8ac4c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 >> 172.21.15.193:0/2290449377 conn(0x56166f89f160 msgr2=0x56166f89d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 shutdown_connections 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2290449377 wait complete. 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 msgr2=0x7f1ec803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 0x7f1ec803bf30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56166f887670 tx=0x7f1fe4003070 comp rx=0 tx=0).stop 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 msgr2=0x56166f896790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d660 tx=0x7f1fe800da60 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 shutdown_connections 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ec8039a70 0x7f1ec803bf30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2971972720 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f896370 0x56166f896790 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 >> 172.21.15.193:0/2971972720 conn(0x56166f88bd20 msgr2=0x56166f88c100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 shutdown_connections 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2971972720 wait complete. 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 msgr2=0x56166f885d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 0x56166f885d80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 msgr2=0x7f1ed803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 0x7f1ed803bf80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8004180 tx=0x7f1fe8001340 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 msgr2=0x56166f87ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0b8040 tx=0x7f1fec017d70 comp rx=0 tx=0).stop 2024-09-12T17:13:16.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 shutdown_connections 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x56166f78f130 0x56166f885d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f1ed8039ac0 0x7f1ed803bf80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 --2- 172.21.15.193:0/2045571973 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56166f78bfa0 0x56166f87ec10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 >> 172.21.15.193:0/2045571973 conn(0x56166f787ac0 msgr2=0x56166f871e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 shutdown_connections 2024-09-12T17:13:16.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.005+0000 7f1ff35699c0 1 -- 172.21.15.193:0/2045571973 wait complete. 2024-09-12T17:13:16.023 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.023 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.023 ERROR:root:0 2024-09-12T17:13:16.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T17:13:16.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-12T17:13:16.024 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-12T17:13:16.113 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:16.114 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:16.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff107bd79c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557b9d3c0690 0x557b9d3c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff107bd79c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b9d2729c0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff107bd79c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x557b9d2c26d0 con 0x557b9d3c0690 2024-09-12T17:13:16.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff1056dd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557b9d3c0690 0x557b9d3c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff104edc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x557b9d3c2fc0 0x557b9d3c53b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44364/0 (socket says 172.21.15.193:44364) 2024-09-12T17:13:16.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff104edc640 1 -- 172.21.15.193:0/1679392261 learned_addr learned my addr 172.21.15.193:0/1679392261 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:16.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff1056dd640 1 -- 172.21.15.193:0/1679392261 >> v1:172.21.15.62:6789/0 conn(0x557b9d3c2fc0 legacy=0x557b9d3c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff1056dd640 1 -- 172.21.15.193:0/1679392261 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d266ca0 con 0x557b9d3c0690 2024-09-12T17:13:16.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.113+0000 7ff1056dd640 1 --2- 172.21.15.193:0/1679392261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d3c2a80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800a420 tx=0x7ff0f801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49fcfa9bd796fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff0fffff640 1 -- 172.21.15.193:0/1679392261 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80af070 con 0x557b9d3c0690 2024-09-12T17:13:16.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff0fffff640 1 -- 172.21.15.193:0/1679392261 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f80aa530 con 0x557b9d3c0690 2024-09-12T17:13:16.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff0fffff640 1 -- 172.21.15.193:0/1679392261 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80aa850 con 0x557b9d3c0690 2024-09-12T17:13:16.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1679392261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 msgr2=0x557b9d3c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1679392261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d3c2a80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800a420 tx=0x7ff0f801afd0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1679392261 shutdown_connections 2024-09-12T17:13:16.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1679392261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d3c2a80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1679392261 >> 172.21.15.193:0/1679392261 conn(0x557b9d333a20 msgr2=0x557b9d333e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1679392261 shutdown_connections 2024-09-12T17:13:16.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.117+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1679392261 wait complete. 2024-09-12T17:13:16.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.129+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.129+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b9d2c6680 con 0x557b9d3c0690 2024-09-12T17:13:16.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45966/0 (socket says 172.21.15.193:45966) 2024-09-12T17:13:16.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 -- 172.21.15.193:0/280612779 learned_addr learned my addr 172.21.15.193:0/280612779 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 -- 172.21.15.193:0/280612779 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d241da0 con 0x557b9d3c0690 2024-09-12T17:13:16.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 --2- 172.21.15.193:0/280612779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80ad040 tx=0x7ff0f80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45d9f0beb75919c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7feff3606640 1 -- 172.21.15.193:0/280612779 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80af050 con 0x557b9d3c0690 2024-09-12T17:13:16.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7feff3606640 1 -- 172.21.15.193:0/280612779 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f80b0040 con 0x557b9d3c0690 2024-09-12T17:13:16.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7feff3606640 1 -- 172.21.15.193:0/280612779 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80aaad0 con 0x557b9d3c0690 2024-09-12T17:13:16.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- 172.21.15.193:0/280612779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 msgr2=0x557b9d4ab830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/280612779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80ad040 tx=0x7ff0f80033b0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- 172.21.15.193:0/280612779 shutdown_connections 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/280612779 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4ab830 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- 172.21.15.193:0/280612779 >> 172.21.15.193:0/280612779 conn(0x557b9d333a20 msgr2=0x557b9d4a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- 172.21.15.193:0/280612779 shutdown_connections 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- 172.21.15.193:0/280612779 wait complete. 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff107bd79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b9d268a50 con 0x557b9d3c0690 2024-09-12T17:13:16.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45978/0 (socket says 172.21.15.193:45978) 2024-09-12T17:13:16.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.133+0000 7ff1056dd640 1 -- 172.21.15.193:0/1524421649 learned_addr learned my addr 172.21.15.193:0/1524421649 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.139 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff1056dd640 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d4b32f0 con 0x557b9d3c0690 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff1056dd640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80aa500 tx=0x7ff0f8017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 -- 172.21.15.193:0/1524421649 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80b6c40 con 0x557b9d3c0690 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b9d4b3580 con 0x557b9d3c0690 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 -- 172.21.15.193:0/1524421649 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f80b6de0 con 0x557b9d3c0690 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 -- 172.21.15.193:0/1524421649 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f80bf590 con 0x557b9d3c0690 2024-09-12T17:13:16.140 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9d4b3f30 con 0x557b9d3c0690 2024-09-12T17:13:16.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 -- 172.21.15.193:0/1524421649 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0f80bf800 con 0x557b9d3c0690 2024-09-12T17:13:16.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 0x7fefec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7feff1e03640 1 -- 172.21.15.193:0/1524421649 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff0f80bb070 con 0x557b9d3c0690 2024-09-12T17:13:16.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff104edc640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 0x7fefec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 0x557b9d4b9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ba440 con 0x557b9d3c2fc0 2024-09-12T17:13:16.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff105ede640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 0x557b9d4b9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff104edc640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 0x7fefec03bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0004180 tx=0x7ff0f0001340 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff105ede640 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 0x557b9d4b9f00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff105ede640 1 -- 172.21.15.193:0/1524421649 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1000083f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4b4310 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.137+0000 7ff105ede640 1 -- 172.21.15.193:0/1524421649 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1000083f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4bc1a0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff105ede640 1 -- 172.21.15.193:0/1524421649 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1000083f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4bb3d0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff105ede640 1 -- 172.21.15.193:0/1524421649 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1000083f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4bb7f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff105ede640 1 -- 172.21.15.193:0/1524421649 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1000083f0 con 0x557b9d3c2fc0 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b9d2d3450 con 0x557b9d4ca4c0 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45992/0 (socket says 172.21.15.193:45992) 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff104edc640 1 -- 172.21.15.193:0/1498247009 learned_addr learned my addr 172.21.15.193:0/1498247009 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff104edc640 1 -- 172.21.15.193:0/1498247009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d4caf20 con 0x557b9d4ca4c0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff104edc640 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d660 tx=0x7ff0f000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7fefeaffd640 1 -- 172.21.15.193:0/1498247009 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f000c6b0 con 0x557b9d4ca4c0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7fefeaffd640 1 -- 172.21.15.193:0/1498247009 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f000c850 con 0x557b9d4ca4c0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b9d4cb780 con 0x557b9d4ca4c0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7fefeaffd640 1 -- 172.21.15.193:0/1498247009 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f000cb30 con 0x557b9d4ca4c0 2024-09-12T17:13:16.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.141+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9d4cbcf0 con 0x557b9d4ca4c0 2024-09-12T17:13:16.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefeaffd640 1 -- 172.21.15.193:0/1498247009 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0f0023020 con 0x557b9d4ca4c0 2024-09-12T17:13:16.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefeaffd640 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 0x7fefdc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefeaffd640 1 -- 172.21.15.193:0/1498247009 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff0f0021020 con 0x557b9d4ca4c0 2024-09-12T17:13:16.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff105ede640 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 0x7fefdc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b9d4abfc0 con 0x557b9d4d7e80 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff105ede640 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 0x7fefdc03bf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x557b9d4bb770 tx=0x7ff100003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46004/0 (socket says 172.21.15.193:46004) 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff104edc640 1 -- 172.21.15.193:0/2894107284 learned_addr learned my addr 172.21.15.193:0/2894107284 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff104edc640 1 -- 172.21.15.193:0/2894107284 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d4d8870 con 0x557b9d4d7e80 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff104edc640 1 --2- 172.21.15.193:0/2894107284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0050f10 tx=0x7ff0f0023430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2018a7c4e4fab085 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefe8ff9640 1 -- 172.21.15.193:0/2894107284 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f000ccd0 con 0x557b9d4d7e80 2024-09-12T17:13:16.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefe8ff9640 1 -- 172.21.15.193:0/2894107284 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f0047020 con 0x557b9d4d7e80 2024-09-12T17:13:16.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7fefe8ff9640 1 -- 172.21.15.193:0/2894107284 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f001bcc0 con 0x557b9d4d7e80 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- 172.21.15.193:0/2894107284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 msgr2=0x557b9d4d8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/2894107284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0050f10 tx=0x7ff0f0023430 comp rx=0 tx=0).stop 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- 172.21.15.193:0/2894107284 shutdown_connections 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/2894107284 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4d8280 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- 172.21.15.193:0/2894107284 >> 172.21.15.193:0/2894107284 conn(0x557b9d4d32a0 msgr2=0x557b9d4d14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- 172.21.15.193:0/2894107284 shutdown_connections 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- 172.21.15.193:0/2894107284 wait complete. 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 Processor -- start 2024-09-12T17:13:16.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- start start 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4de390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.145+0000 7ff107bd79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557b9d4d6dd0 con 0x557b9d4d7e80 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff104edc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4de390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46020/0 (socket says 172.21.15.193:46020) 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 learned_addr learned my addr 172.21.15.193:0/3279200158 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b9d4de8f0 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff104edc640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4de390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0050fa0 tx=0x7ff0f0050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 -- 172.21.15.193:0/3279200158 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0034070 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b9d4deb80 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 -- 172.21.15.193:0/3279200158 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f0047070 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 -- 172.21.15.193:0/3279200158 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0f0019840 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9d4deb80 con 0x557b9d4d7e80 2024-09-12T17:13:16.153 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 -- 172.21.15.193:0/3279200158 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff0f0037070 con 0x557b9d4d7e80 2024-09-12T17:13:16.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefd00399d0 0x7fefd003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7fefdaffd640 1 -- 172.21.15.193:0/3279200158 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff0f0048070 con 0x557b9d4d7e80 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff105ede640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefd00399d0 0x7fefd003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d4e9540 0x557b9d4eb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ec120 con 0x557b9d4e9540 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff1056dd640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d4e9540 0x557b9d4eb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.149+0000 7ff105ede640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefd00399d0 0x7fefd003be90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff10000f010 tx=0x7ff10001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d4e9540 0x557b9d4eb9d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 realm 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ec530 con 0x557b9d4e9540 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ece00 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ed1a0 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ed9f0 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:16.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 20 searching for the correct realm 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557b9d4ef760 0x557b9d4f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff104edc640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557b9d4ef760 0x557b9d4f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff104edc640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557b9d4ef760 0x557b9d4f1b50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff104edc640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff0f0039070 0x7ff0f0052450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff105ede640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff0f0039070 0x7ff0f0052450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff105ede640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff0f0039070 0x7ff0f0052450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff105ede640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff100019040 0x7ff100019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff100019040 0x7ff100019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.153+0000 7ff1056dd640 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff100019040 0x7ff100019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.157+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.168 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.161+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4ef760 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff100019040 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x557b9d4e9540 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f2090 con 0x7ff0f0039070 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:16.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4ee2d0 con 0x557b9d4e9540 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4eeb70 con 0x557b9d4e9540 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.165+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f24c0 con 0x557b9d4e9540 2024-09-12T17:13:16.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 zone default found 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 4 Realm: () 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 zonegroup default 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f24c0 con 0x7ff100019040 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f42f0 con 0x557b9d4ef760 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f4760 con 0x557b9d4ef760 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 started sync module instance, tier type = 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f3790 con 0x7ff0f0039070 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989408553856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f5070 con 0x7ff0f0039070 2024-09-12T17:13:16.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f58c0 con 0x557b9d4e9540 2024-09-12T17:13:16.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.169+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93989408553856] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989408558016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f5490 con 0x557b9d4e9540 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f5f70 con 0x557b9d4ef760 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989408561792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f6810 con 0x557b9d4ef760 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f7210 con 0x7ff0f0039070 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.173+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93989408558016] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989408559072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f7600 con 0x7ff0f0039070 2024-09-12T17:13:16.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f7fc0 con 0x557b9d4e9540 2024-09-12T17:13:16.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93989408561792] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93989408559072] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989408566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f7b10 con 0x557b9d4e9540 2024-09-12T17:13:16.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.177+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f8860 con 0x7ff100019040 2024-09-12T17:13:16.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93989408566560] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989408564064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f7b10 con 0x7ff100019040 2024-09-12T17:13:16.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f8d20 con 0x7ff100019040 2024-09-12T17:13:16.185 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93989408564064] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989408573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f8ce0 con 0x7ff100019040 2024-09-12T17:13:16.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.181+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f96e0 con 0x7ff100019040 2024-09-12T17:13:16.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93989408573424] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989408571776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4f96a0 con 0x7ff100019040 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=0 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=1 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=2 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=3 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=4 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=5 2024-09-12T17:13:16.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.185+0000 7ff107bd79c0 20 add_watcher() i=6 2024-09-12T17:13:16.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93989408571776] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 add_watcher() i=7 2024-09-12T17:13:16.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:16.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4fcb00 con 0x557b9d4e9540 2024-09-12T17:13:16.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989408576448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d4fa020 con 0x557b9d4e9540 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93989408576448] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7fefbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 5 note: GC not initialized 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7fefbafe5640 20 reqs_thread_entry: start 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 Filter name: none 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7fefb8fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51fd50 con 0x7ff100019040 2024-09-12T17:13:16.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51e3f0 con 0x557b9d4ef760 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-12T17:13:16.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.189+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51ee70 con 0x7ff100019040 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93989408730736 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d523860 con 0x7ff0f0039070 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== watch-notify(notify (1) cookie 93989408553856 notify 146028888089 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7ff100010040 con 0x7ff0f0039070 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefe8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 93989408553856 notifier 4846 bl.length()=533 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefe8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefe8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(65 notify.0 [notify cookie 93989408730736 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefe8ff9640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fefc8003eb0 con 0x7ff0f0039070 2024-09-12T17:13:16.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== watch-notify(notify_complete (2) cookie 93989408730736 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff100026a50 con 0x7ff0f0039070 2024-09-12T17:13:16.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51ee70 con 0x557b9d4ef760 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 93989408730736 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b9d522940 con 0x557b9d4e9540 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 93989408558016 notify 146028888112 ret 0) ==== 218+0+0 (crc 0 0 0) 0x557b9d51f8f0 con 0x557b9d4e9540 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefdbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888112 cookie 93989408558016 notifier 4846 bl.length()=176 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefdbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-12T17:13:16.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefdbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-12T17:13:16.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7fefdbfff640 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fef2c003410 con 0x557b9d4e9540 2024-09-12T17:13:16.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.193+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(68 notify.1 [notify cookie 93989408730736 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 93989408730736 notify 146028888112 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff0f80d9040 con 0x557b9d4e9540 2024-09-12T17:13:16.200 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-12T17:13:16.194068Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:16.194055Z","tags":[],"group_ids":[]} 2024-09-12T17:13:16.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7fefbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989408576448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x557b9d4e9540 2024-09-12T17:13:16.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93989408576448] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989408553856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x7ff0f0039070 2024-09-12T17:13:16.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93989408553856] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff107bd79c0 20 remove_watcher() i=0 2024-09-12T17:13:16.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff107bd79c0 2 removed watcher, disabling cache 2024-09-12T17:13:16.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.197+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989408558016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x557b9d4e9540 2024-09-12T17:13:16.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93989408558016] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff107bd79c0 20 remove_watcher() i=1 2024-09-12T17:13:16.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989408561792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x557b9d4ef760 2024-09-12T17:13:16.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff104edc640 1 -- 172.21.15.193:0/3279200158 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93989408561792] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f0036030 con 0x557b9d4ef760 2024-09-12T17:13:16.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff107bd79c0 20 remove_watcher() i=2 2024-09-12T17:13:16.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.201+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989408559072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x7ff0f0039070 2024-09-12T17:13:16.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff105ede640 1 -- 172.21.15.193:0/3279200158 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93989408559072] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff10002f040 con 0x7ff0f0039070 2024-09-12T17:13:16.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff107bd79c0 20 remove_watcher() i=3 2024-09-12T17:13:16.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989408566560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x557b9d4e9540 2024-09-12T17:13:16.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93989408566560] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x557b9d4e9540 2024-09-12T17:13:16.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff107bd79c0 20 remove_watcher() i=4 2024-09-12T17:13:16.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.205+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989408564064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x7ff100019040 2024-09-12T17:13:16.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93989408564064] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff107bd79c0 20 remove_watcher() i=5 2024-09-12T17:13:16.211 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989408573424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x7ff100019040 2024-09-12T17:13:16.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93989408573424] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff107bd79c0 20 remove_watcher() i=6 2024-09-12T17:13:16.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.209+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989408571776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b9d51db80 con 0x7ff100019040 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93989408571776] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0f80cf070 con 0x7ff100019040 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 20 remove_watcher() i=7 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff100019040 msgr2=0x7ff100019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff100019040 0x7ff100019930 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d4e9540 msgr2=0x557b9d4eb9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d4e9540 0x557b9d4eb9d0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff0f0039070 msgr2=0x7ff0f0052450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff0f0039070 0x7ff0f0052450 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557b9d4ef760 msgr2=0x557b9d4f1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557b9d4ef760 0x557b9d4f1b50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefd00399d0 msgr2=0x7fefd003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefd00399d0 0x7fefd003be90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff10000f010 tx=0x7ff10001b070 comp rx=0 tx=0).stop 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 msgr2=0x557b9d4de390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/3279200158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4d7e80 0x557b9d4de390 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0050fa0 tx=0x7ff0f0050e70 comp rx=0 tx=0).stop 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 reap_dead start 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff1056dd640 1 -- 172.21.15.193:0/3279200158 reap_dead start 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 shutdown_connections 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 >> 172.21.15.193:0/3279200158 conn(0x557b9d4d32a0 msgr2=0x557b9d4d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 shutdown_connections 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/3279200158 wait complete. 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 msgr2=0x7fefdc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 0x7fefdc03bf80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x557b9d4bb770 tx=0x7ff100003070 comp rx=0 tx=0).stop 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 msgr2=0x557b9d4ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000d660 tx=0x7ff0f000da60 comp rx=0 tx=0).stop 2024-09-12T17:13:16.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 shutdown_connections 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefdc039ac0 0x7fefdc03bf80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1498247009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d4ca4c0 0x557b9d4ca8e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 >> 172.21.15.193:0/1498247009 conn(0x557b9d4bfe70 msgr2=0x557b9d4c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 shutdown_connections 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1498247009 wait complete. 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 msgr2=0x557b9d4b9f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 0x557b9d4b9f00 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 msgr2=0x7fefec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 0x7fefec03bf30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0004180 tx=0x7ff0f0001340 comp rx=0 tx=0).stop 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 msgr2=0x557b9d4b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80aa500 tx=0x7ff0f8017d70 comp rx=0 tx=0).stop 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 shutdown_connections 2024-09-12T17:13:16.219 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557b9d3c2fc0 0x557b9d4b9f00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fefec039a70 0x7fefec03bf30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 --2- 172.21.15.193:0/1524421649 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557b9d3c0690 0x557b9d4b2d90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 >> 172.21.15.193:0/1524421649 conn(0x557b9d333a20 msgr2=0x557b9d4a5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 shutdown_connections 2024-09-12T17:13:16.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.213+0000 7ff107bd79c0 1 -- 172.21.15.193:0/1524421649 wait complete. 2024-09-12T17:13:16.225 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T17:13:16.194068Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:16.194055Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.226 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-12T17:13:16.194068Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:16.194055Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.226 ERROR:root:0 2024-09-12T17:13:16.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:16.230 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:16.231 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-12T17:13:16.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-12T17:13:16.231 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-12T17:13:16.258 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:16.258 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:16.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01e09099c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b76d698fb0 0x55b76d699390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01e09099c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b76d54d9c0 con 0x55b76d69c140 2024-09-12T17:13:16.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01e09099c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55b76d59d6d0 con 0x55b76d698fb0 2024-09-12T17:13:16.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01de40f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55b76d698fb0 0x55b76d699390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01d5c0e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55b76d69c140 0x55b76d69e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44368/0 (socket says 172.21.15.193:44368) 2024-09-12T17:13:16.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01d5c0e640 1 -- 172.21.15.193:0/2839570744 learned_addr learned my addr 172.21.15.193:0/2839570744 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:16.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01de40f640 1 -- 172.21.15.193:0/2839570744 >> v1:172.21.15.62:6789/0 conn(0x55b76d69c140 legacy=0x55b76d69e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.260 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.257+0000 7f01de40f640 1 -- 172.21.15.193:0/2839570744 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d541ca0 con 0x55b76d698fb0 2024-09-12T17:13:16.262 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01de40f640 1 --2- 172.21.15.193:0/2839570744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d699390 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f01d000a480 tx=0x7f01d001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423dcd9f46171781 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01ddc0e640 1 -- 172.21.15.193:0/2839570744 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00b0070 con 0x55b76d698fb0 2024-09-12T17:13:16.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01ddc0e640 1 -- 172.21.15.193:0/2839570744 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00ab540 con 0x55b76d698fb0 2024-09-12T17:13:16.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01ddc0e640 1 -- 172.21.15.193:0/2839570744 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00ab840 con 0x55b76d698fb0 2024-09-12T17:13:16.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 -- 172.21.15.193:0/2839570744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 msgr2=0x55b76d699390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 --2- 172.21.15.193:0/2839570744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d699390 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f01d000a480 tx=0x7f01d001b280 comp rx=0 tx=0).stop 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 -- 172.21.15.193:0/2839570744 shutdown_connections 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 --2- 172.21.15.193:0/2839570744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d699390 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 -- 172.21.15.193:0/2839570744 >> 172.21.15.193:0/2839570744 conn(0x55b76d694ad0 msgr2=0x55b76d696ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 -- 172.21.15.193:0/2839570744 shutdown_connections 2024-09-12T17:13:16.264 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.261+0000 7f01e09099c0 1 -- 172.21.15.193:0/2839570744 wait complete. 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01e09099c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01e09099c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b76d5a1680 con 0x55b76d698fb0 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01de40f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01de40f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46048/0 (socket says 172.21.15.193:46048) 2024-09-12T17:13:16.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01de40f640 1 -- 172.21.15.193:0/3492824088 learned_addr learned my addr 172.21.15.193:0/3492824088 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01de40f640 1 -- 172.21.15.193:0/3492824088 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d51cda0 con 0x55b76d698fb0 2024-09-12T17:13:16.279 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f01de40f640 1 --2- 172.21.15.193:0/3492824088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f01d0018eb0 tx=0x7f01d0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5daad0defc43e423 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f00cc608640 1 -- 172.21.15.193:0/3492824088 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00b0070 con 0x55b76d698fb0 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f00cc608640 1 -- 172.21.15.193:0/3492824088 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00b1040 con 0x55b76d698fb0 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.273+0000 7f00cc608640 1 -- 172.21.15.193:0/3492824088 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00ab6f0 con 0x55b76d698fb0 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/3492824088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 msgr2=0x55b76d60fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3492824088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f01d0018eb0 tx=0x7f01d0003030 comp rx=0 tx=0).stop 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/3492824088 shutdown_connections 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3492824088 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d60fa10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/3492824088 >> 172.21.15.193:0/3492824088 conn(0x55b76d694ad0 msgr2=0x55b76d780370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/3492824088 shutdown_connections 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/3492824088 wait complete. 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b76d543a50 con 0x55b76d698fb0 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01de40f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01de40f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46052/0 (socket says 172.21.15.193:46052) 2024-09-12T17:13:16.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01de40f640 1 -- 172.21.15.193:0/861288648 learned_addr learned my addr 172.21.15.193:0/861288648 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01de40f640 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d78e330 con 0x55b76d698fb0 2024-09-12T17:13:16.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01de40f640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ab510 tx=0x7f01d0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 -- 172.21.15.193:0/861288648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00c4070 con 0x55b76d698fb0 2024-09-12T17:13:16.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 -- 172.21.15.193:0/861288648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00b75b0 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76d78e5c0 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 -- 172.21.15.193:0/861288648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01d00b7890 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76d78ef70 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 -- 172.21.15.193:0/861288648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f01d00c7070 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 0x7f00c403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.277+0000 7f00cae05640 1 -- 172.21.15.193:0/861288648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f01d00bc070 con 0x55b76d698fb0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 0x7f00c403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 0x55b76d794f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d795480 con 0x55b76d69c140 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 0x55b76d794f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 0x7f00c403bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01c8001d80 tx=0x7f01c80012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 0x55b76d794f40 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 -- 172.21.15.193:0/861288648 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01d800a4d0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d795820 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 -- 172.21.15.193:0/861288648 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01d800a4d0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d797120 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 -- 172.21.15.193:0/861288648 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01d800a4d0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d796350 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 -- 172.21.15.193:0/861288648 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01d800a4d0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7967a0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01dec10640 1 -- 172.21.15.193:0/861288648 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f01d800a4d0 con 0x55b76d69c140 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.287 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01e09099c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b76d5ae450 con 0x55b76d7a5430 2024-09-12T17:13:16.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46062/0 (socket says 172.21.15.193:46062) 2024-09-12T17:13:16.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 -- 172.21.15.193:0/3906082366 learned_addr learned my addr 172.21.15.193:0/3906082366 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 -- 172.21.15.193:0/3906082366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d7a5e90 con 0x55b76d7a5430 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.281+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f01c800d660 tx=0x7f01c800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 -- 172.21.15.193:0/3906082366 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c800c6b0 con 0x55b76d7a5430 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 -- 172.21.15.193:0/3906082366 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c800c850 con 0x55b76d7a5430 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76d7a66f0 con 0x55b76d7a5430 2024-09-12T17:13:16.292 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 -- 172.21.15.193:0/3906082366 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c800cb30 con 0x55b76d7a5430 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76d7a6c60 con 0x55b76d7a5430 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 -- 172.21.15.193:0/3906082366 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f01c8023020 con 0x55b76d7a5430 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 0x7f00b803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c3fff640 1 -- 172.21.15.193:0/3906082366 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f01c8021020 con 0x55b76d7a5430 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01dec10640 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 0x7f00b803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01dec10640 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 0x7f00b803bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b76d795e70 tx=0x7f01d8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b76d610180 con 0x55b76d7b2e00 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46076/0 (socket says 172.21.15.193:46076) 2024-09-12T17:13:16.293 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01d5c0e640 1 -- 172.21.15.193:0/794803369 learned_addr learned my addr 172.21.15.193:0/794803369 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01d5c0e640 1 -- 172.21.15.193:0/794803369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d7b37f0 con 0x55b76d7b2e00 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/794803369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f01c8050f10 tx=0x7f01c8023420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cd8b98fbdd1106 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c1ffb640 1 -- 172.21.15.193:0/794803369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c8047070 con 0x55b76d7b2e00 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c1ffb640 1 -- 172.21.15.193:0/794803369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c800cd20 con 0x55b76d7b2e00 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f00c1ffb640 1 -- 172.21.15.193:0/794803369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c801bcc0 con 0x55b76d7b2e00 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 -- 172.21.15.193:0/794803369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 msgr2=0x55b76d7b3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.285+0000 7f01e09099c0 1 --2- 172.21.15.193:0/794803369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f01c8050f10 tx=0x7f01c8023420 comp rx=0 tx=0).stop 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/794803369 shutdown_connections 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 --2- 172.21.15.193:0/794803369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b3200 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/794803369 >> 172.21.15.193:0/794803369 conn(0x55b76d7ae220 msgr2=0x55b76d7ac460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/794803369 shutdown_connections 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/794803369 wait complete. 2024-09-12T17:13:16.294 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 Processor -- start 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- start start 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55b76d7b1d50 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01d5c0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46090/0 (socket says 172.21.15.193:46090) 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 learned_addr learned my addr 172.21.15.193:0/389362309 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76d7b98d0 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f01c804fdb0 tx=0x7f01c8050e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 -- 172.21.15.193:0/389362309 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c8032030 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b76d7b9b60 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 -- 172.21.15.193:0/389362309 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01c8048040 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 -- 172.21.15.193:0/389362309 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01c803c060 con 0x55b76d7b2e00 2024-09-12T17:13:16.295 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76d7b9b60 con 0x55b76d7b2e00 2024-09-12T17:13:16.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 -- 172.21.15.193:0/389362309 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f01c8035030 con 0x55b76d7b2e00 2024-09-12T17:13:16.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00a8039a70 0x7f00a803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.301 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f00affff640 1 -- 172.21.15.193:0/389362309 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f01c8033070 con 0x55b76d7b2e00 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01dec10640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00a8039a70 0x7f00a803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d7c44a0 0x55b76d7c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c7080 con 0x55b76d7c44a0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.289+0000 7f01de40f640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d7c44a0 0x55b76d7c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00a8039a70 0x7f00a803bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55b76d78fe80 tx=0x7f01d801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d7c44a0 0x55b76d7c6930 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 realm 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c7490 con 0x55b76d7c44a0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.302 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c7d60 con 0x55b76d7c44a0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c8100 con 0x55b76d7c44a0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c8950 con 0x55b76d7c44a0 2024-09-12T17:13:16.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 20 searching for the correct realm 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b76d7ca6c0 0x55b76d7ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b76d7ca6c0 0x55b76d7ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b76d7ca6c0 0x55b76d7ccab0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01d5c0e640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f01c801a590 0x7f01c801aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f01c801a590 0x7f01c801aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f01c801a590 0x7f01c801aa10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.304 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f01d8031040 0x7f01d8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f01d8031040 0x7f01d8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.293+0000 7f01de40f640 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f01d8031040 0x7f01d8032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.305 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.306 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.297+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.313 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.314 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.315 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.301+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01d8031040 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x55b76d7c44a0 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ccff0 con 0x7f01c801a590 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01d801f070 con 0x7f01c801a590 2024-09-12T17:13:16.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c9360 con 0x55b76d7c44a0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7c9c00 con 0x55b76d7c44a0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.305+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7cd390 con 0x55b76d7c44a0 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 zone default found 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 4 Realm: () 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:16.319 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 zonegroup default 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7cd840 con 0x7f01d8031040 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7cf330 con 0x55b76d7ca6c0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7cf770 con 0x55b76d7ca6c0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 started sync module instance, tier type = 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ce6c0 con 0x7f01c801a590 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246304279216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ce320 con 0x7f01c801a590 2024-09-12T17:13:16.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d06a0 con 0x55b76d7c44a0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.309+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94246304279216] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246304283600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d06a0 con 0x55b76d7c44a0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d10b0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246304287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d1900 con 0x55b76d7ca6c0 2024-09-12T17:13:16.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d22c0 con 0x7f01c801a590 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.313+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94246304283600] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246304292368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d2230 con 0x7f01c801a590 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d3180 con 0x55b76d7c44a0 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94246304287744] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94246304292368] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246304294576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d2cd0 con 0x55b76d7c44a0 2024-09-12T17:13:16.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d3520 con 0x7f01d8031040 2024-09-12T17:13:16.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.317+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94246304294576] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246304296144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d35a0 con 0x7f01d8031040 2024-09-12T17:13:16.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d3df0 con 0x7f01d8031040 2024-09-12T17:13:16.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246304298912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d4210 con 0x7f01d8031040 2024-09-12T17:13:16.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d4d30 con 0x7f01d8031040 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.321+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94246304296144] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246304303104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d4cf0 con 0x7f01d8031040 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=0 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=1 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=2 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=3 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=4 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=5 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94246304298912] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=6 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94246304303104] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 add_watcher() i=7 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d3ca0 con 0x55b76d7c44a0 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246304300128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d5150 con 0x55b76d7c44a0 2024-09-12T17:13:16.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94246304300128] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f0094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:16.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:16.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.325+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e0470 con 0x55b76d7c44a0 2024-09-12T17:13:16.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.329+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.332 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.329+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e0a50 con 0x7f01d8031040 2024-09-12T17:13:16.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.329+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.334 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.329+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e0a50 con 0x55b76d7ca6c0 2024-09-12T17:13:16.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.335 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e0df0 con 0x55b76d7c44a0 2024-09-12T17:13:16.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.336 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e0df0 con 0x7f01c801a590 2024-09-12T17:13:16.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'79 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.337 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e1360 con 0x55b76d7ca6c0 2024-09-12T17:13:16.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.333+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'52 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.338 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.337+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e1810 con 0x55b76d7c44a0 2024-09-12T17:13:16.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.337+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.337+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e1810 con 0x7f01d8031040 2024-09-12T17:13:16.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.337+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.337+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e1810 con 0x7f01c801a590 2024-09-12T17:13:16.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7dead0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7dead0 con 0x7f01c801a590 2024-09-12T17:13:16.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'80 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.341+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7dead0 con 0x7f01d8031040 2024-09-12T17:13:16.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.345+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.345+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7dead0 con 0x7f01c801a590 2024-09-12T17:13:16.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.345+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.345+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2370 con 0x7f01d8031040 2024-09-12T17:13:16.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2370 con 0x55b76d7c44a0 2024-09-12T17:13:16.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de880 con 0x55b76d7ca6c0 2024-09-12T17:13:16.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.349+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de880 con 0x7f01c801a590 2024-09-12T17:13:16.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'81 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de880 con 0x55b76d7ca6c0 2024-09-12T17:13:16.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de880 con 0x55b76d7c44a0 2024-09-12T17:13:16.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.353+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2400 con 0x55b76d7c44a0 2024-09-12T17:13:16.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2400 con 0x55b76d7ca6c0 2024-09-12T17:13:16.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.361 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2400 con 0x7f01c801a590 2024-09-12T17:13:16.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.357+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7e2a10 con 0x55b76d7ca6c0 2024-09-12T17:13:16.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x55b76d7ca6c0 2024-09-12T17:13:16.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x55b76d7ca6c0 2024-09-12T17:13:16.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x55b76d7ca6c0 2024-09-12T17:13:16.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'53 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.366 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.361+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x7f01d8031040 2024-09-12T17:13:16.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.365+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.365+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x55b76d7ca6c0 2024-09-12T17:13:16.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.365+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.365+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x7f01d8031040 2024-09-12T17:13:16.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.369+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.369+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x55b76d7ca6c0 2024-09-12T17:13:16.373 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.369+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.369+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x7f01d8031040 2024-09-12T17:13:16.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.373+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.376 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.373+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de450 con 0x7f01c801a590 2024-09-12T17:13:16.378 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.373+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f000f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 20 Filter name: none 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f000d7fa640 20 reqs_thread_entry: start 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.379 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7de0e0 con 0x7f01d8031040 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 20 rados_obj.operate() r=0 bl.length=349 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:16.380 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddbf0 con 0x7f01d8031040 2024-09-12T17:13:16.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 removing key index: system_akey 2024-09-12T17:13:16.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7fdba0 con 0x55b76d7ca6c0 2024-09-12T17:13:16.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(96 system_akey [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94246304340768 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d800460 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== watch-notify(notify (1) cookie 94246304283600 notify 146028888113 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55b76d7df1f0 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f00c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888113 cookie 94246304283600 notifier 4853 bl.length()=161 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(97 notify.1 [notify cookie 94246304340768 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.377+0000 7f00c1ffb640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00a4003d70 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== watch-notify(notify_complete (2) cookie 94246304340768 notify 146028888113 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f01d00db040 con 0x55b76d7c44a0 2024-09-12T17:13:16.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01e09099c0 10 removing email index: 2024-09-12T17:13:16.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01e09099c0 10 removing user buckets index 2024-09-12T17:13:16.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x7f01d8031040 2024-09-12T17:13:16.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(99 system_user.buckets [delete] v34'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01e09099c0 10 removing user index: system_user 2024-09-12T17:13:16.385 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.381+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x7f01d8031040 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(100 system_user [call,call,delete] v34'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01e09099c0 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01e09099c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94246304340768 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ff450 con 0x7f01c801a590 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== watch-notify(notify (1) cookie 94246304279216 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55b76d7dea50 con 0x7f01c801a590 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f00c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94246304279216 notifier 4853 bl.length()=160 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f00c1ffb640 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f00a4003d70 con 0x7f01c801a590 2024-09-12T17:13:16.387 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(101 notify.0 [notify cookie 94246304340768 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== watch-notify(notify_complete (2) cookie 94246304340768 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b76d7dee70 con 0x7f01c801a590 2024-09-12T17:13:16.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.388 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f0094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246304300128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x55b76d7c44a0 2024-09-12T17:13:16.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94246304300128] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.389 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.385+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246304279216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x7f01c801a590 2024-09-12T17:13:16.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94246304279216] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01e09099c0 20 remove_watcher() i=0 2024-09-12T17:13:16.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01e09099c0 2 removed watcher, disabling cache 2024-09-12T17:13:16.391 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246304283600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ceab0 con 0x55b76d7c44a0 2024-09-12T17:13:16.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94246304283600] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01e09099c0 20 remove_watcher() i=1 2024-09-12T17:13:16.393 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.389+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246304287744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x55b76d7ca6c0 2024-09-12T17:13:16.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01d5c0e640 1 -- 172.21.15.193:0/389362309 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94246304287744] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01c8042a70 con 0x55b76d7ca6c0 2024-09-12T17:13:16.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 20 remove_watcher() i=2 2024-09-12T17:13:16.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246304292368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ceab0 con 0x7f01c801a590 2024-09-12T17:13:16.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01dec10640 1 -- 172.21.15.193:0/389362309 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94246304292368] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d8040040 con 0x7f01c801a590 2024-09-12T17:13:16.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 20 remove_watcher() i=3 2024-09-12T17:13:16.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246304294576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d0c00 con 0x55b76d7c44a0 2024-09-12T17:13:16.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94246304294576] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x55b76d7c44a0 2024-09-12T17:13:16.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 20 remove_watcher() i=4 2024-09-12T17:13:16.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.393+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246304296144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ddb20 con 0x7f01d8031040 2024-09-12T17:13:16.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.397+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94246304296144] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.397+0000 7f01e09099c0 20 remove_watcher() i=5 2024-09-12T17:13:16.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.397+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246304298912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7d1e10 con 0x7f01d8031040 2024-09-12T17:13:16.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94246304298912] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 20 remove_watcher() i=6 2024-09-12T17:13:16.403 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246304303104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b76d7ceab0 con 0x7f01d8031040 2024-09-12T17:13:16.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94246304303104] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01d00d0070 con 0x7f01d8031040 2024-09-12T17:13:16.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 20 remove_watcher() i=7 2024-09-12T17:13:16.407 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f01d8031040 msgr2=0x7f01d8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f01d8031040 0x7f01d8032940 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d7c44a0 msgr2=0x55b76d7c6930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d7c44a0 0x55b76d7c6930 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f01c801a590 msgr2=0x7f01c801aa10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f01c801a590 0x7f01c801aa10 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b76d7ca6c0 msgr2=0x55b76d7ccab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55b76d7ca6c0 0x55b76d7ccab0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00a8039a70 msgr2=0x7f00a803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00a8039a70 0x7f00a803bf30 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x55b76d78fe80 tx=0x7f01d801f000 comp rx=0 tx=0).stop 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01de40f640 1 -- 172.21.15.193:0/389362309 reap_dead start 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 msgr2=0x55b76d7b9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.408 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f01c804fdb0 tx=0x7f01c8050e70 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 shutdown_connections 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/389362309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7b2e00 0x55b76d7b9370 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 >> 172.21.15.193:0/389362309 conn(0x55b76d7ae220 msgr2=0x55b76d7ac430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 shutdown_connections 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/389362309 wait complete. 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 msgr2=0x7f00b803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 0x7f00b803bf30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55b76d795e70 tx=0x7f01d8005850 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 msgr2=0x55b76d7a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f01c800d660 tx=0x7f01c800da60 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 shutdown_connections 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00b8039a70 0x7f00b803bf30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 --2- 172.21.15.193:0/3906082366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d7a5430 0x55b76d7a5850 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.409 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 >> 172.21.15.193:0/3906082366 conn(0x55b76d79ade0 msgr2=0x55b76d79b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 shutdown_connections 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.401+0000 7f01e09099c0 1 -- 172.21.15.193:0/3906082366 wait complete. 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 msgr2=0x55b76d794f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 0x55b76d794f40 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 msgr2=0x7f00c403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 0x7f00c403bf30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f01c8001d80 tx=0x7f01c80012e0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 msgr2=0x55b76d78ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ab510 tx=0x7f01d0018020 comp rx=0 tx=0).stop 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 shutdown_connections 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55b76d69c140 0x55b76d794f40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f00c4039a70 0x7f00c403bf30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.410 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 --2- 172.21.15.193:0/861288648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55b76d698fb0 0x55b76d78ddd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 >> 172.21.15.193:0/861288648 conn(0x55b76d694ad0 msgr2=0x55b76d60e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 shutdown_connections 2024-09-12T17:13:16.411 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.405+0000 7f01e09099c0 1 -- 172.21.15.193:0/861288648 wait complete. 2024-09-12T17:13:16.417 ERROR:root:None 2024-09-12T17:13:16.417 ERROR:root:0 2024-09-12T17:13:16.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T17:13:16.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-12T17:13:16.417 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-12T17:13:16.501 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:16.502 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:16.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.497+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.502 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06084a79c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560882eda5a0 0x560882f6e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06084a79c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560882e1a9c0 con 0x560882eda1c0 2024-09-12T17:13:16.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06084a79c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x560882e6a6d0 con 0x560882eda5a0 2024-09-12T17:13:16.503 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06057ac640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560882eda5a0 0x560882f6e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f0605fad640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x560882eda1c0 0x560882f6af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44376/0 (socket says 172.21.15.193:44376) 2024-09-12T17:13:16.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f0605fad640 1 -- 172.21.15.193:0/4092106916 learned_addr learned my addr 172.21.15.193:0/4092106916 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:16.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06057ac640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x560882eda5a0 0x560882f6e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46094/0 (socket says 172.21.15.193:46094) 2024-09-12T17:13:16.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06057ac640 1 -- 172.21.15.193:0/4092106916 >> v1:172.21.15.62:6789/0 conn(0x560882eda1c0 legacy=0x560882f6af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.504 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06057ac640 1 -- 172.21.15.193:0/4092106916 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882e0eca0 con 0x560882eda5a0 2024-09-12T17:13:16.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.501+0000 7f06057ac640 1 --2- 172.21.15.193:0/4092106916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda5a0 0x560882f6e6a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00a480 tx=0x7f05fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6044e49714e8592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f0604fab640 1 -- 172.21.15.193:0/4092106916 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0b0070 con 0x560882eda5a0 2024-09-12T17:13:16.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f0604fab640 1 -- 172.21.15.193:0/4092106916 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc0ab540 con 0x560882eda5a0 2024-09-12T17:13:16.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f0604fab640 1 -- 172.21.15.193:0/4092106916 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0ab840 con 0x560882eda5a0 2024-09-12T17:13:16.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 -- 172.21.15.193:0/4092106916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda5a0 msgr2=0x560882f6e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 --2- 172.21.15.193:0/4092106916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda5a0 0x560882f6e6a0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00a480 tx=0x7f05fc01b280 comp rx=0 tx=0).stop 2024-09-12T17:13:16.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 -- 172.21.15.193:0/4092106916 shutdown_connections 2024-09-12T17:13:16.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 --2- 172.21.15.193:0/4092106916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda5a0 0x560882f6e6a0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 -- 172.21.15.193:0/4092106916 >> 172.21.15.193:0/4092106916 conn(0x560882f608a0 msgr2=0x560882f62cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 -- 172.21.15.193:0/4092106916 shutdown_connections 2024-09-12T17:13:16.508 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.505+0000 7f06084a79c0 1 -- 172.21.15.193:0/4092106916 wait complete. 2024-09-12T17:13:16.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f06084a79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f06084a79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560882e6e680 con 0x560882eda1c0 2024-09-12T17:13:16.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f0605fad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f0605fad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46106/0 (socket says 172.21.15.193:46106) 2024-09-12T17:13:16.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f0605fad640 1 -- 172.21.15.193:0/1506422543 learned_addr learned my addr 172.21.15.193:0/1506422543 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f0605fad640 1 -- 172.21.15.193:0/1506422543 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560882de9da0 con 0x560882eda1c0 2024-09-12T17:13:16.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f0605fad640 1 --2- 172.21.15.193:0/1506422543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001e50 tx=0x7f05f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669936e88f648a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f04f3e07640 1 -- 172.21.15.193:0/1506422543 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f8012020 con 0x560882eda1c0 2024-09-12T17:13:16.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f04f3e07640 1 -- 172.21.15.193:0/1506422543 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f800e7c0 con 0x560882eda1c0 2024-09-12T17:13:16.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.517+0000 7f04f3e07640 1 -- 172.21.15.193:0/1506422543 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f800eaa0 con 0x560882eda1c0 2024-09-12T17:13:16.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/1506422543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 msgr2=0x560883053910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 --2- 172.21.15.193:0/1506422543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f05f8001e50 tx=0x7f05f8001e80 comp rx=0 tx=0).stop 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/1506422543 shutdown_connections 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 --2- 172.21.15.193:0/1506422543 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x560883053910 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/1506422543 >> 172.21.15.193:0/1506422543 conn(0x560882f608a0 msgr2=0x56088304f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/1506422543 shutdown_connections 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/1506422543 wait complete. 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560882e10a50 con 0x560882eda1c0 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f0605fad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.524 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f0605fad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46116/0 (socket says 172.21.15.193:46116) 2024-09-12T17:13:16.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f0605fad640 1 -- 172.21.15.193:0/2597963393 learned_addr learned my addr 172.21.15.193:0/2597963393 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f0605fad640 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56088305b540 con 0x560882eda1c0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f0605fad640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x5608830548a0 tx=0x7f05f8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f04f2604640 1 -- 172.21.15.193:0/2597963393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f8012030 con 0x560882eda1c0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f04f2604640 1 -- 172.21.15.193:0/2597963393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f801a680 con 0x560882eda1c0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56088305b7d0 con 0x560882eda1c0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f04f2604640 1 -- 172.21.15.193:0/2597963393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05f801a980 con 0x560882eda1c0 2024-09-12T17:13:16.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56088305c180 con 0x560882eda1c0 2024-09-12T17:13:16.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.521+0000 7f04f2604640 1 -- 172.21.15.193:0/2597963393 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05f8015020 con 0x560882eda1c0 2024-09-12T17:13:16.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f04f2604640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 0x7f04ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f04f2604640 1 -- 172.21.15.193:0/2597963393 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f05f8020070 con 0x560882eda1c0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 0x7f04ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 0x560883062150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883062690 con 0x560882eda5a0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 0x560883062150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 0x560883062150 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 0x7f04ec03bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ad000 tx=0x7f05fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 -- 172.21.15.193:0/2597963393 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f060000a4d0 con 0x560882eda5a0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56088305c4c0 con 0x560882eda5a0 2024-09-12T17:13:16.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 -- 172.21.15.193:0/2597963393 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f060000a4d0 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830643f0 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 -- 172.21.15.193:0/2597963393 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f060000a4d0 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883063620 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 -- 172.21.15.193:0/2597963393 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f060000a4d0 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883063a70 con 0x560882eda5a0 2024-09-12T17:13:16.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06067ae640 1 -- 172.21.15.193:0/2597963393 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f060000a4d0 con 0x560882eda5a0 2024-09-12T17:13:16.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06084a79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560882e7b450 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46118/0 (socket says 172.21.15.193:46118) 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 -- 172.21.15.193:0/134461492 learned_addr learned my addr 172.21.15.193:0/134461492 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.525+0000 7f06057ac640 1 -- 172.21.15.193:0/134461492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560883073160 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f05fc096e80 tx=0x7f05fc018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 -- 172.21.15.193:0/134461492 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0c7070 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 -- 172.21.15.193:0/134461492 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc0b7dd0 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 -- 172.21.15.193:0/134461492 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0b0040 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608830739c0 con 0x560883072700 2024-09-12T17:13:16.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560883073ed0 con 0x560883072700 2024-09-12T17:13:16.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 -- 172.21.15.193:0/134461492 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05fc0ca070 con 0x560883072700 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 0x7f04e003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04eb7fe640 1 -- 172.21.15.193:0/134461492 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f05fc0a8070 con 0x560883072700 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06067ae640 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 0x7f04e003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06067ae640 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 0x7f04e003bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x560883063140 tx=0x7f0600005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06084a79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x560883054160 con 0x560883080010 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46122/0 (socket says 172.21.15.193:46122) 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 -- 172.21.15.193:0/933199908 learned_addr learned my addr 172.21.15.193:0/933199908 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 -- 172.21.15.193:0/933199908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608830809e0 con 0x560883080010 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f06057ac640 1 --2- 172.21.15.193:0/933199908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ca920 tx=0x7f05fc0cae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bdf54c156f824a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04e97fa640 1 -- 172.21.15.193:0/933199908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0c1df0 con 0x560883080010 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04e97fa640 1 -- 172.21.15.193:0/933199908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc0db070 con 0x560883080010 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.529+0000 7f04e97fa640 1 -- 172.21.15.193:0/933199908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0b5c10 con 0x560883080010 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/933199908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 msgr2=0x5608830803f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 --2- 172.21.15.193:0/933199908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ca920 tx=0x7f05fc0cae70 comp rx=0 tx=0).stop 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/933199908 shutdown_connections 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 --2- 172.21.15.193:0/933199908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x5608830803f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/933199908 >> 172.21.15.193:0/933199908 conn(0x56088307b3d0 msgr2=0x560883079610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/933199908 shutdown_connections 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/933199908 wait complete. 2024-09-12T17:13:16.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 Processor -- start 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- start start 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x56088307ef00 con 0x560883080010 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06057ac640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46128/0 (socket says 172.21.15.193:46128) 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 learned_addr learned my addr 172.21.15.193:0/3485545136 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560883086aa0 con 0x560883080010 2024-09-12T17:13:16.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06057ac640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0b7810 tx=0x7f05fc0eada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 -- 172.21.15.193:0/3485545136 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0b5c10 con 0x560883080010 2024-09-12T17:13:16.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560883086d30 con 0x560883080010 2024-09-12T17:13:16.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 -- 172.21.15.193:0/3485545136 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05fc0b6650 con 0x560883080010 2024-09-12T17:13:16.542 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 -- 172.21.15.193:0/3485545136 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05fc0b6930 con 0x560883080010 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608830876e0 con 0x560883080010 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 -- 172.21.15.193:0/3485545136 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f05fc0aa8f0 con 0x560883080010 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04d0039a70 0x7f04d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f04d77fe640 1 -- 172.21.15.193:0/3485545136 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f05fc0f7d30 con 0x560883080010 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06067ae640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04d0039a70 0x7f04d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5608830918a0 0x560883093d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.533+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883094480 con 0x5608830918a0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5608830918a0 0x560883093d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04d0039a70 0x7f04d003bf30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x56088305c400 tx=0x7f060001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5608830918a0 0x560883093d30 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 realm 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883094890 con 0x5608830918a0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883095160 con 0x5608830918a0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883095500 con 0x5608830918a0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883095d50 con 0x5608830918a0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 20 searching for the correct realm 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560883097ac0 0x560883099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06057ac640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560883097ac0 0x560883099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.545 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06057ac640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560883097ac0 0x560883099eb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06057ac640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f05fc0d6070 0x7f05fc0dba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f05fc0d6070 0x7f05fc0dba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f05fc0d6070 0x7f05fc0dba50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0600031040 0x7f0600032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.537+0000 7f0605fad640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0600031040 0x7f0600032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0600031040 0x7f0600032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.552 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.553 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.541+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.545+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x560883097ac0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f0600031040 2024-09-12T17:13:16.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x5608830918a0 2024-09-12T17:13:16.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56088309a3f0 con 0x7f05fc0d6070 2024-09-12T17:13:16.560 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f060001f070 con 0x7f05fc0d6070 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883096660 con 0x5608830918a0 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.561 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883096f00 con 0x5608830918a0 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883096f00 con 0x5608830918a0 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 zone default found 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 4 Realm: () 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:16.562 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 zonegroup default 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.549+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560883096f00 con 0x7f0600031040 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56088309c260 con 0x560883097ac0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56088309c720 con 0x560883097ac0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.563 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 started sync module instance, tier type = 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309b700 con 0x7f05fc0d6070 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594558180128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309b360 con 0x7f05fc0d6070 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309d650 con 0x5608830918a0 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.553+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594558180128] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594558184320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309d650 con 0x5608830918a0 2024-09-12T17:13:16.564 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309e060 con 0x560883097ac0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594558184320] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594558185888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309d5c0 con 0x560883097ac0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.557+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309eda0 con 0x7f05fc0d6070 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594558191792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309f640 con 0x7f05fc0d6070 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a0060 con 0x5608830918a0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594558185888] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.566 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594558191792] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594558196560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309f190 con 0x5608830918a0 2024-09-12T17:13:16.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a0900 con 0x7f0600031040 2024-09-12T17:13:16.567 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.561+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594558196560] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594558190592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56088309f190 con 0x7f0600031040 2024-09-12T17:13:16.568 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a0d90 con 0x7f0600031040 2024-09-12T17:13:16.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594558190592] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594558198400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a0d50 con 0x7f0600031040 2024-09-12T17:13:16.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.565+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a1750 con 0x7f0600031040 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594558202464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a1b70 con 0x7f0600031040 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=0 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=1 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=2 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=3 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=4 2024-09-12T17:13:16.571 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=5 2024-09-12T17:13:16.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594558198400] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.572 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=6 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594558202464] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 20 add_watcher() i=7 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830a08a0 con 0x5608830918a0 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.573 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594558199968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830a20f0 con 0x5608830918a0 2024-09-12T17:13:16.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594558199968] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.569+0000 7f04bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:16.574 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:16.575 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 5 note: GC not initialized 2024-09-12T17:13:16.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04bafe5640 20 reqs_thread_entry: start 2024-09-12T17:13:16.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:16.577 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 Filter name: none 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04b8fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830c7de0 con 0x560883097ac0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830c6930 con 0x560883097ac0 2024-09-12T17:13:16.578 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830cb3d0 con 0x560883097ac0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94594558356816 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830cba60 con 0x560883097ac0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== watch-notify(notify (1) cookie 94594558185888 notify 146028888073 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5608830c6650 con 0x560883097ac0 2024-09-12T17:13:16.579 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04e97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888073 cookie 94594558185888 notifier 4860 bl.length()=542 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04e97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04e97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(65 notify.2 [notify cookie 94594558356816 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f04e97fa640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f04c8003eb0 con 0x560883097ac0 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== watch-notify(notify_complete (2) cookie 94594558356816 notify 146028888073 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560883086aa0 con 0x560883097ac0 2024-09-12T17:13:16.580 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.573+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c6d50 con 0x560883097ac0 2024-09-12T17:13:16.581 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06084a79c0 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06084a79c0 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06084a79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94594558356816 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5608830cbe90 con 0x7f0600031040 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== watch-notify(notify (1) cookie 94594558190592 notify 146028888094 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7f05f8041e30 con 0x7f0600031040 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f04e8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94594558190592 notifier 4860 bl.length()=175 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f04e8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f04e8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f04e8ff9640 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0438003410 con 0x7f0600031040 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(68 notify.5 [notify cookie 94594558356816 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.583 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== watch-notify(notify_complete (2) cookie 94594558356816 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56088305c180 con 0x7f0600031040 2024-09-12T17:13:16.583 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-12T17:13:16.576099Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:16.576079Z","tags":[],"group_ids":[]} 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f04bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.577+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594558199968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x5608830918a0 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94594558199968] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594558180128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x7f05fc0d6070 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94594558180128] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 20 remove_watcher() i=0 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 2 removed watcher, disabling cache 2024-09-12T17:13:16.584 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594558184320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x5608830918a0 2024-09-12T17:13:16.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94594558184320] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 20 remove_watcher() i=1 2024-09-12T17:13:16.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.581+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594558185888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x560883097ac0 2024-09-12T17:13:16.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06057ac640 1 -- 172.21.15.193:0/3485545136 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94594558185888] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05fc0c9030 con 0x560883097ac0 2024-09-12T17:13:16.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06084a79c0 20 remove_watcher() i=2 2024-09-12T17:13:16.588 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594558191792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x7f05fc0d6070 2024-09-12T17:13:16.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06067ae640 1 -- 172.21.15.193:0/3485545136 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94594558191792] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0600040040 con 0x7f05fc0d6070 2024-09-12T17:13:16.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06084a79c0 20 remove_watcher() i=3 2024-09-12T17:13:16.589 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.585+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594558196560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x5608830918a0 2024-09-12T17:13:16.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94594558196560] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x5608830918a0 2024-09-12T17:13:16.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f06084a79c0 20 remove_watcher() i=4 2024-09-12T17:13:16.591 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594558190592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x7f0600031040 2024-09-12T17:13:16.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94594558190592] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.592 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f06084a79c0 20 remove_watcher() i=5 2024-09-12T17:13:16.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.589+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594558198400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x7f0600031040 2024-09-12T17:13:16.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94594558198400] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 20 remove_watcher() i=6 2024-09-12T17:13:16.595 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594558202464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5608830c5bc0 con 0x7f0600031040 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94594558202464] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05f8008030 con 0x7f0600031040 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 20 remove_watcher() i=7 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0600031040 msgr2=0x7f0600032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0600031040 0x7f0600032430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5608830918a0 msgr2=0x560883093d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5608830918a0 0x560883093d30 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f05fc0d6070 msgr2=0x7f05fc0dba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f05fc0d6070 0x7f05fc0dba50 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560883097ac0 msgr2=0x560883099eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.599 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x560883097ac0 0x560883099eb0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04d0039a70 msgr2=0x7f04d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04d0039a70 0x7f04d003bf30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x56088305c400 tx=0x7f060001f000 comp rx=0 tx=0).stop 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 msgr2=0x560883086540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0b7810 tx=0x7f05fc0eada0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f0605fad640 1 -- 172.21.15.193:0/3485545136 reap_dead start 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 shutdown_connections 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/3485545136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883080010 0x560883086540 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 >> 172.21.15.193:0/3485545136 conn(0x56088307b3d0 msgr2=0x5608830795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 shutdown_connections 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/3485545136 wait complete. 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 msgr2=0x7f04e003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 0x7f04e003bf30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x560883063140 tx=0x7f0600005850 comp rx=0 tx=0).stop 2024-09-12T17:13:16.600 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 msgr2=0x560883072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f05fc096e80 tx=0x7f05fc018020 comp rx=0 tx=0).stop 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 shutdown_connections 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04e0039a70 0x7f04e003bf30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/134461492 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560883072700 0x560883072b20 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 >> 172.21.15.193:0/134461492 conn(0x5608830680b0 msgr2=0x560883068490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 shutdown_connections 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/134461492 wait complete. 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 msgr2=0x560883062150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 0x560883062150 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 msgr2=0x7f04ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 0x7f04ec03bf30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0ad000 tx=0x7f05fc0a5040 comp rx=0 tx=0).stop 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 msgr2=0x56088305afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x5608830548a0 tx=0x7f05f8000ee0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 shutdown_connections 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x560882eda5a0 0x560883062150 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f04ec039a70 0x7f04ec03bf30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 --2- 172.21.15.193:0/2597963393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x560882eda1c0 0x56088305afe0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.593+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 >> 172.21.15.193:0/2597963393 conn(0x560882f608a0 msgr2=0x56088304dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.597+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 shutdown_connections 2024-09-12T17:13:16.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.597+0000 7f06084a79c0 1 -- 172.21.15.193:0/2597963393 wait complete. 2024-09-12T17:13:16.608 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T17:13:16.576099Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:16.576079Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.608 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-12T17:13:16.576099Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:16.576079Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:16.608 ERROR:root:0 2024-09-12T17:13:16.609 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:16.613 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:16.613 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-12T17:13:16.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-12T17:13:16.614 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-12T17:13:16.683 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:16.683 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f693061b9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627f86dc220 0x5627f86de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f693061b9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627f858a9c0 con 0x5627f86d8710 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f693061b9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5627f85da6d0 con 0x5627f86dc220 2024-09-12T17:13:16.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692d920640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627f86dc220 0x5627f86de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692d920640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x5627f86dc220 0x5627f86de610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46130/0 (socket says 172.21.15.193:46130) 2024-09-12T17:13:16.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692d920640 1 -- 172.21.15.193:0/1713718028 learned_addr learned my addr 172.21.15.193:0/1713718028 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692e121640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x5627f86d8710 0x5627f86dab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44380/0 (socket says 172.21.15.193:44380) 2024-09-12T17:13:16.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692d920640 1 -- 172.21.15.193:0/1713718028 >> v1:172.21.15.62:6789/0 conn(0x5627f86d8710 legacy=0x5627f86dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.681+0000 7f692d920640 1 -- 172.21.15.193:0/1713718028 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f857eca0 con 0x5627f86dc220 2024-09-12T17:13:16.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f692d920640 1 --2- 172.21.15.193:0/1713718028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f86de610 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f691800a5c0 tx=0x7f691801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960fb2d6690fdaf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f692d11f640 1 -- 172.21.15.193:0/1713718028 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180a6070 con 0x5627f86dc220 2024-09-12T17:13:16.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f692d11f640 1 -- 172.21.15.193:0/1713718028 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180af070 con 0x5627f86dc220 2024-09-12T17:13:16.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f692d11f640 1 -- 172.21.15.193:0/1713718028 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180aa5c0 con 0x5627f86dc220 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 -- 172.21.15.193:0/1713718028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 msgr2=0x5627f86de610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 --2- 172.21.15.193:0/1713718028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f86de610 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f691800a5c0 tx=0x7f691801b340 comp rx=0 tx=0).stop 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 -- 172.21.15.193:0/1713718028 shutdown_connections 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 --2- 172.21.15.193:0/1713718028 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f86de610 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 -- 172.21.15.193:0/1713718028 >> 172.21.15.193:0/1713718028 conn(0x5627f864baa0 msgr2=0x5627f864beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 -- 172.21.15.193:0/1713718028 shutdown_connections 2024-09-12T17:13:16.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.685+0000 7f693061b9c0 1 -- 172.21.15.193:0/1713718028 wait complete. 2024-09-12T17:13:16.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f693061b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f693061b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627f85de680 con 0x5627f86d8710 2024-09-12T17:13:16.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f692e121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f692e121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46142/0 (socket says 172.21.15.193:46142) 2024-09-12T17:13:16.702 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f692e121640 1 -- 172.21.15.193:0/305637943 learned_addr learned my addr 172.21.15.193:0/305637943 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f692e121640 1 -- 172.21.15.193:0/305637943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f8559da0 con 0x5627f86d8710 2024-09-12T17:13:16.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.697+0000 7f692e121640 1 --2- 172.21.15.193:0/305637943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6928001ec0 tx=0x7f692800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d553cced8c1a3076 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681c608640 1 -- 172.21.15.193:0/305637943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692800e5d0 con 0x5627f86d8710 2024-09-12T17:13:16.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681c608640 1 -- 172.21.15.193:0/305637943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692800e770 con 0x5627f86d8710 2024-09-12T17:13:16.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681c608640 1 -- 172.21.15.193:0/305637943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692800ea70 con 0x5627f86d8710 2024-09-12T17:13:16.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/305637943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 msgr2=0x5627f87c3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 --2- 172.21.15.193:0/305637943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6928001ec0 tx=0x7f692800b6d0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/305637943 shutdown_connections 2024-09-12T17:13:16.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 --2- 172.21.15.193:0/305637943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86d8710 0x5627f87c3870 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/305637943 >> 172.21.15.193:0/305637943 conn(0x5627f864baa0 msgr2=0x5627f87bf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/305637943 shutdown_connections 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/305637943 wait complete. 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627f8580a50 con 0x5627f86dc220 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f692e121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f692e121640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46156/0 (socket says 172.21.15.193:46156) 2024-09-12T17:13:16.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f692e121640 1 -- 172.21.15.193:0/3902123164 learned_addr learned my addr 172.21.15.193:0/3902123164 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f692e121640 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f87cb7d0 con 0x5627f86dc220 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f692e121640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5627f87c4860 tx=0x7f6928000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681ae05640 1 -- 172.21.15.193:0/3902123164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692801a7c0 con 0x5627f86dc220 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f87cba60 con 0x5627f86dc220 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f87cc2d0 con 0x5627f86dc220 2024-09-12T17:13:16.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681ae05640 1 -- 172.21.15.193:0/3902123164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692801a960 con 0x5627f86dc220 2024-09-12T17:13:16.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.701+0000 7f681ae05640 1 -- 172.21.15.193:0/3902123164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f692802c060 con 0x5627f86dc220 2024-09-12T17:13:16.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f681ae05640 1 -- 172.21.15.193:0/3902123164 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6928017070 con 0x5627f86dc220 2024-09-12T17:13:16.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f681ae05640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 0x7f681403bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f681ae05640 1 -- 172.21.15.193:0/3902123164 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6928015020 con 0x5627f86dc220 2024-09-12T17:13:16.709 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692d920640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 0x7f681403bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 0x5627f87d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f87d2bc0 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 0x5627f87d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692d920640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 0x7f681403bf80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae000 tx=0x7f69180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 0x5627f87d2680 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 -- 172.21.15.193:0/3902123164 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692000a4d0 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f87d2f60 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 -- 172.21.15.193:0/3902123164 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f692000a4d0 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f87d4840 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 -- 172.21.15.193:0/3902123164 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f692000a4d0 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f87d3a70 con 0x5627f87d0290 2024-09-12T17:13:16.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 -- 172.21.15.193:0/3902123164 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f692000a4d0 con 0x5627f87d0290 2024-09-12T17:13:16.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f87d3ec0 con 0x5627f87d0290 2024-09-12T17:13:16.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f692e922640 1 -- 172.21.15.193:0/3902123164 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f692000a4d0 con 0x5627f87d0290 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.705+0000 7f693061b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627f85eb450 con 0x5627f87e2b50 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46162/0 (socket says 172.21.15.193:46162) 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692d920640 1 -- 172.21.15.193:0/525795585 learned_addr learned my addr 172.21.15.193:0/525795585 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692d920640 1 -- 172.21.15.193:0/525795585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f87e35b0 con 0x5627f87e2b50 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692d920640 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c10 tx=0x7f69180180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 -- 172.21.15.193:0/525795585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180b3b90 con 0x5627f87e2b50 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f87e3e10 con 0x5627f87e2b50 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 -- 172.21.15.193:0/525795585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180b3d30 con 0x5627f87e2b50 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 -- 172.21.15.193:0/525795585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180c8560 con 0x5627f87e2b50 2024-09-12T17:13:16.713 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f87e4320 con 0x5627f87e2b50 2024-09-12T17:13:16.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 -- 172.21.15.193:0/525795585 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69180d1440 con 0x5627f87e2b50 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 0x7f680803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f6813fff640 1 -- 172.21.15.193:0/525795585 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f69180edc00 con 0x5627f87e2b50 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692e922640 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 0x7f680803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f692e922640 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 0x7f680803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5627f87d3590 tx=0x7f6920005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.709+0000 7f693061b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627f87c40c0 con 0x5627f87ef390 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46176/0 (socket says 172.21.15.193:46176) 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 -- 172.21.15.193:0/3127920749 learned_addr learned my addr 172.21.15.193:0/3127920749 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 -- 172.21.15.193:0/3127920749 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f87efd40 con 0x5627f87ef390 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 --2- 172.21.15.193:0/3127920749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f69180ebea0 tx=0x7f69180bda80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecf7a6c73a0404d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f6811ffb640 1 -- 172.21.15.193:0/3127920749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180bdc40 con 0x5627f87ef390 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f6811ffb640 1 -- 172.21.15.193:0/3127920749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180be410 con 0x5627f87ef390 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f6811ffb640 1 -- 172.21.15.193:0/3127920749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180bcc80 con 0x5627f87ef390 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- 172.21.15.193:0/3127920749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 msgr2=0x5627f87ef770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3127920749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f69180ebea0 tx=0x7f69180bda80 comp rx=0 tx=0).stop 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- 172.21.15.193:0/3127920749 shutdown_connections 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3127920749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87ef770 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- 172.21.15.193:0/3127920749 >> 172.21.15.193:0/3127920749 conn(0x5627f87eb7c0 msgr2=0x5627f87e9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- 172.21.15.193:0/3127920749 shutdown_connections 2024-09-12T17:13:16.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- 172.21.15.193:0/3127920749 wait complete. 2024-09-12T17:13:16.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 Processor -- start 2024-09-12T17:13:16.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- start start 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f693061b9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5627f87f03a0 con 0x5627f87ef390 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46178/0 (socket says 172.21.15.193:46178) 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 learned_addr learned my addr 172.21.15.193:0/2323273859 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.713+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f87f6e90 con 0x5627f87ef390 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692d920640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f691800a5c0 tx=0x7f69180ebe30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 -- 172.21.15.193:0/2323273859 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180c7e20 con 0x5627f87ef390 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627f87f7120 con 0x5627f87ef390 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f87f7ad0 con 0x5627f87ef390 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 -- 172.21.15.193:0/2323273859 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69180f2070 con 0x5627f87ef390 2024-09-12T17:13:16.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 -- 172.21.15.193:0/2323273859 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69180d1a40 con 0x5627f87ef390 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 -- 172.21.15.193:0/2323273859 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f69180e5050 con 0x5627f87ef390 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f8039a70 0x7f67f803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f67fffff640 1 -- 172.21.15.193:0/2323273859 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f69180fa100 con 0x5627f87ef390 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e922640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f8039a70 0x7f67f803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f8801c40 0x5627f88040d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f8804820 con 0x5627f8801c40 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f8801c40 0x5627f88040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e922640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f8039a70 0x7f67f803bf30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5627f87cd1d0 tx=0x7f692001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f8801c40 0x5627f88040d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 realm 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f8804c30 con 0x5627f8801c40 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f8805500 con 0x5627f8801c40 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f88058a0 con 0x5627f8801c40 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.717+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f88060f0 con 0x5627f8801c40 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f693061b9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f693061b9c0 20 searching for the correct realm 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627f8807e60 0x5627f880a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692d920640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627f8807e60 0x5627f880a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692d920640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627f8807e60 0x5627f880a250 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692d920640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6918009040 0x7f69180f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e922640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6918009040 0x7f69180f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e922640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6918009040 0x7f69180f7ab0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e922640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6920031040 0x7f6920032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6920031040 0x7f6920032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6920031040 0x7f6920032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.721+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.725+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.738 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.729+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8807e60 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.739 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6920031040 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x5627f8801c40 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5627f880a790 con 0x7f6918009040 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692001f070 con 0x7f6918009040 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.740 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f88069d0 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f8807270 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f880abc0 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 zone default found 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 4 Realm: () 2024-09-12T17:13:16.741 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 zonegroup default 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f880ac00 con 0x7f6920031040 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f880ca30 con 0x5627f8807e60 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.742 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f880cea0 con 0x5627f8807e60 2024-09-12T17:13:16.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 started sync module instance, tier type = 2024-09-12T17:13:16.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:16.743 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.733+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880bed0 con 0x7f6918009040 2024-09-12T17:13:16.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94729672901360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880d7b0 con 0x7f6918009040 2024-09-12T17:13:16.744 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880e000 con 0x5627f8801c40 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94729672901360] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94729672905472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880dbd0 con 0x5627f8801c40 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.737+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880e670 con 0x5627f8807e60 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94729672905472] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94729672909120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880ef10 con 0x5627f8807e60 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880d720 con 0x7f6918009040 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94729672913952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880fcf0 con 0x7f6918009040 2024-09-12T17:13:16.745 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f88106b0 con 0x5627f8801c40 2024-09-12T17:13:16.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94729672909120] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.741+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94729672913952] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.746 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94729672915008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880fc60 con 0x5627f8801c40 2024-09-12T17:13:16.747 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8810b60 con 0x7f6920031040 2024-09-12T17:13:16.748 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94729672915008] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94729672917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8810ad0 con 0x7f6920031040 2024-09-12T17:13:16.749 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.745+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811360 con 0x7f6920031040 2024-09-12T17:13:16.751 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94729672919760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f88119f0 con 0x7f6920031040 2024-09-12T17:13:16.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f88122a0 con 0x7f6920031040 2024-09-12T17:13:16.752 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94729672917504] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94729672919760] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.753 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94729672918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f88119f0 con 0x7f6920031040 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=0 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=1 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=2 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=3 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=4 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=5 2024-09-12T17:13:16.754 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.749+0000 7f693061b9c0 20 add_watcher() i=6 2024-09-12T17:13:16.755 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94729672918560] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 20 add_watcher() i=7 2024-09-12T17:13:16.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:16.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f88153a0 con 0x5627f8801c40 2024-09-12T17:13:16.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.756 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94729672922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8812820 con 0x5627f8801c40 2024-09-12T17:13:16.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94729672922432] v34'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f67e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:16.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:16.757 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.753+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881dad0 con 0x5627f8801c40 2024-09-12T17:13:16.758 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.759 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881df80 con 0x7f6920031040 2024-09-12T17:13:16.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881df80 con 0x5627f8807e60 2024-09-12T17:13:16.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.761 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.757+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881e320 con 0x5627f8801c40 2024-09-12T17:13:16.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881e320 con 0x7f6918009040 2024-09-12T17:13:16.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'82 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.763 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881e890 con 0x5627f8807e60 2024-09-12T17:13:16.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'54 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.764 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881ecc0 con 0x5627f8801c40 2024-09-12T17:13:16.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.761+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.766 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.765+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881edf0 con 0x7f6920031040 2024-09-12T17:13:16.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.765+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.768 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.765+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881edf0 con 0x7f6918009040 2024-09-12T17:13:16.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.765+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.770 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.765+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881f360 con 0x5627f8807e60 2024-09-12T17:13:16.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.771 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881f3f0 con 0x7f6918009040 2024-09-12T17:13:16.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'83 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.772 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881f960 con 0x7f6920031040 2024-09-12T17:13:16.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.774 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.769+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881f960 con 0x7f6918009040 2024-09-12T17:13:16.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.773+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.775 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.773+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6920031040 2024-09-12T17:13:16.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.773+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.777 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.773+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8801c40 2024-09-12T17:13:16.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.778 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.780 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6918009040 2024-09-12T17:13:16.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'84 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.781 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.777+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.782 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.781+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8801c40 2024-09-12T17:13:16.784 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.781+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.781+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8801c40 2024-09-12T17:13:16.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.781+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.785 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.781+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.787 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6918009040 2024-09-12T17:13:16.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.788 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.789 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.785+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.789+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.789+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881ffe0 con 0x5627f8807e60 2024-09-12T17:13:16.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.789+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'55 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.792 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.789+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881ffe0 con 0x7f6920031040 2024-09-12T17:13:16.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881ffe0 con 0x5627f8807e60 2024-09-12T17:13:16.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6920031040 2024-09-12T17:13:16.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.793+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x5627f8807e60 2024-09-12T17:13:16.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.797+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.800 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.797+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6920031040 2024-09-12T17:13:16.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.797+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.797+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f881fe10 con 0x7f6918009040 2024-09-12T17:13:16.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f67df7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 20 Filter name: none 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f67dd7fa640 20 reqs_thread_entry: start 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.805 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f881d360 con 0x5627f8807e60 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 20 rados_obj.operate() r=0 bl.length=363 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f883d920 con 0x5627f8807e60 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f69180ce020 con 0x5627f8807e60 2024-09-12T17:13:16.806 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 10 removing key index: true_admin_akey 2024-09-12T17:13:16.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.801+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f883b900 con 0x5627f8807e60 2024-09-12T17:13:16.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-12T17:13:16.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94729673098336 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f883dd40 con 0x7f6920031040 2024-09-12T17:13:16.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== watch-notify(notify (1) cookie 94729672917504 notify 146028888095 ret 0) ==== 207+0+0 (crc 0 0 0) 0x5627f881f360 con 0x7f6920031040 2024-09-12T17:13:16.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f6811ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94729672917504 notifier 4867 bl.length()=165 2024-09-12T17:13:16.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(97 notify.5 [notify cookie 94729673098336 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f6811ffb640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f67f4003d70 con 0x7f6920031040 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== watch-notify(notify_complete (2) cookie 94729673098336 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6928039020 con 0x7f6920031040 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 removing email index: 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 removing user buckets index 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f883b900 con 0x5627f8807e60 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'3 uv2 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 removing user index: a_user 2024-09-12T17:13:16.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f883da80 con 0x5627f8807e60 2024-09-12T17:13:16.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-12T17:13:16.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-12T17:13:16.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.805+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94729673102800 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5627f883d9f0 con 0x5627f8807e60 2024-09-12T17:13:16.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== watch-notify(notify (1) cookie 94729672909120 notify 146028888074 ret 0) ==== 197+0+0 (crc 0 0 0) 0x5627f881ee40 con 0x5627f8807e60 2024-09-12T17:13:16.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f6811ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888074 cookie 94729672909120 notifier 4867 bl.length()=155 2024-09-12T17:13:16.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f6811ffb640 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f67f4003d70 con 0x5627f8807e60 2024-09-12T17:13:16.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(101 notify.2 [notify cookie 94729673102800 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== watch-notify(notify_complete (2) cookie 94729673102800 notify 146028888074 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5627f87f6e90 con 0x5627f8807e60 2024-09-12T17:13:16.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f67e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94729672922432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f883d5d0 con 0x5627f8801c40 2024-09-12T17:13:16.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94729672922432] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94729672901360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x7f6918009040 2024-09-12T17:13:16.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94729672901360] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f693061b9c0 20 remove_watcher() i=0 2024-09-12T17:13:16.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f693061b9c0 2 removed watcher, disabling cache 2024-09-12T17:13:16.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.809+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94729672905472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x5627f8801c40 2024-09-12T17:13:16.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94729672905472] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f693061b9c0 20 remove_watcher() i=1 2024-09-12T17:13:16.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94729672909120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x5627f8807e60 2024-09-12T17:13:16.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f692d920640 1 -- 172.21.15.193:0/2323273859 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94729672909120] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6918116040 con 0x5627f8807e60 2024-09-12T17:13:16.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f693061b9c0 20 remove_watcher() i=2 2024-09-12T17:13:16.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.813+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94729672913952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x7f6918009040 2024-09-12T17:13:16.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f692e922640 1 -- 172.21.15.193:0/2323273859 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94729672913952] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6920040040 con 0x7f6918009040 2024-09-12T17:13:16.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f693061b9c0 20 remove_watcher() i=3 2024-09-12T17:13:16.819 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94729672915008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f880f420 con 0x5627f8801c40 2024-09-12T17:13:16.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94729672915008] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x5627f8801c40 2024-09-12T17:13:16.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f693061b9c0 20 remove_watcher() i=4 2024-09-12T17:13:16.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.817+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94729672917504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x7f6920031040 2024-09-12T17:13:16.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94729672917504] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f693061b9c0 20 remove_watcher() i=5 2024-09-12T17:13:16.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94729672919760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8810200 con 0x7f6920031040 2024-09-12T17:13:16.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94729672919760] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f693061b9c0 20 remove_watcher() i=6 2024-09-12T17:13:16.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.821+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94729672918560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5627f8811540 con 0x7f6920031040 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94729672918560] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692802e070 con 0x7f6920031040 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 20 remove_watcher() i=7 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6920031040 msgr2=0x7f6920032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6920031040 0x7f6920032940 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f8801c40 msgr2=0x5627f88040d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f8801c40 0x5627f88040d0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6918009040 msgr2=0x7f69180f7ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6918009040 0x7f69180f7ab0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627f8807e60 msgr2=0x5627f880a250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x5627f8807e60 0x5627f880a250 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f8039a70 msgr2=0x7f67f803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f67f8039a70 0x7f67f803bf30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x5627f87cd1d0 tx=0x7f692001f000 comp rx=0 tx=0).stop 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 msgr2=0x5627f87f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f692e121640 1 -- 172.21.15.193:0/2323273859 reap_dead start 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f691800a5c0 tx=0x7f69180ebe30 comp rx=0 tx=0).stop 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 shutdown_connections 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/2323273859 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87ef390 0x5627f87f6930 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 >> 172.21.15.193:0/2323273859 conn(0x5627f87eb7c0 msgr2=0x5627f87e99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 shutdown_connections 2024-09-12T17:13:16.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/2323273859 wait complete. 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 msgr2=0x7f680803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 0x7f680803bf30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5627f87d3590 tx=0x7f6920005850 comp rx=0 tx=0).stop 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 msgr2=0x5627f87e2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c10 tx=0x7f69180180e0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 shutdown_connections 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6808039a70 0x7f680803bf30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/525795585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f87e2b50 0x5627f87e2f70 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 >> 172.21.15.193:0/525795585 conn(0x5627f87d8500 msgr2=0x5627f87d88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 shutdown_connections 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/525795585 wait complete. 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 msgr2=0x5627f87d2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 0x5627f87d2680 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 msgr2=0x7f681403bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 0x7f681403bf80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae000 tx=0x7f69180a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 msgr2=0x5627f87cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5627f87c4860 tx=0x7f6928000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 shutdown_connections 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x5627f87d0290 0x5627f87d2680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6814039ac0 0x7f681403bf80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 --2- 172.21.15.193:0/3902123164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x5627f86dc220 0x5627f87cb270 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 >> 172.21.15.193:0/3902123164 conn(0x5627f864baa0 msgr2=0x5627f87bdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 shutdown_connections 2024-09-12T17:13:16.835 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.825+0000 7f693061b9c0 1 -- 172.21.15.193:0/3902123164 wait complete. 2024-09-12T17:13:16.839 ERROR:root:None 2024-09-12T17:13:16.839 ERROR:root:0 2024-09-12T17:13:16.839 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T17:13:16.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-12T17:13:16.839 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-12T17:13:16.919 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:16.919 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:16.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3f9be9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c4918cdf90 0x55c4918ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3f9be9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c49180b9c0 con 0x55c4918d10d0 2024-09-12T17:13:16.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3f9be9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c49185b6d0 con 0x55c4918cdf90 2024-09-12T17:13:16.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3d4c4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c4918cdf90 0x55c4918ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3d4c4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c4918cdf90 0x55c4918ce370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46194/0 (socket says 172.21.15.193:46194) 2024-09-12T17:13:16.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3d4c4640 1 -- 172.21.15.193:0/1466485792 learned_addr learned my addr 172.21.15.193:0/1466485792 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3d4c4640 1 -- 172.21.15.193:0/1466485792 >> v1:172.21.15.62:6789/0 conn(0x55c4918d10d0 legacy=0x55c4918d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.921 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.917+0000 7faf3d4c4640 1 -- 172.21.15.193:0/1466485792 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4917ffca0 con 0x55c4918cdf90 2024-09-12T17:13:16.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/1466485792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c4918ce370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faf3000a5c0 tx=0x7faf3001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23be5ed73f90171c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf2ffff640 1 -- 172.21.15.193:0/1466485792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300af070 con 0x55c4918cdf90 2024-09-12T17:13:16.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf2ffff640 1 -- 172.21.15.193:0/1466485792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300aa530 con 0x55c4918cdf90 2024-09-12T17:13:16.925 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf2ffff640 1 -- 172.21.15.193:0/1466485792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300aa830 con 0x55c4918cdf90 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1466485792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 msgr2=0x55c4918ce370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/1466485792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c4918ce370 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7faf3000a5c0 tx=0x7faf3001b340 comp rx=0 tx=0).stop 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1466485792 shutdown_connections 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/1466485792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c4918ce370 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1466485792 >> 172.21.15.193:0/1466485792 conn(0x55c4918ccb00 msgr2=0x55c4918ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.926 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1466485792 shutdown_connections 2024-09-12T17:13:16.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.921+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1466485792 wait complete. 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c49185f680 con 0x55c4918cdf90 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46196/0 (socket says 172.21.15.193:46196) 2024-09-12T17:13:16.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 -- 172.21.15.193:0/3346102908 learned_addr learned my addr 172.21.15.193:0/3346102908 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 -- 172.21.15.193:0/3346102908 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4917dada0 con 0x55c4918cdf90 2024-09-12T17:13:16.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/3346102908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faf300ad040 tx=0x7faf30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a619780b0be4202 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7fae2b606640 1 -- 172.21.15.193:0/3346102908 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300af040 con 0x55c4918cdf90 2024-09-12T17:13:16.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7fae2b606640 1 -- 172.21.15.193:0/3346102908 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300aab30 con 0x55c4918cdf90 2024-09-12T17:13:16.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7fae2b606640 1 -- 172.21.15.193:0/3346102908 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300aae10 con 0x55c4918cdf90 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3346102908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 msgr2=0x55c491a49350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3346102908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faf300ad040 tx=0x7faf30003030 comp rx=0 tx=0).stop 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3346102908 shutdown_connections 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3346102908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a49350 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3346102908 >> 172.21.15.193:0/3346102908 conn(0x55c4918ccb00 msgr2=0x55c491a44f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3346102908 shutdown_connections 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3346102908 wait complete. 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3f9be9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c491801a50 con 0x55c4918cdf90 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46212/0 (socket says 172.21.15.193:46212) 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.937+0000 7faf3d4c4640 1 -- 172.21.15.193:0/204212129 learned_addr learned my addr 172.21.15.193:0/204212129 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3d4c4640 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c491a50e30 con 0x55c4918cdf90 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faf3001bbe0 tx=0x7faf300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 -- 172.21.15.193:0/204212129 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300c2070 con 0x55c4918cdf90 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c491a510c0 con 0x55c4918cdf90 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 -- 172.21.15.193:0/204212129 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300b5b80 con 0x55c4918cdf90 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c491a51a70 con 0x55c4918cdf90 2024-09-12T17:13:16.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 -- 172.21.15.193:0/204212129 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf300cc060 con 0x55c4918cdf90 2024-09-12T17:13:16.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 -- 172.21.15.193:0/204212129 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf300c5070 con 0x55c4918cdf90 2024-09-12T17:13:16.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7fae29e03640 1 -- 172.21.15.193:0/204212129 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf300ba070 con 0x55c4918cdf90 2024-09-12T17:13:16.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 0x55c491a57a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a57f80 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 0x55c491a57a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf340015d0 tx=0x7faf340066b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 0x55c491a57a40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3dcc5640 1 -- 172.21.15.193:0/204212129 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf380083f0 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a51df0 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3dcc5640 1 -- 172.21.15.193:0/204212129 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf380083f0 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a59d30 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3dcc5640 1 -- 172.21.15.193:0/204212129 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faf380083f0 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.941+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a58f60 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3dcc5640 1 -- 172.21.15.193:0/204212129 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf380083f0 con 0x55c4918d10d0 2024-09-12T17:13:16.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a593b0 con 0x55c4918d10d0 2024-09-12T17:13:16.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3dcc5640 1 -- 172.21.15.193:0/204212129 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faf380083f0 con 0x55c4918d10d0 2024-09-12T17:13:16.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c49186c450 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46222/0 (socket says 172.21.15.193:46222) 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3ccc3640 1 -- 172.21.15.193:0/3712421103 learned_addr learned my addr 172.21.15.193:0/3712421103 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3ccc3640 1 -- 172.21.15.193:0/3712421103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c491a68aa0 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faf34012630 tx=0x7faf34015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 -- 172.21.15.193:0/3712421103 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf340152c0 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 -- 172.21.15.193:0/3712421103 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf34020430 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c491a69300 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 -- 172.21.15.193:0/3712421103 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34020710 con 0x55c491a68040 2024-09-12T17:13:16.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c491a69870 con 0x55c491a68040 2024-09-12T17:13:16.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 -- 172.21.15.193:0/3712421103 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf34010070 con 0x55c491a68040 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 0x7fae1403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.945+0000 7fae22ffd640 1 -- 172.21.15.193:0/3712421103 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf3401b070 con 0x55c491a68040 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 0x7fae1403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 0x7fae1403bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf3800e3f0 tx=0x7faf38003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c491a49ae0 con 0x55c491a75a30 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46234/0 (socket says 172.21.15.193:46234) 2024-09-12T17:13:16.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 -- 172.21.15.193:0/1360504648 learned_addr learned my addr 172.21.15.193:0/1360504648 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 -- 172.21.15.193:0/1360504648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c491a76420 con 0x55c491a75a30 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/1360504648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faf34050460 tx=0x7faf34028af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de56d1db327f7081 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7fae20ff9640 1 -- 172.21.15.193:0/1360504648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3401d8f0 con 0x55c491a75a30 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7fae20ff9640 1 -- 172.21.15.193:0/1360504648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3401dd80 con 0x55c491a75a30 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7fae20ff9640 1 -- 172.21.15.193:0/1360504648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34028de0 con 0x55c491a75a30 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1360504648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 msgr2=0x55c491a75e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/1360504648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7faf34050460 tx=0x7faf34028af0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1360504648 shutdown_connections 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/1360504648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a75e30 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1360504648 >> 172.21.15.193:0/1360504648 conn(0x55c491a70e50 msgr2=0x55c491a6f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:16.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1360504648 shutdown_connections 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/1360504648 wait complete. 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 Processor -- start 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- start start 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3f9be9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c491a74980 con 0x55c491a75a30 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46236/0 (socket says 172.21.15.193:46236) 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 learned_addr learned my addr 172.21.15.193:0/576832322 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.949+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c491a7c4b0 con 0x55c491a75a30 2024-09-12T17:13:16.956 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faf3401dae0 tx=0x7faf340503f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 -- 172.21.15.193:0/576832322 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34010420 con 0x55c491a75a30 2024-09-12T17:13:16.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 -- 172.21.15.193:0/576832322 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3401d8f0 con 0x55c491a75a30 2024-09-12T17:13:16.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c491a7c740 con 0x55c491a75a30 2024-09-12T17:13:16.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 -- 172.21.15.193:0/576832322 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3401e3c0 con 0x55c491a75a30 2024-09-12T17:13:16.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c491a7d0f0 con 0x55c491a75a30 2024-09-12T17:13:16.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 -- 172.21.15.193:0/576832322 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7faf34039060 con 0x55c491a75a30 2024-09-12T17:13:16.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7fae12ffd640 1 -- 172.21.15.193:0/576832322 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7faf34044030 con 0x55c491a75a30 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c491a87310 0x55c491a897a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a89ef0 con 0x55c491a87310 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c491a87310 0x55c491a897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf3800f010 tx=0x7faf3801b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c491a87310 0x55c491a897a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 realm 2024-09-12T17:13:16.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8a300 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8abd0 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8af70 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.963 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8b7c0 con 0x55c491a87310 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 20 searching for the correct realm 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c491a8d530 0x55c491a8f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.953+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c491a8d530 0x55c491a8f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c491a8d530 0x55c491a8f920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3ccc3640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7faf34058040 0x7faf3403ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7faf34058040 0x7faf3403ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7faf34058040 0x7faf3403ea90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3dcc5640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7faf38019040 0x7faf38019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7faf38019040 0x7faf38019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7faf38019040 0x7faf38019930 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.957+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.970 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.961+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.973 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a8d530 2024-09-12T17:13:16.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.965+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf38019040 2024-09-12T17:13:16.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x55c491a87310 2024-09-12T17:13:16.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8fe60 con 0x7faf34058040 2024-09-12T17:13:16.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.977 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8c1d0 con 0x55c491a87310 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8ca70 con 0x55c491a87310 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a8ca70 con 0x55c491a87310 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 zone default found 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 4 Realm: () 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 zonegroup default 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a90200 con 0x7faf38019040 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a920a0 con 0x55c491a8d530 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a92440 con 0x55c491a8d530 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 started sync module instance, tier type = 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:16.980 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a914e0 con 0x7faf34058040 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94302745729280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a92c90 con 0x7faf34058040 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.969+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a934e0 con 0x55c491a87310 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.973+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94302745729280] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.973+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.973+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94302745733088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a934e0 con 0x55c491a87310 2024-09-12T17:13:16.981 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.973+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a93ea0 con 0x55c491a8d530 2024-09-12T17:13:16.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.973+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94302745733088] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94302745735216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a93450 con 0x55c491a8d530 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a94c30 con 0x7faf34058040 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94302745741120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a954d0 con 0x7faf34058040 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a95f10 con 0x55c491a87310 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94302745735216] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94302745741120] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94302745745888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a95020 con 0x55c491a87310 2024-09-12T17:13:16.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.977+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a967b0 con 0x7faf38019040 2024-09-12T17:13:16.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.981+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94302745745888] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.981+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.981+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94302745739920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a95020 con 0x7faf38019040 2024-09-12T17:13:16.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.981+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a96c60 con 0x7faf38019040 2024-09-12T17:13:16.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.981+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94302745739920] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94302745749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a96c20 con 0x7faf38019040 2024-09-12T17:13:16.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a97640 con 0x7faf38019040 2024-09-12T17:13:16.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94302745749296] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.989 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94302745751856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a97600 con 0x7faf38019040 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=0 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=1 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=2 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=3 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=4 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=5 2024-09-12T17:13:16.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.985+0000 7faf3f9be9c0 20 add_watcher() i=6 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94302745751856] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 add_watcher() i=7 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491a9aa30 con 0x55c491a87310 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94302745747648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a97f80 con 0x55c491a87310 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94302745747648] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7fadf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 5 note: GC not initialized 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7fadf2fe5640 20 reqs_thread_entry: start 2024-09-12T17:13:16.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 Filter name: none 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7fadf0fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.989+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491abdc20 con 0x7faf38019040 2024-09-12T17:13:16.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:13:16.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:16.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:16.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:16.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491ac4160 con 0x7faf38019040 2024-09-12T17:13:16.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:16.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:16.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:16.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94302745934864 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c491abf8b0 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94302745745888 notify 146028888114 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55c491a51a70 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94302745934864 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7fae20ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888114 cookie 94302745745888 notifier 4874 bl.length()=666 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7fae20ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7fae20ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7fae20ff9640 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fae00003eb0 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.993+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94302745934864 notify 146028888114 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c491a510c0 con 0x55c491a87310 2024-09-12T17:13:16.999 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7fadf3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94302745747648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491abba00 con 0x55c491a87310 2024-09-12T17:13:17.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94302745747648] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:17.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94302745729280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491abba00 con 0x7faf34058040 2024-09-12T17:13:17.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94302745729280] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:17.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3f9be9c0 20 remove_watcher() i=0 2024-09-12T17:13:17.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3f9be9c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:16.997+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94302745733088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491abba00 con 0x55c491a87310 2024-09-12T17:13:17.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94302745733088] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:17.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3f9be9c0 20 remove_watcher() i=1 2024-09-12T17:13:17.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94302745735216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491abba00 con 0x55c491a8d530 2024-09-12T17:13:17.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3ccc3640 1 -- 172.21.15.193:0/576832322 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94302745735216] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf34026020 con 0x55c491a8d530 2024-09-12T17:13:17.005 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3f9be9c0 20 remove_watcher() i=2 2024-09-12T17:13:17.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.001+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94302745741120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a93030 con 0x7faf34058040 2024-09-12T17:13:17.006 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3dcc5640 1 -- 172.21.15.193:0/576832322 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94302745741120] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf3802f040 con 0x7faf34058040 2024-09-12T17:13:17.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3f9be9c0 20 remove_watcher() i=3 2024-09-12T17:13:17.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94302745745888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a93030 con 0x55c491a87310 2024-09-12T17:13:17.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94302745745888] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x55c491a87310 2024-09-12T17:13:17.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3f9be9c0 20 remove_watcher() i=4 2024-09-12T17:13:17.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.005+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94302745739920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a959e0 con 0x7faf38019040 2024-09-12T17:13:17.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94302745739920] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:17.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3f9be9c0 20 remove_watcher() i=5 2024-09-12T17:13:17.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94302745749296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a93030 con 0x7faf38019040 2024-09-12T17:13:17.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94302745749296] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:17.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3f9be9c0 20 remove_watcher() i=6 2024-09-12T17:13:17.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.009+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94302745751856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c491a959e0 con 0x7faf38019040 2024-09-12T17:13:17.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94302745751856] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faf300c4030 con 0x7faf38019040 2024-09-12T17:13:17.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 20 remove_watcher() i=7 2024-09-12T17:13:17.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7faf38019040 msgr2=0x7faf38019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7faf38019040 0x7faf38019930 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c491a87310 msgr2=0x55c491a897a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c491a87310 0x55c491a897a0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7faf34058040 msgr2=0x7faf3403ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7faf34058040 0x7faf3403ea90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c491a8d530 msgr2=0x55c491a8f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c491a8d530 0x55c491a8f920 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 msgr2=0x7fae0803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae08039a70 0x7fae0803bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf3800f010 tx=0x7faf3801b070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 msgr2=0x55c491a7bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3d4c4640 1 -- 172.21.15.193:0/576832322 reap_dead start 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faf3401dae0 tx=0x7faf340503f0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 shutdown_connections 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/576832322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a75a30 0x55c491a7bf50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 >> 172.21.15.193:0/576832322 conn(0x55c491a70e50 msgr2=0x55c491a6f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 shutdown_connections 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/576832322 wait complete. 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 msgr2=0x7fae1403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 0x7fae1403bf30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7faf3800e3f0 tx=0x7faf38003070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 msgr2=0x55c491a68460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faf34012630 tx=0x7faf34015f90 comp rx=0 tx=0).stop 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 shutdown_connections 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae14039a70 0x7fae1403bf30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/3712421103 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c491a68040 0x55c491a68460 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 >> 172.21.15.193:0/3712421103 conn(0x55c491a5d9f0 msgr2=0x55c491a5ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 shutdown_connections 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/3712421103 wait complete. 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 msgr2=0x55c491a57a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 0x55c491a57a40 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 msgr2=0x7fae2403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 0x7fae2403bf30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7faf340015d0 tx=0x7faf340066b0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 msgr2=0x55c491a508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7faf3001bbe0 tx=0x7faf300180e0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 shutdown_connections 2024-09-12T17:13:17.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c4918d10d0 0x55c491a57a40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fae24039a70 0x7fae2403bf30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 --2- 172.21.15.193:0/204212129 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c4918cdf90 0x55c491a508d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 >> 172.21.15.193:0/204212129 conn(0x55c4918ccb00 msgr2=0x55c491a43a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 shutdown_connections 2024-09-12T17:13:17.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.013+0000 7faf3f9be9c0 1 -- 172.21.15.193:0/204212129 wait complete. 2024-09-12T17:13:17.026 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.027 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.027 ERROR:root:0 2024-09-12T17:13:17.027 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:17.031 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:17.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T17:13:17.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-12T17:13:17.031 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-12T17:13:17.102 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.102 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e52c79c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557174e21140 0x557174e23530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e52c79c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557174cd19c0 con 0x557174e1cfa0 2024-09-12T17:13:17.103 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e52c79c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x557174d216d0 con 0x557174e21140 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557174e21140 0x557174e23530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557174e21140 0x557174e23530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:46242/0 (socket says 172.21.15.193:46242) 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1057801144 learned_addr learned my addr 172.21.15.193:0/1057801144 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e2dcd640 1 --1- 172.21.15.193:0/1057801144 >> v1:172.21.15.62:6789/0 conn(0x557174e1cfa0 0x557174e1d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:44408/0 (socket says 172.21.15.193:44408) 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1057801144 >> v1:172.21.15.62:6789/0 conn(0x557174e1cfa0 legacy=0x557174e1d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.104 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1057801144 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174cc5ca0 con 0x557174e21140 2024-09-12T17:13:17.106 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1057801144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e21140 0x557174e23530 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a5c0 tx=0x7ff9cc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b60474c8e68a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e1dcb640 1 -- 172.21.15.193:0/1057801144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0a9590 con 0x557174e21140 2024-09-12T17:13:17.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e1dcb640 1 -- 172.21.15.193:0/1057801144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0ae070 con 0x557174e21140 2024-09-12T17:13:17.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.101+0000 7ff9e1dcb640 1 -- 172.21.15.193:0/1057801144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0a9880 con 0x557174e21140 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1057801144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e21140 msgr2=0x557174e23530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1057801144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e21140 0x557174e23530 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc00a5c0 tx=0x7ff9cc01b3d0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1057801144 shutdown_connections 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1057801144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e21140 0x557174e23530 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1057801144 >> 172.21.15.193:0/1057801144 conn(0x557174e18ac0 msgr2=0x557174e1aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1057801144 shutdown_connections 2024-09-12T17:13:17.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.105+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1057801144 wait complete. 2024-09-12T17:13:17.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.120 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557174d25680 con 0x557174e1cfa0 2024-09-12T17:13:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e2dcd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e2dcd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45474/0 (socket says 172.21.15.193:45474) 2024-09-12T17:13:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/3167086161 learned_addr learned my addr 172.21.15.193:0/3167086161 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/3167086161 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174ca0da0 con 0x557174e1cfa0 2024-09-12T17:13:17.121 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/3167086161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001680 tx=0x7ff9dc001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30a54c82a62325d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff8d0e09640 1 -- 172.21.15.193:0/3167086161 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc013420 con 0x557174e1cfa0 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff8d0e09640 1 -- 172.21.15.193:0/3167086161 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0135c0 con 0x557174e1cfa0 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff8d0e09640 1 -- 172.21.15.193:0/3167086161 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc0138e0 con 0x557174e1cfa0 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3167086161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 msgr2=0x557174f08730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3167086161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc001680 tx=0x7ff9dc001b40 comp rx=0 tx=0).stop 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3167086161 shutdown_connections 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3167086161 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f08730 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3167086161 >> 172.21.15.193:0/3167086161 conn(0x557174e18ac0 msgr2=0x557174f043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.117+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3167086161 shutdown_connections 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3167086161 wait complete. 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.123 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557174cc7a50 con 0x557174e1cfa0 2024-09-12T17:13:17.124 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e2dcd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e2dcd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45476/0 (socket says 172.21.15.193:45476) 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/3367692328 learned_addr learned my addr 172.21.15.193:0/3367692328 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174f102d0 con 0x557174e1cfa0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x557174f09720 tx=0x7ff9dc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 -- 172.21.15.193:0/3367692328 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc0037a0 con 0x557174e1cfa0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557174f10560 con 0x557174e1cfa0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557174f10f10 con 0x557174e1cfa0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 -- 172.21.15.193:0/3367692328 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc023070 con 0x557174e1cfa0 2024-09-12T17:13:17.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 -- 172.21.15.193:0/3367692328 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc003a70 con 0x557174e1cfa0 2024-09-12T17:13:17.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 -- 172.21.15.193:0/3367692328 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff9dc010070 con 0x557174e1cfa0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 0x7ff8c803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff8cf606640 1 -- 172.21.15.193:0/3367692328 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff9dc050250 con 0x557174e1cfa0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 0x7ff8c803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 0x557174f16ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f17420 con 0x557174e21140 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.121+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 0x557174f16ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 0x7ff8c803bf80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0ad000 tx=0x7ff9cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 0x557174f16ee0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 -- 172.21.15.193:0/3367692328 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9d40083f0 con 0x557174e21140 2024-09-12T17:13:17.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f177c0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 -- 172.21.15.193:0/3367692328 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9d40083f0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f190c0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 -- 172.21.15.193:0/3367692328 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9d40083f0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f182f0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 -- 172.21.15.193:0/3367692328 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9d40083f0 con 0x557174e21140 2024-09-12T17:13:17.129 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f18740 con 0x557174e21140 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e35ce640 1 -- 172.21.15.193:0/3367692328 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9d40083f0 con 0x557174e21140 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e52c79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557174d32450 con 0x557174f273d0 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45488/0 (socket says 172.21.15.193:45488) 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1137651438 learned_addr learned my addr 172.21.15.193:0/1137651438 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1137651438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174f27e30 con 0x557174f273d0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc017fe0 tx=0x7ff9cc018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff8cce01640 1 -- 172.21.15.193:0/1137651438 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0b3ba0 con 0x557174f273d0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff8cce01640 1 -- 172.21.15.193:0/1137651438 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0b3d40 con 0x557174f273d0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.125+0000 7ff8cce01640 1 -- 172.21.15.193:0/1137651438 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0c8580 con 0x557174f273d0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557174f28690 con 0x557174f273d0 2024-09-12T17:13:17.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557174f28ba0 con 0x557174f273d0 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8cce01640 1 -- 172.21.15.193:0/1137651438 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff9cc0d1440 con 0x557174f273d0 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8cce01640 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 0x7ff8bc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8cce01640 1 -- 172.21.15.193:0/1137651438 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff9cc0edca0 con 0x557174f273d0 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 0x7ff8bc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 0x7ff8bc03bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x557174f17e10 tx=0x7ff9d4003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e52c79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557174f08f60 con 0x557174f34c80 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45498/0 (socket says 172.21.15.193:45498) 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e25cc640 1 -- 172.21.15.193:0/142583504 learned_addr learned my addr 172.21.15.193:0/142583504 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e25cc640 1 -- 172.21.15.193:0/142583504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174f35650 con 0x557174f34c80 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/142583504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c7480 tx=0x7ff9cc0c76d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becd0bdb145990db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8c67fc640 1 -- 172.21.15.193:0/142583504 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0be410 con 0x557174f34c80 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8c67fc640 1 -- 172.21.15.193:0/142583504 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0bc3b0 con 0x557174f34c80 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.129+0000 7ff8c67fc640 1 -- 172.21.15.193:0/142583504 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0be5b0 con 0x557174f34c80 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/142583504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 msgr2=0x557174f35060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/142583504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c7480 tx=0x7ff9cc0c76d0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/142583504 shutdown_connections 2024-09-12T17:13:17.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/142583504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f35060 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/142583504 >> 172.21.15.193:0/142583504 conn(0x557174f30040 msgr2=0x557174f2e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/142583504 shutdown_connections 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/142583504 wait complete. 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 Processor -- start 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- start start 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557174f33b70 con 0x557174f34c80 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e25cc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45502/0 (socket says 172.21.15.193:45502) 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 learned_addr learned my addr 172.21.15.193:0/1410354777 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557174f3b6c0 con 0x557174f34c80 2024-09-12T17:13:17.137 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c7af0 tx=0x7ff9cc0ebf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 -- 172.21.15.193:0/1410354777 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0f2070 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557174f3b950 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557174f3c300 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 -- 172.21.15.193:0/1410354777 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc0bca80 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 -- 172.21.15.193:0/1410354777 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc0fc060 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 -- 172.21.15.193:0/1410354777 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff9cc0f5070 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8ac039a70 0x7ff8ac03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff8c4ff9640 1 -- 172.21.15.193:0/1410354777 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff9cc0f9080 con 0x557174f34c80 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8ac039a70 0x7ff8ac03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174f464e0 0x557174f48970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.133+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f490c0 con 0x557174f464e0 2024-09-12T17:13:17.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174f464e0 0x557174f48970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8ac039a70 0x7ff8ac03bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400f010 tx=0x7ff9d401b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174f464e0 0x557174f48970 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 realm 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f494d0 con 0x557174f464e0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f49da0 con 0x557174f464e0 2024-09-12T17:13:17.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4a140 con 0x557174f464e0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4a990 con 0x557174f464e0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 20 searching for the correct realm 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557174f4c700 0x557174f4eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557174f4f030 con 0x557174f4c700 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557174f4c700 0x557174f4eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.144 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557174f4c700 0x557174f4eaf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e25cc640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff9cc0f7060 0x7ff9cc0e90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff9cc0f7060 0x7ff9cc0e90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff9cc0f7060 0x7ff9cc0e90d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff9d4019040 0x7ff9d4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff9d4019040 0x7ff9d4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.137+0000 7ff9e2dcd640 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff9d4019040 0x7ff9d4019930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.141+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.145+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f4c700 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9d4019040 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x557174f464e0 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7ff9cc102040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:17.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4b2e0 con 0x557174f464e0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4bb30 con 0x557174f464e0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4bb30 con 0x557174f464e0 2024-09-12T17:13:17.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 zone default found 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 4 Realm: () 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 zonegroup default 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.149+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f4f460 con 0x7ff9d4019040 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.160 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f50f50 con 0x557174f4c700 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f513b0 con 0x557174f4c700 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 started sync module instance, tier type = 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f502f0 con 0x7ff9cc0f7060 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93945781880544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f4ff50 con 0x7ff9cc0f7060 2024-09-12T17:13:17.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f522e0 con 0x557174f464e0 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.153+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93945781880544] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93945781884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f522e0 con 0x557174f464e0 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f52ca0 con 0x557174f4c700 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93945781884944] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93945781886512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f52250 con 0x557174f4c700 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f539a0 con 0x7ff9cc0f7060 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93945781892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f54240 con 0x7ff9cc0f7060 2024-09-12T17:13:17.163 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.157+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f54c40 con 0x557174f464e0 2024-09-12T17:13:17.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93945781886512] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93945781892640] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93945781891136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f53d90 con 0x557174f464e0 2024-09-12T17:13:17.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f554e0 con 0x7ff9d4019040 2024-09-12T17:13:17.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.161+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93945781891136] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93945781897040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f53d90 con 0x7ff9d4019040 2024-09-12T17:13:17.167 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f55930 con 0x7ff9d4019040 2024-09-12T17:13:17.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93945781897040] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93945781900352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f55d70 con 0x7ff9d4019040 2024-09-12T17:13:17.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.165+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f54e80 con 0x7ff9d4019040 2024-09-12T17:13:17.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93945781898880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f567e0 con 0x7ff9d4019040 2024-09-12T17:13:17.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=0 2024-09-12T17:13:17.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=1 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=2 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=3 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=4 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=5 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93945781900352] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=6 2024-09-12T17:13:17.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93945781898880] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 20 add_watcher() i=7 2024-09-12T17:13:17.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:17.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f567e0 con 0x557174f464e0 2024-09-12T17:13:17.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.169+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93945781904176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f56750 con 0x557174f464e0 2024-09-12T17:13:17.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93945781904176] v34'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff8997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:17.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 5 note: GC not initialized 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff813fff640 20 reqs_thread_entry: start 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 Filter name: none 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff811ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f7ca40 con 0x7ff9d4019040 2024-09-12T17:13:17.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:13:17.177 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:17.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:17.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.173+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f83270 con 0x7ff9d4019040 2024-09-12T17:13:17.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e52c79c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e52c79c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e52c79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93945782086880 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557174f7e960 con 0x557174f464e0 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 93945781891136 notify 146028888115 ret 0) ==== 708+0+0 (crc 0 0 0) 0x557174f10f10 con 0x557174f464e0 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff8c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888115 cookie 93945781891136 notifier 4881 bl.length()=666 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff8c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff8c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 93945782086880 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff8c67fc640 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff8a8003eb0 con 0x557174f464e0 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 93945782086880 notify 146028888115 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557174f10560 con 0x557174f464e0 2024-09-12T17:13:17.182 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff8997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.177+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93945781904176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f7a7f0 con 0x557174f464e0 2024-09-12T17:13:17.182 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93945781904176] v34'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93945781880544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f7a7f0 con 0x7ff9cc0f7060 2024-09-12T17:13:17.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93945781880544] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 20 remove_watcher() i=0 2024-09-12T17:13:17.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.184 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93945781884944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f506e0 con 0x557174f464e0 2024-09-12T17:13:17.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93945781884944] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 20 remove_watcher() i=1 2024-09-12T17:13:17.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.181+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93945781886512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f7a7f0 con 0x557174f4c700 2024-09-12T17:13:17.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e25cc640 1 -- 172.21.15.193:0/1410354777 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93945781886512] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc0f4030 con 0x557174f4c700 2024-09-12T17:13:17.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e52c79c0 20 remove_watcher() i=2 2024-09-12T17:13:17.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93945781892640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f506e0 con 0x7ff9cc0f7060 2024-09-12T17:13:17.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e35ce640 1 -- 172.21.15.193:0/1410354777 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93945781892640] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d402f040 con 0x7ff9cc0f7060 2024-09-12T17:13:17.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e52c79c0 20 remove_watcher() i=3 2024-09-12T17:13:17.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.185+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93945781891136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f51e30 con 0x557174f464e0 2024-09-12T17:13:17.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93945781891136] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x557174f464e0 2024-09-12T17:13:17.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e52c79c0 20 remove_watcher() i=4 2024-09-12T17:13:17.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93945781897040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f53620 con 0x7ff9d4019040 2024-09-12T17:13:17.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93945781897040] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e52c79c0 20 remove_watcher() i=5 2024-09-12T17:13:17.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93945781900352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f506e0 con 0x7ff9d4019040 2024-09-12T17:13:17.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93945781900352] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.189+0000 7ff9e52c79c0 20 remove_watcher() i=6 2024-09-12T17:13:17.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93945781898880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557174f53040 con 0x7ff9d4019040 2024-09-12T17:13:17.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93945781898880] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9dc00f030 con 0x7ff9d4019040 2024-09-12T17:13:17.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 20 remove_watcher() i=7 2024-09-12T17:13:17.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff9d4019040 msgr2=0x7ff9d4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7ff9d4019040 0x7ff9d4019930 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.198 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174f464e0 msgr2=0x557174f48970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174f464e0 0x557174f48970 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff9cc0f7060 msgr2=0x7ff9cc0e90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7ff9cc0f7060 0x7ff9cc0e90d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557174f4c700 msgr2=0x557174f4eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557174f4c700 0x557174f4eaf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8ac039a70 msgr2=0x7ff8ac03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8ac039a70 0x7ff8ac03bf30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400f010 tx=0x7ff9d401b070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 msgr2=0x557174f3b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e2dcd640 1 -- 172.21.15.193:0/1410354777 reap_dead start 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0c7af0 tx=0x7ff9cc0ebf90 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 shutdown_connections 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1410354777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f34c80 0x557174f3b160 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 >> 172.21.15.193:0/1410354777 conn(0x557174f30040 msgr2=0x557174f2e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 shutdown_connections 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1410354777 wait complete. 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 msgr2=0x7ff8bc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 0x7ff8bc03bf80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x557174f17e10 tx=0x7ff9d4003070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 msgr2=0x557174f277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc017fe0 tx=0x7ff9cc018170 comp rx=0 tx=0).stop 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 shutdown_connections 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8bc039ac0 0x7ff8bc03bf80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/1137651438 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174f273d0 0x557174f277f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 >> 172.21.15.193:0/1137651438 conn(0x557174f1cd80 msgr2=0x557174f1d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 shutdown_connections 2024-09-12T17:13:17.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/1137651438 wait complete. 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 msgr2=0x557174f16ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 0x557174f16ee0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 msgr2=0x7ff8c803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 0x7ff8c803bf80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc0ad000 tx=0x7ff9cc0a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 msgr2=0x557174f0fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x557174f09720 tx=0x7ff9dc000f50 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 shutdown_connections 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557174e21140 0x557174f16ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff8c8039ac0 0x7ff8c803bf80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 --2- 172.21.15.193:0/3367692328 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557174e1cfa0 0x557174f0fd70 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 >> 172.21.15.193:0/3367692328 conn(0x557174e18ac0 msgr2=0x557174f02e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 shutdown_connections 2024-09-12T17:13:17.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.193+0000 7ff9e52c79c0 1 -- 172.21.15.193:0/3367692328 wait complete. 2024-09-12T17:13:17.209 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.209 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.209 ERROR:root:0 2024-09-12T17:13:17.209 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:17.213 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:17.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:17.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:17.214 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:13:17.284 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.284 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f63862789c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ef341d140 0x556ef341f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f63862789c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ef32cd9c0 con 0x556ef3418fa0 2024-09-12T17:13:17.285 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f63862789c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x556ef331d6d0 con 0x556ef341d140 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f638357d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ef341d140 0x556ef341f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f638357d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x556ef341d140 0x556ef341f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45506/0 (socket says 172.21.15.193:45506) 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f6383d7e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x556ef3418fa0 0x556ef3419380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:59302/0 (socket says 172.21.15.193:59302) 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f638357d640 1 -- 172.21.15.193:0/2223794529 learned_addr learned my addr 172.21.15.193:0/2223794529 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f638357d640 1 -- 172.21.15.193:0/2223794529 >> v1:172.21.15.62:6789/0 conn(0x556ef3418fa0 legacy=0x556ef3419380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.286 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.281+0000 7f638357d640 1 -- 172.21.15.193:0/2223794529 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef32c1ca0 con 0x556ef341d140 2024-09-12T17:13:17.288 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f638357d640 1 --2- 172.21.15.193:0/2223794529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef341d140 0x556ef341f530 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f637800a5c0 tx=0x7f637801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2593b42af1e4bf46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f6382d7c640 1 -- 172.21.15.193:0/2223794529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780a9590 con 0x556ef341d140 2024-09-12T17:13:17.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f6382d7c640 1 -- 172.21.15.193:0/2223794529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780ae070 con 0x556ef341d140 2024-09-12T17:13:17.289 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f6382d7c640 1 -- 172.21.15.193:0/2223794529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780a9880 con 0x556ef341d140 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 -- 172.21.15.193:0/2223794529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef341d140 msgr2=0x556ef341f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 --2- 172.21.15.193:0/2223794529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef341d140 0x556ef341f530 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f637800a5c0 tx=0x7f637801b3d0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 -- 172.21.15.193:0/2223794529 shutdown_connections 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 --2- 172.21.15.193:0/2223794529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef341d140 0x556ef341f530 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 -- 172.21.15.193:0/2223794529 >> 172.21.15.193:0/2223794529 conn(0x556ef3414ac0 msgr2=0x556ef3416ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.290 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 -- 172.21.15.193:0/2223794529 shutdown_connections 2024-09-12T17:13:17.291 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.285+0000 7f63862789c0 1 -- 172.21.15.193:0/2223794529 wait complete. 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.297+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ef3321680 con 0x556ef3418fa0 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45522/0 (socket says 172.21.15.193:45522) 2024-09-12T17:13:17.303 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 -- 172.21.15.193:0/1550679815 learned_addr learned my addr 172.21.15.193:0/1550679815 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 -- 172.21.15.193:0/1550679815 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef329cda0 con 0x556ef3418fa0 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 --2- 172.21.15.193:0/1550679815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f637400b270 tx=0x7f637400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4ce61c31fc2dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6271e0b640 1 -- 172.21.15.193:0/1550679815 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637400e5d0 con 0x556ef3418fa0 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6271e0b640 1 -- 172.21.15.193:0/1550679815 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637400e770 con 0x556ef3418fa0 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6271e0b640 1 -- 172.21.15.193:0/1550679815 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637400ea70 con 0x556ef3418fa0 2024-09-12T17:13:17.307 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- 172.21.15.193:0/1550679815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 msgr2=0x556ef338fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 --2- 172.21.15.193:0/1550679815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f637400b270 tx=0x7f637400b670 comp rx=0 tx=0).stop 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- 172.21.15.193:0/1550679815 shutdown_connections 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 --2- 172.21.15.193:0/1550679815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef338fa00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- 172.21.15.193:0/1550679815 >> 172.21.15.193:0/1550679815 conn(0x556ef3414ac0 msgr2=0x556ef35003d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- 172.21.15.193:0/1550679815 shutdown_connections 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- 172.21.15.193:0/1550679815 wait complete. 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.308 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f63862789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ef32c3a50 con 0x556ef3418fa0 2024-09-12T17:13:17.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45530/0 (socket says 172.21.15.193:45530) 2024-09-12T17:13:17.309 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 -- 172.21.15.193:0/4177225637 learned_addr learned my addr 172.21.15.193:0/4177225637 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.301+0000 7f6383d7e640 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef350e5a0 con 0x556ef3418fa0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f6383d7e640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x556ef338f5e0 tx=0x7f6374000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 -- 172.21.15.193:0/4177225637 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637400be70 con 0x556ef3418fa0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 -- 172.21.15.193:0/4177225637 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637400f9f0 con 0x556ef3418fa0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ef350e830 con 0x556ef3418fa0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 -- 172.21.15.193:0/4177225637 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f637400fd10 con 0x556ef3418fa0 2024-09-12T17:13:17.312 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef350f140 con 0x556ef3418fa0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 -- 172.21.15.193:0/4177225637 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6374017070 con 0x556ef3418fa0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 0x7f626c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f626bfff640 1 -- 172.21.15.193:0/4177225637 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6374015020 con 0x556ef3418fa0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638357d640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 0x7f626c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 0x556ef3515110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3515650 con 0x556ef341d140 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 0x556ef3515110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638357d640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 0x7f626c03bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63780ad000 tx=0x7f63780a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 0x556ef3515110 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 -- 172.21.15.193:0/4177225637 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f637c00a4d0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3515a50 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 -- 172.21.15.193:0/4177225637 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f637c00a4d0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3517350 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 -- 172.21.15.193:0/4177225637 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f637c00a4d0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3516580 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f638457f640 1 -- 172.21.15.193:0/4177225637 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f637c00a4d0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.305+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef35169a0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638457f640 1 -- 172.21.15.193:0/4177225637 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f637c00a4d0 con 0x556ef341d140 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ef332e450 con 0x556ef35256b0 2024-09-12T17:13:17.324 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45538/0 (socket says 172.21.15.193:45538) 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638357d640 1 -- 172.21.15.193:0/32382707 learned_addr learned my addr 172.21.15.193:0/32382707 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638357d640 1 -- 172.21.15.193:0/32382707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef3526110 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638357d640 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f63780ab040 tx=0x7f6378018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 -- 172.21.15.193:0/32382707 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780b3ba0 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 -- 172.21.15.193:0/32382707 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780b3d40 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ef3526970 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 -- 172.21.15.193:0/32382707 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780c8580 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef3526e80 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 -- 172.21.15.193:0/32382707 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f63780d1440 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 0x7f625c03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f62697fa640 1 -- 172.21.15.193:0/32382707 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f63780edce0 con 0x556ef35256b0 2024-09-12T17:13:17.325 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.309+0000 7f638457f640 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 0x7f625c03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638457f640 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 0x7f625c03bf20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x556ef3516920 tx=0x7f637c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ef3390230 con 0x556ef3531ef0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45546/0 (socket says 172.21.15.193:45546) 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 -- 172.21.15.193:0/381839449 learned_addr learned my addr 172.21.15.193:0/381839449 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 -- 172.21.15.193:0/381839449 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef35328a0 con 0x556ef3531ef0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 --2- 172.21.15.193:0/381839449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f63780c76f0 tx=0x7f63780c7490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8de47422eba6b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f6262ffd640 1 -- 172.21.15.193:0/381839449 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780bc3b0 con 0x556ef3531ef0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f6262ffd640 1 -- 172.21.15.193:0/381839449 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780ed030 con 0x556ef3531ef0 2024-09-12T17:13:17.326 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f6262ffd640 1 -- 172.21.15.193:0/381839449 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780bcca0 con 0x556ef3531ef0 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- 172.21.15.193:0/381839449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 msgr2=0x556ef35322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 --2- 172.21.15.193:0/381839449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f63780c76f0 tx=0x7f63780c7490 comp rx=0 tx=0).stop 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- 172.21.15.193:0/381839449 shutdown_connections 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 --2- 172.21.15.193:0/381839449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35322d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- 172.21.15.193:0/381839449 >> 172.21.15.193:0/381839449 conn(0x556ef352e320 msgr2=0x556ef352c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- 172.21.15.193:0/381839449 shutdown_connections 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- 172.21.15.193:0/381839449 wait complete. 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 Processor -- start 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- start start 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f63862789c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x556ef3532f00 con 0x556ef3531ef0 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.327 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45550/0 (socket says 172.21.15.193:45550) 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 learned_addr learned my addr 172.21.15.193:0/237065770 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.313+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef3539a20 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f638357d640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f63780c74d0 tx=0x7f63780ebfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 -- 172.21.15.193:0/237065770 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780bfc30 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ef3539cb0 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef353a660 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 -- 172.21.15.193:0/237065770 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780a8a60 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 -- 172.21.15.193:0/237065770 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63780a8d40 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 -- 172.21.15.193:0/237065770 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f63780f4020 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624c039a70 0x7f624c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f62617fa640 1 -- 172.21.15.193:0/237065770 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f63780f2020 con 0x556ef3531ef0 2024-09-12T17:13:17.328 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f638457f640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624c039a70 0x7f624c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef3544780 0x556ef3546c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3547360 con 0x556ef3544780 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef3544780 0x556ef3546c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f638457f640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624c039a70 0x7f624c03bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x556ef35160a0 tx=0x7f637c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef3544780 0x556ef3546c10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 realm 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3547770 con 0x556ef3544780 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:17.329 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3548040 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef35483e0 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3548c30 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 20 searching for the correct realm 2024-09-12T17:13:17.330 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ef354a9a0 0x556ef354cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.317+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638357d640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ef354a9a0 0x556ef354cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638357d640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ef354a9a0 0x556ef354cd90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638357d640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6378009040 0x7f63780cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.331 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638457f640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6378009040 0x7f63780cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638457f640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6378009040 0x7f63780cbab0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638457f640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f637c031040 0x7f637c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f637c031040 0x7f637c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f637c031040 0x7f637c032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.340 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.321+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.342 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.325+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.344 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef354a9a0 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.329+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f637c031040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x556ef3544780 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d2d0 con 0x7f6378009040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f637c01f070 con 0x7f6378009040 2024-09-12T17:13:17.345 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3549580 con 0x556ef3544780 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3549e20 con 0x556ef3544780 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d670 con 0x556ef3544780 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 zone default found 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 4 Realm: () 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:17.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 zonegroup default 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef354d6e0 con 0x7f637c031040 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef354f510 con 0x556ef354a9a0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef354f980 con 0x556ef354a9a0 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 started sync module instance, tier type = 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.333+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef354e9b0 con 0x7f6378009040 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93935017192864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef354e610 con 0x7f6378009040 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef35508b0 con 0x556ef3544780 2024-09-12T17:13:17.349 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93935017192864] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93935017197024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef35508b0 con 0x556ef3544780 2024-09-12T17:13:17.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.337+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3551270 con 0x556ef354a9a0 2024-09-12T17:13:17.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93935017201088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3551ac0 con 0x556ef354a9a0 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef35524c0 con 0x7f6378009040 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93935017197024] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93935017198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef35528b0 con 0x7f6378009040 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3553270 con 0x556ef3544780 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93935017201088] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93935017198592] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93935017205712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3552dc0 con 0x556ef3544780 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.341+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3553610 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.345+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93935017205712] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.345+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.345+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93935017209280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3553a00 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.345+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3554250 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.345+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93935017209280] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.354 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93935017210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3553eb0 con 0x7f637c031040 2024-09-12T17:13:17.355 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3554930 con 0x7f637c031040 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93935017210336] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93935017215008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3554b10 con 0x7f637c031040 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=0 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=1 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=2 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=3 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=4 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=5 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.349+0000 7f63862789c0 20 add_watcher() i=6 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93935017215008] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.356 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 add_watcher() i=7 2024-09-12T17:13:17.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:17.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef3557ee0 con 0x556ef3544780 2024-09-12T17:13:17.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.357 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93935017216512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef35552d0 con 0x556ef3544780 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93935017216512] v34'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f6239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 5 note: GC not initialized 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f6238fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:17.358 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 Filter name: none 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f61b27fc640 20 reqs_thread_entry: start 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.353+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef357afd0 con 0x7f637c031040 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.359 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:13:17.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:17.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:17.360 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3581850 con 0x7f637c031040 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f637402e070 con 0x7f637c031040 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93935017399040 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556ef357cfa0 con 0x556ef3544780 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 93935017205712 notify 146028888116 ret 0) ==== 721+0+0 (crc 0 0 0) 0x556ef350f140 con 0x556ef3544780 2024-09-12T17:13:17.362 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6262ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888116 cookie 93935017205712 notifier 4888 bl.length()=679 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6262ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6262ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6262ffd640 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6248003eb0 con 0x556ef3544780 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 93935017399040 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637402e070 con 0x556ef3544780 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.357+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 93935017399040 notify 146028888116 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f637405b020 con 0x556ef3544780 2024-09-12T17:13:17.363 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f6239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93935017216512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x556ef3544780 2024-09-12T17:13:17.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93935017216512] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f637405d040 con 0x556ef3544780 2024-09-12T17:13:17.364 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93935017192864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x7f6378009040 2024-09-12T17:13:17.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93935017192864] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f63862789c0 20 remove_watcher() i=0 2024-09-12T17:13:17.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f63862789c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.365 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.361+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93935017197024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x556ef3544780 2024-09-12T17:13:17.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93935017197024] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637405d040 con 0x556ef3544780 2024-09-12T17:13:17.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f63862789c0 20 remove_watcher() i=1 2024-09-12T17:13:17.367 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93935017201088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x556ef354a9a0 2024-09-12T17:13:17.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f638357d640 1 -- 172.21.15.193:0/237065770 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93935017201088] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63780ce020 con 0x556ef354a9a0 2024-09-12T17:13:17.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f63862789c0 20 remove_watcher() i=2 2024-09-12T17:13:17.369 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.365+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93935017198592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x7f6378009040 2024-09-12T17:13:17.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f638457f640 1 -- 172.21.15.193:0/237065770 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93935017198592] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637c040040 con 0x7f6378009040 2024-09-12T17:13:17.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f63862789c0 20 remove_watcher() i=3 2024-09-12T17:13:17.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93935017205712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x556ef3544780 2024-09-12T17:13:17.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93935017205712] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637405d040 con 0x556ef3544780 2024-09-12T17:13:17.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f63862789c0 20 remove_watcher() i=4 2024-09-12T17:13:17.372 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.369+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93935017209280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x7f637c031040 2024-09-12T17:13:17.374 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93935017209280] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637405d040 con 0x7f637c031040 2024-09-12T17:13:17.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f63862789c0 20 remove_watcher() i=5 2024-09-12T17:13:17.375 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93935017210336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x7f637c031040 2024-09-12T17:13:17.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93935017210336] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637405d040 con 0x7f637c031040 2024-09-12T17:13:17.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f63862789c0 20 remove_watcher() i=6 2024-09-12T17:13:17.377 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.373+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93935017215008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556ef3578db0 con 0x7f637c031040 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93935017215008] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f637405d040 con 0x7f637c031040 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 20 remove_watcher() i=7 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f637c031040 msgr2=0x7f637c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f637c031040 0x7f637c032940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef3544780 msgr2=0x556ef3546c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef3544780 0x556ef3546c10 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6378009040 msgr2=0x7f63780cbab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.381 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6378009040 0x7f63780cbab0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ef354a9a0 msgr2=0x556ef354cd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x556ef354a9a0 0x556ef354cd90 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624c039a70 msgr2=0x7f624c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624c039a70 0x7f624c03bf30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x556ef35160a0 tx=0x7f637c01f000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 msgr2=0x556ef35394c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f63780c74d0 tx=0x7f63780ebfd0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f6383d7e640 1 -- 172.21.15.193:0/237065770 reap_dead start 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 shutdown_connections 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/237065770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3531ef0 0x556ef35394c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 >> 172.21.15.193:0/237065770 conn(0x556ef352e320 msgr2=0x556ef352c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 shutdown_connections 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/237065770 wait complete. 2024-09-12T17:13:17.382 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 msgr2=0x7f625c03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 0x7f625c03bf20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x556ef3516920 tx=0x7f637c005850 comp rx=0 tx=0).stop 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 msgr2=0x556ef3525ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f63780ab040 tx=0x7f6378018170 comp rx=0 tx=0).stop 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 shutdown_connections 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f625c039a60 0x7f625c03bf20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/32382707 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef35256b0 0x556ef3525ad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 >> 172.21.15.193:0/32382707 conn(0x556ef351b060 msgr2=0x556ef351b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 shutdown_connections 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/32382707 wait complete. 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 msgr2=0x556ef3515110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 0x556ef3515110 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 msgr2=0x7f626c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.383 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 0x7f626c03bf30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f63780ad000 tx=0x7f63780a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 msgr2=0x556ef350e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x556ef338f5e0 tx=0x7f6374000ee0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 shutdown_connections 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x556ef341d140 0x556ef3515110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f626c039a70 0x7f626c03bf30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 --2- 172.21.15.193:0/4177225637 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x556ef3418fa0 0x556ef350e040 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 >> 172.21.15.193:0/4177225637 conn(0x556ef3414ac0 msgr2=0x556ef338e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 shutdown_connections 2024-09-12T17:13:17.384 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.377+0000 7f63862789c0 1 -- 172.21.15.193:0/4177225637 wait complete. 2024-09-12T17:13:17.389 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.390 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.390 ERROR:root:0 2024-09-12T17:13:17.390 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:17.394 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:17.394 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T17:13:17.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-12T17:13:17.395 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-12T17:13:17.458 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.458 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aad4c59c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559ec949e0c0 0x559ec94a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aad4c59c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ec934e9c0 con 0x559ec9499f70 2024-09-12T17:13:17.459 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aad4c59c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x559ec939e6d0 con 0x559ec949e0c0 2024-09-12T17:13:17.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aaa7ca640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559ec949e0c0 0x559ec94a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aaa7ca640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x559ec949e0c0 0x559ec94a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45554/0 (socket says 172.21.15.193:45554) 2024-09-12T17:13:17.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/1879948204 learned_addr learned my addr 172.21.15.193:0/1879948204 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/1879948204 >> v1:172.21.15.62:6789/0 conn(0x559ec9499f70 legacy=0x559ec949a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.460 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.457+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/1879948204 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec9342ca0 con 0x559ec949e0c0 2024-09-12T17:13:17.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/1879948204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec949e0c0 0x559ec94a04b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00a4e0 tx=0x7f9a9c01b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa04d4c9be4cb2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aa9fc9640 1 -- 172.21.15.193:0/1879948204 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0aa540 con 0x559ec949e0c0 2024-09-12T17:13:17.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aa9fc9640 1 -- 172.21.15.193:0/1879948204 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0aa6e0 con 0x559ec949e0c0 2024-09-12T17:13:17.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aa9fc9640 1 -- 172.21.15.193:0/1879948204 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0aaa40 con 0x559ec949e0c0 2024-09-12T17:13:17.463 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1879948204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec949e0c0 msgr2=0x559ec94a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/1879948204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec949e0c0 0x559ec94a04b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00a4e0 tx=0x7f9a9c01b120 comp rx=0 tx=0).stop 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1879948204 shutdown_connections 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/1879948204 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec949e0c0 0x559ec94a04b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1879948204 >> 172.21.15.193:0/1879948204 conn(0x559ec9495a90 msgr2=0x559ec9497eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1879948204 shutdown_connections 2024-09-12T17:13:17.464 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.461+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1879948204 wait complete. 2024-09-12T17:13:17.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aad4c59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.476 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aad4c59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ec93a2680 con 0x559ec9499f70 2024-09-12T17:13:17.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aaafcb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aaafcb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45566/0 (socket says 172.21.15.193:45566) 2024-09-12T17:13:17.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aaafcb640 1 -- 172.21.15.193:0/1273342170 learned_addr learned my addr 172.21.15.193:0/1273342170 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aaafcb640 1 -- 172.21.15.193:0/1273342170 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec931dda0 con 0x559ec9499f70 2024-09-12T17:13:17.477 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/1273342170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b220 tx=0x7f9aa400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8edb28fb7186a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9998e09640 1 -- 172.21.15.193:0/1273342170 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa400a040 con 0x559ec9499f70 2024-09-12T17:13:17.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9998e09640 1 -- 172.21.15.193:0/1273342170 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa400f750 con 0x559ec9499f70 2024-09-12T17:13:17.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.473+0000 7f9998e09640 1 -- 172.21.15.193:0/1273342170 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa400fa70 con 0x559ec9499f70 2024-09-12T17:13:17.479 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1273342170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 msgr2=0x559ec9585750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/1273342170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b220 tx=0x7f9aa400b6e0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1273342170 shutdown_connections 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/1273342170 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec9585750 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1273342170 >> 172.21.15.193:0/1273342170 conn(0x559ec9495a90 msgr2=0x559ec9581390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1273342170 shutdown_connections 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/1273342170 wait complete. 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ec9344a50 con 0x559ec9499f70 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaafcb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaafcb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45568/0 (socket says 172.21.15.193:45568) 2024-09-12T17:13:17.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaafcb640 1 -- 172.21.15.193:0/249456280 learned_addr learned my addr 172.21.15.193:0/249456280 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaafcb640 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec958d380 con 0x559ec9499f70 2024-09-12T17:13:17.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559ec95866e0 tx=0x7f9aa4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.481 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 -- 172.21.15.193:0/249456280 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa401a880 con 0x559ec9499f70 2024-09-12T17:13:17.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec958d610 con 0x559ec9499f70 2024-09-12T17:13:17.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec958dfc0 con 0x559ec9499f70 2024-09-12T17:13:17.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 -- 172.21.15.193:0/249456280 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa401aa20 con 0x559ec9499f70 2024-09-12T17:13:17.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 -- 172.21.15.193:0/249456280 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9aa402c060 con 0x559ec9499f70 2024-09-12T17:13:17.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 -- 172.21.15.193:0/249456280 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9aa4017050 con 0x559ec9499f70 2024-09-12T17:13:17.483 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 0x7f999003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9997606640 1 -- 172.21.15.193:0/249456280 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9aa4015020 con 0x559ec9499f70 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 0x7f999003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 0x559ec9593f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.477+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95944d0 con 0x559ec949e0c0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 0x559ec9593f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 0x7f999003bf80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0ab000 tx=0x7f9a9c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 0x559ec9593f90 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 -- 172.21.15.193:0/249456280 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa00083f0 con 0x559ec949e0c0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95948b0 con 0x559ec949e0c0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 -- 172.21.15.193:0/249456280 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9aa00083f0 con 0x559ec949e0c0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec9596180 con 0x559ec949e0c0 2024-09-12T17:13:17.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 -- 172.21.15.193:0/249456280 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9aa00083f0 con 0x559ec949e0c0 2024-09-12T17:13:17.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95953b0 con 0x559ec949e0c0 2024-09-12T17:13:17.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 -- 172.21.15.193:0/249456280 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9aa00083f0 con 0x559ec949e0c0 2024-09-12T17:13:17.485 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95957d0 con 0x559ec949e0c0 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aab7cc640 1 -- 172.21.15.193:0/249456280 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9aa00083f0 con 0x559ec949e0c0 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ec93af450 con 0x559ec95a4500 2024-09-12T17:13:17.486 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45582/0 (socket says 172.21.15.193:45582) 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/764099224 learned_addr learned my addr 172.21.15.193:0/764099224 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/764099224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec95a4f60 con 0x559ec95a4500 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c01b160 tx=0x7f9a9c017ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9994e01640 1 -- 172.21.15.193:0/764099224 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0c2070 con 0x559ec95a4500 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec95a57c0 con 0x559ec95a4500 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9994e01640 1 -- 172.21.15.193:0/764099224 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0be410 con 0x559ec95a4500 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9994e01640 1 -- 172.21.15.193:0/764099224 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0b9040 con 0x559ec95a4500 2024-09-12T17:13:17.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.481+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec95a5cd0 con 0x559ec95a4500 2024-09-12T17:13:17.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9994e01640 1 -- 172.21.15.193:0/764099224 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9a9c0c5070 con 0x559ec95a4500 2024-09-12T17:13:17.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9994e01640 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 0x7f998403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9994e01640 1 -- 172.21.15.193:0/764099224 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9a9c0ed000 con 0x559ec95a4500 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 0x7f998403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 0x7f998403bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x559ec9595750 tx=0x7f9aa0003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ec9585fa0 con 0x559ec95b1df0 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45594/0 (socket says 172.21.15.193:45594) 2024-09-12T17:13:17.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/3829911769 learned_addr learned my addr 172.21.15.193:0/3829911769 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/3829911769 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec95b27c0 con 0x559ec95b1df0 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/3829911769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0bdd40 tx=0x7f9a9c0c59a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63ef09be3552fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f998e7fc640 1 -- 172.21.15.193:0/3829911769 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0c7580 con 0x559ec95b1df0 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f998e7fc640 1 -- 172.21.15.193:0/3829911769 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0d6070 con 0x559ec95b1df0 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f998e7fc640 1 -- 172.21.15.193:0/3829911769 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0cfb90 con 0x559ec95b1df0 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/3829911769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 msgr2=0x559ec95b21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/3829911769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0bdd40 tx=0x7f9a9c0c59a0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/3829911769 shutdown_connections 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/3829911769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b21d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.485+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/3829911769 >> 172.21.15.193:0/3829911769 conn(0x559ec95ad1b0 msgr2=0x559ec95ab3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/3829911769 shutdown_connections 2024-09-12T17:13:17.491 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/3829911769 wait complete. 2024-09-12T17:13:17.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 Processor -- start 2024-09-12T17:13:17.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- start start 2024-09-12T17:13:17.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.492 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559ec95b0ce0 con 0x559ec95b1df0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aaa7ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45596/0 (socket says 172.21.15.193:45596) 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 learned_addr learned my addr 172.21.15.193:0/368021535 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec95b8800 con 0x559ec95b1df0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b82a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0bdd40 tx=0x7f9a9c0eb2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f998cff9640 1 -- 172.21.15.193:0/368021535 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0cf6b0 con 0x559ec95b1df0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ec95b8a90 con 0x559ec95b1df0 2024-09-12T17:13:17.493 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f998cff9640 1 -- 172.21.15.193:0/368021535 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a9c0d6040 con 0x559ec95b1df0 2024-09-12T17:13:17.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f998cff9640 1 -- 172.21.15.193:0/368021535 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a9c0be760 con 0x559ec95b1df0 2024-09-12T17:13:17.494 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec95b9440 con 0x559ec95b1df0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f998cff9640 1 -- 172.21.15.193:0/368021535 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f9a9c0b3040 con 0x559ec95b1df0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.489+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f998cff9640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9974039a20 0x7f997403bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f998cff9640 1 -- 172.21.15.193:0/368021535 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f9a9c0e5070 con 0x559ec95b1df0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9974039a20 0x7f997403bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec95c3600 0x559ec95c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c61e0 con 0x559ec95c3600 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec95c3600 0x559ec95c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.495 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9974039a20 0x7f997403bee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000f010 tx=0x7f9aa001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.496 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec95c3600 0x559ec95c5a90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 realm 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c6640 con 0x559ec95c3600 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c6f10 con 0x559ec95c3600 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.499 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c72b0 con 0x559ec95c3600 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c7b00 con 0x559ec95c3600 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 20 searching for the correct realm 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559ec95c9870 0x559ec95cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559ec95c9870 0x559ec95cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.500 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559ec95c9870 0x559ec95cbc60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaa7ca640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9a9c0c7070 0x7f9a9c0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9a9c0c7070 0x7f9a9c0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9a9c0c7070 0x7f9a9c0c9a30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa0019040 0x7f9aa0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.493+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa0019040 0x7f9aa0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.501 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa0019040 0x7f9aa0019930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.505 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.497+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.506 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.501+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.512 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c9870 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9aa0019040 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x559ec95c3600 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc1a0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.513 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c83e0 con 0x559ec95c3600 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c8c80 con 0x559ec95c3600 2024-09-12T17:13:17.514 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c8c80 con 0x559ec95c3600 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 zone default found 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 4 Realm: () 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 zonegroup default 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.515 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.505+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cc5d0 con 0x7f9aa0019040 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95ce0c0 con 0x559ec95c9870 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95ce4e0 con 0x559ec95c9870 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 started sync module instance, tier type = 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:17.516 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95c8890 con 0x7f9a9c0c7070 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94140471498000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95ce940 con 0x7f9a9c0c7070 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cf3c0 con 0x559ec95c3600 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.509+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94140471498000] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.518 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94140471499248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cf380 con 0x559ec95c3600 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cfe00 con 0x559ec95c9870 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94140471507280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d06a0 con 0x559ec95c9870 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d1060 con 0x7f9a9c0c7070 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94140471499248] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94140471511984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d0fd0 con 0x7f9a9c0c7070 2024-09-12T17:13:17.519 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.513+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d1e10 con 0x559ec95c3600 2024-09-12T17:13:17.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94140471507280] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94140471511984] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94140471509488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d1dd0 con 0x559ec95c3600 2024-09-12T17:13:17.520 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d2240 con 0x7f9aa0019040 2024-09-12T17:13:17.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.517+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94140471509488] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94140471517584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d1900 con 0x7f9aa0019040 2024-09-12T17:13:17.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d2c50 con 0x7f9aa0019040 2024-09-12T17:13:17.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94140471517584] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94140471514464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d2c50 con 0x7f9aa0019040 2024-09-12T17:13:17.525 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.521+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d3500 con 0x7f9aa0019040 2024-09-12T17:13:17.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94140471514464] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94140471519136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d36e0 con 0x7f9aa0019040 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=0 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=1 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=2 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=3 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=4 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=5 2024-09-12T17:13:17.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=6 2024-09-12T17:13:17.529 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94140471519136] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 20 add_watcher() i=7 2024-09-12T17:13:17.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:17.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d6ab0 con 0x559ec95c3600 2024-09-12T17:13:17.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.530 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.525+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94140471522768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d3ea0 con 0x559ec95c3600 2024-09-12T17:13:17.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94140471522768] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.531 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 5 note: GC not initialized 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9960fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 Filter name: none 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9959ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.532 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95f9b30 con 0x7f9aa0019040 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 20 rados_obj.operate() r=0 bl.length=503 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:17.533 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.529+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec9600420 con 0x7f9aa0019040 2024-09-12T17:13:17.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.535 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94140471705296 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559ec95fbbd0 con 0x559ec95c3600 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94140471509488 notify 146028888117 ret 0) ==== 678+0+0 (crc 0 0 0) 0x559ec958dfc0 con 0x559ec95c3600 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f998e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888117 cookie 94140471509488 notifier 4895 bl.length()=636 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f998e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f998e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94140471705296 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f998e7fc640 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f9970003eb0 con 0x559ec95c3600 2024-09-12T17:13:17.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.537 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94140471705296 notify 146028888117 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559ec958d610 con 0x559ec95c3600 2024-09-12T17:13:17.537 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9961fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94140471522768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95f7920 con 0x559ec95c3600 2024-09-12T17:13:17.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94140471522768] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.533+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94140471498000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95f7920 con 0x7f9a9c0c7070 2024-09-12T17:13:17.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94140471498000] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aad4c59c0 20 remove_watcher() i=0 2024-09-12T17:13:17.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aad4c59c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.539 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94140471499248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95f7920 con 0x559ec95c3600 2024-09-12T17:13:17.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94140471499248] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aad4c59c0 20 remove_watcher() i=1 2024-09-12T17:13:17.541 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.537+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94140471507280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95f7920 con 0x559ec95c9870 2024-09-12T17:13:17.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aaa7ca640 1 -- 172.21.15.193:0/368021535 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94140471507280] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a9c0ce070 con 0x559ec95c9870 2024-09-12T17:13:17.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 20 remove_watcher() i=2 2024-09-12T17:13:17.543 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94140471511984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cf950 con 0x7f9a9c0c7070 2024-09-12T17:13:17.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aab7cc640 1 -- 172.21.15.193:0/368021535 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94140471511984] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa002f040 con 0x7f9a9c0c7070 2024-09-12T17:13:17.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 20 remove_watcher() i=3 2024-09-12T17:13:17.544 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94140471509488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d0bb0 con 0x559ec95c3600 2024-09-12T17:13:17.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94140471509488] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x559ec95c3600 2024-09-12T17:13:17.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 20 remove_watcher() i=4 2024-09-12T17:13:17.546 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.541+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94140471517584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cf950 con 0x7f9aa0019040 2024-09-12T17:13:17.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94140471517584] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aad4c59c0 20 remove_watcher() i=5 2024-09-12T17:13:17.548 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94140471514464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95d0bb0 con 0x7f9aa0019040 2024-09-12T17:13:17.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94140471514464] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aad4c59c0 20 remove_watcher() i=6 2024-09-12T17:13:17.550 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.545+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94140471519136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559ec95cf950 con 0x7f9aa0019040 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94140471519136] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9aa402e070 con 0x7f9aa0019040 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 20 remove_watcher() i=7 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa0019040 msgr2=0x7f9aa0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f9aa0019040 0x7f9aa0019930 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec95c3600 msgr2=0x559ec95c5a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.554 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec95c3600 0x559ec95c5a90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9a9c0c7070 msgr2=0x7f9a9c0c9a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f9a9c0c7070 0x7f9a9c0c9a30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559ec95c9870 msgr2=0x559ec95cbc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x559ec95c9870 0x559ec95cbc60 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9974039a20 msgr2=0x7f997403bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9974039a20 0x7f997403bee0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000f010 tx=0x7f9aa001b070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 msgr2=0x559ec95b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/368021535 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95b1df0 0x559ec95b82a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0bdd40 tx=0x7f9a9c0eb2f0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aaafcb640 1 -- 172.21.15.193:0/368021535 reap_dead start 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 shutdown_connections 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 >> 172.21.15.193:0/368021535 conn(0x559ec95ad1b0 msgr2=0x559ec95ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 shutdown_connections 2024-09-12T17:13:17.555 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/368021535 wait complete. 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 msgr2=0x7f998403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 0x7f998403bf30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x559ec9595750 tx=0x7f9aa0003070 comp rx=0 tx=0).stop 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 msgr2=0x559ec95a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c01b160 tx=0x7f9a9c017ec0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 shutdown_connections 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9984039a70 0x7f998403bf30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/764099224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec95a4500 0x559ec95a4920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 >> 172.21.15.193:0/764099224 conn(0x559ec9599eb0 msgr2=0x559ec959a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 shutdown_connections 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/764099224 wait complete. 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 msgr2=0x559ec9593f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.556 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 0x559ec9593f90 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 msgr2=0x7f999003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 0x7f999003bf80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0ab000 tx=0x7f9a9c0a5000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 msgr2=0x559ec958ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x559ec95866e0 tx=0x7f9aa4000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 shutdown_connections 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x559ec949e0c0 0x559ec9593f90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f9990039ac0 0x7f999003bf80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 --2- 172.21.15.193:0/249456280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559ec9499f70 0x559ec958ce20 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 >> 172.21.15.193:0/249456280 conn(0x559ec9495a90 msgr2=0x559ec957fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 shutdown_connections 2024-09-12T17:13:17.557 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.549+0000 7f9aad4c59c0 1 -- 172.21.15.193:0/249456280 wait complete. 2024-09-12T17:13:17.562 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.563 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.563 ERROR:root:0 2024-09-12T17:13:17.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:13:17.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:13:17.563 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-12T17:13:17.637 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.637 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.633+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.633+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.633+0000 7fe424d609c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558a02941340 0x558a02943730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.633+0000 7fe424d609c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558a027ef9c0 con 0x558a0293d1f0 2024-09-12T17:13:17.638 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.633+0000 7fe424d609c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x558a0283f6d0 con 0x558a02941340 2024-09-12T17:13:17.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558a02941340 0x558a02943730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x558a02941340 0x558a02943730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45612/0 (socket says 172.21.15.193:45612) 2024-09-12T17:13:17.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 -- 172.21.15.193:0/60535907 learned_addr learned my addr 172.21.15.193:0/60535907 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 -- 172.21.15.193:0/60535907 >> v1:172.21.15.62:6789/0 conn(0x558a0293d1f0 legacy=0x558a0293d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.639 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 -- 172.21.15.193:0/60535907 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a027e3ca0 con 0x558a02941340 2024-09-12T17:13:17.641 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe422065640 1 --2- 172.21.15.193:0/60535907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02941340 0x558a02943730 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe41800a5c0 tx=0x7fe41801b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6e2e578393f179 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe421864640 1 -- 172.21.15.193:0/60535907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180a9590 con 0x558a02941340 2024-09-12T17:13:17.642 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe421864640 1 -- 172.21.15.193:0/60535907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180ae070 con 0x558a02941340 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe421864640 1 -- 172.21.15.193:0/60535907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180a9880 con 0x558a02941340 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe424d609c0 1 -- 172.21.15.193:0/60535907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02941340 msgr2=0x558a02943730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe424d609c0 1 --2- 172.21.15.193:0/60535907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02941340 0x558a02943730 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe41800a5c0 tx=0x7fe41801b3d0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe424d609c0 1 -- 172.21.15.193:0/60535907 shutdown_connections 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.637+0000 7fe424d609c0 1 --2- 172.21.15.193:0/60535907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02941340 0x558a02943730 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.641+0000 7fe424d609c0 1 -- 172.21.15.193:0/60535907 >> 172.21.15.193:0/60535907 conn(0x558a028b0b00 msgr2=0x558a028b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.641+0000 7fe424d609c0 1 -- 172.21.15.193:0/60535907 shutdown_connections 2024-09-12T17:13:17.643 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.641+0000 7fe424d609c0 1 -- 172.21.15.193:0/60535907 wait complete. 2024-09-12T17:13:17.655 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a02843680 con 0x558a0293d1f0 2024-09-12T17:13:17.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe422866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.656 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe422866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45620/0 (socket says 172.21.15.193:45620) 2024-09-12T17:13:17.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe422866640 1 -- 172.21.15.193:0/4202733620 learned_addr learned my addr 172.21.15.193:0/4202733620 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe422866640 1 -- 172.21.15.193:0/4202733620 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a027beda0 con 0x558a0293d1f0 2024-09-12T17:13:17.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe422866640 1 --2- 172.21.15.193:0/4202733620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b220 tx=0x7fe41400b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bd8f64672eab3d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe310e09640 1 -- 172.21.15.193:0/4202733620 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41400a040 con 0x558a0293d1f0 2024-09-12T17:13:17.657 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe310e09640 1 -- 172.21.15.193:0/4202733620 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41400f750 con 0x558a0293d1f0 2024-09-12T17:13:17.658 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe310e09640 1 -- 172.21.15.193:0/4202733620 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41400fa70 con 0x558a0293d1f0 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- 172.21.15.193:0/4202733620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 msgr2=0x558a02a288f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4202733620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe41400b220 tx=0x7fe41400b6e0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- 172.21.15.193:0/4202733620 shutdown_connections 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4202733620 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a288f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- 172.21.15.193:0/4202733620 >> 172.21.15.193:0/4202733620 conn(0x558a028b0b00 msgr2=0x558a02a24530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- 172.21.15.193:0/4202733620 shutdown_connections 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.653+0000 7fe424d609c0 1 -- 172.21.15.193:0/4202733620 wait complete. 2024-09-12T17:13:17.659 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a027e5a50 con 0x558a0293d1f0 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45636/0 (socket says 172.21.15.193:45636) 2024-09-12T17:13:17.660 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422866640 1 -- 172.21.15.193:0/4027188244 learned_addr learned my addr 172.21.15.193:0/4027188244 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422866640 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a02a30520 con 0x558a0293d1f0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422866640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x558a02a29880 tx=0x7fe414000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 -- 172.21.15.193:0/4027188244 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41401a880 con 0x558a0293d1f0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a02a307b0 con 0x558a0293d1f0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 -- 172.21.15.193:0/4027188244 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe41401aa20 con 0x558a0293d1f0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 -- 172.21.15.193:0/4027188244 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe41401ad00 con 0x558a0293d1f0 2024-09-12T17:13:17.661 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a02a31160 con 0x558a0293d1f0 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 -- 172.21.15.193:0/4027188244 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe414017050 con 0x558a0293d1f0 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 0x7fe30803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe30f606640 1 -- 172.21.15.193:0/4027188244 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe414015020 con 0x558a0293d1f0 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe422065640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 0x7fe30803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 0x558a02a37130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a37670 con 0x558a02941340 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.657+0000 7fe423067640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 0x558a02a37130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.663 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 0x7fe30803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ad000 tx=0x7fe4180a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 0x558a02a37130 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 -- 172.21.15.193:0/4027188244 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41c00a4d0 con 0x558a02941340 2024-09-12T17:13:17.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a37a90 con 0x558a02941340 2024-09-12T17:13:17.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 -- 172.21.15.193:0/4027188244 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe41c00a4d0 con 0x558a02941340 2024-09-12T17:13:17.664 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a39390 con 0x558a02941340 2024-09-12T17:13:17.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 -- 172.21.15.193:0/4027188244 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe41c00a4d0 con 0x558a02941340 2024-09-12T17:13:17.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a385c0 con 0x558a02941340 2024-09-12T17:13:17.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 -- 172.21.15.193:0/4027188244 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe41c00a4d0 con 0x558a02941340 2024-09-12T17:13:17.665 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a389e0 con 0x558a02941340 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe423067640 1 -- 172.21.15.193:0/4027188244 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe41c00a4d0 con 0x558a02941340 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a02850450 con 0x558a02a476f0 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45650/0 (socket says 172.21.15.193:45650) 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 -- 172.21.15.193:0/3442045874 learned_addr learned my addr 172.21.15.193:0/3442045874 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.666 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 -- 172.21.15.193:0/3442045874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a02a48150 con 0x558a02a476f0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe422065640 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe418017fe0 tx=0x7fe418018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe30ce01640 1 -- 172.21.15.193:0/3442045874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180b3ba0 con 0x558a02a476f0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a02a489b0 con 0x558a02a476f0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe30ce01640 1 -- 172.21.15.193:0/3442045874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180b3d40 con 0x558a02a476f0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.661+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a02a48ec0 con 0x558a02a476f0 2024-09-12T17:13:17.667 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe30ce01640 1 -- 172.21.15.193:0/3442045874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180c8560 con 0x558a02a476f0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe30ce01640 1 -- 172.21.15.193:0/3442045874 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4180c8700 con 0x558a02a476f0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe30ce01640 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 0x7fe2fc03bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe30ce01640 1 -- 172.21.15.193:0/3442045874 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe4180edf90 con 0x558a02a476f0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe423067640 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 0x7fe2fc03bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe424d609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe424d609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a02a29140 con 0x558a02a53f90 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe423067640 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 0x7fe2fc03bf20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x558a02a38960 tx=0x7fe41c005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.669 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45662/0 (socket says 172.21.15.193:45662) 2024-09-12T17:13:17.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe422065640 1 -- 172.21.15.193:0/2887544076 learned_addr learned my addr 172.21.15.193:0/2887544076 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.670 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe422065640 1 -- 172.21.15.193:0/2887544076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a02a54960 con 0x558a02a53f90 2024-09-12T17:13:17.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe422065640 1 --2- 172.21.15.193:0/2887544076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ec190 tx=0x7fe4180c8e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe95353df16d723 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.671 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe3067fc640 1 -- 172.21.15.193:0/2887544076 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180e5680 con 0x558a02a53f90 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe3067fc640 1 -- 172.21.15.193:0/2887544076 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180be8e0 con 0x558a02a53f90 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.665+0000 7fe3067fc640 1 -- 172.21.15.193:0/2887544076 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180be410 con 0x558a02a53f90 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2887544076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 msgr2=0x558a02a54370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2887544076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ec190 tx=0x7fe4180c8e60 comp rx=0 tx=0).stop 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2887544076 shutdown_connections 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2887544076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a54370 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2887544076 >> 172.21.15.193:0/2887544076 conn(0x558a02a503c0 msgr2=0x558a02a4e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2887544076 shutdown_connections 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2887544076 wait complete. 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 Processor -- start 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- start start 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.672 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x558a02a54fa0 con 0x558a02a53f90 2024-09-12T17:13:17.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422065640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45666/0 (socket says 172.21.15.193:45666) 2024-09-12T17:13:17.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 learned_addr learned my addr 172.21.15.193:0/2882537873 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.673 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a02a5ba30 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422065640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe4180c7fc0 tx=0x7fe4180ea000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 -- 172.21.15.193:0/2882537873 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180c79c0 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558a02a5bcc0 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a02a5bcc0 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 -- 172.21.15.193:0/2882537873 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4180bd7b0 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 -- 172.21.15.193:0/2882537873 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4180bda90 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 -- 172.21.15.193:0/2882537873 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fe4180f8060 con 0x558a02a53f90 2024-09-12T17:13:17.677 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ec039a70 0x7fe2ec03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe304ff9640 1 -- 172.21.15.193:0/2882537873 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fe4180dc0b0 con 0x558a02a53f90 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe423067640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ec039a70 0x7fe2ec03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02a66680 0x558a02a68b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a69260 con 0x558a02a66680 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.669+0000 7fe422866640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02a66680 0x558a02a68b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ec039a70 0x7fe2ec03bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x558a02a380e0 tx=0x7fe41c01f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02a66680 0x558a02a68b10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 realm 2024-09-12T17:13:17.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a69670 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a69f40 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6a2e0 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.679 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6ab30 con 0x558a02a66680 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 20 searching for the correct realm 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558a02a6c8a0 0x558a02a6ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422065640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558a02a6c8a0 0x558a02a6ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422065640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558a02a6c8a0 0x558a02a6ec90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422065640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe418009040 0x7fe4180da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe418009040 0x7fe4180da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.680 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe418009040 0x7fe4180da5b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe41c031040 0x7fe41c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.673+0000 7fe422866640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe41c031040 0x7fe41c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe41c031040 0x7fe41c032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x7fe41c031040 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.685 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x7fe41c031040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x7fe41c031040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x7fe41c031040 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.686 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.677+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x7fe41c031040 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41402e070 con 0x558a02a66680 2024-09-12T17:13:17.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.688 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.681+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.693 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a6c8a0 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe41c031040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x558a02a66680 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f1d0 con 0x7fe418009040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe41c01f070 con 0x7fe418009040 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:17.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6b480 con 0x558a02a66680 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6bd20 con 0x558a02a66680 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6bd20 con 0x558a02a66680 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 zone default found 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 4 Realm: () 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 zonegroup default 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.685+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a6f570 con 0x7fe41c031040 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.696 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a71060 con 0x558a02a6c8a0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a71550 con 0x558a02a6c8a0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 started sync module instance, tier type = 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a70400 con 0x7fe418009040 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94051238348784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a70060 con 0x7fe418009040 2024-09-12T17:13:17.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a72480 con 0x558a02a66680 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94051238348784] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94051238353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a72480 con 0x558a02a66680 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.689+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a72e40 con 0x558a02a6c8a0 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.699 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94051238357392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a73690 con 0x558a02a6c8a0 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a74050 con 0x7fe418009040 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94051238353328] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94051238362016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a73fc0 con 0x7fe418009040 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a74de0 con 0x558a02a66680 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.693+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94051238357392] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94051238362016] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94051238359520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a748f0 con 0x558a02a66680 2024-09-12T17:13:17.700 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a75680 con 0x7fe41c031040 2024-09-12T17:13:17.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94051238359520] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94051238364224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a75360 con 0x7fe41c031040 2024-09-12T17:13:17.701 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.697+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a75bb0 con 0x7fe41c031040 2024-09-12T17:13:17.703 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94051238364224] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94051238367168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a759b0 con 0x7fe41c031040 2024-09-12T17:13:17.704 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a764b0 con 0x7fe41c031040 2024-09-12T17:13:17.705 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94051238367168] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94051238371232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a76470 con 0x7fe41c031040 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=0 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=1 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=2 2024-09-12T17:13:17.706 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=3 2024-09-12T17:13:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=4 2024-09-12T17:13:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=5 2024-09-12T17:13:17.707 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.701+0000 7fe424d609c0 20 add_watcher() i=6 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94051238371232] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 add_watcher() i=7 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a79930 con 0x558a02a66680 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.708 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94051238368288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a76df0 con 0x558a02a66680 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94051238368288] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe2d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 5 note: GC not initialized 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe2d8fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 Filter name: none 2024-09-12T17:13:17.710 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe2d1ffb640 20 reqs_thread_entry: start 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.705+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9cb90 con 0x7fe41c031040 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:13:17.711 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:17.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:17.712 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02aa30c0 con 0x7fe41c031040 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94051238554416 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9e7d0 con 0x558a02a66680 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94051238359520 notify 146028888118 ret 0) ==== 708+0+0 (crc 0 0 0) 0x558a02a31160 con 0x558a02a66680 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe3067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888118 cookie 94051238359520 notifier 4902 bl.length()=666 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe3067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe3067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.714 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94051238554416 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe3067fc640 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe2e8003eb0 con 0x558a02a66680 2024-09-12T17:13:17.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.709+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94051238554416 notify 146028888118 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558a02a307b0 con 0x558a02a66680 2024-09-12T17:13:17.715 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.715 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe2d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94051238368288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9a990 con 0x558a02a66680 2024-09-12T17:13:17.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94051238368288] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.716 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94051238348784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9a990 con 0x7fe418009040 2024-09-12T17:13:17.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94051238348784] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe424d609c0 20 remove_watcher() i=0 2024-09-12T17:13:17.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe424d609c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.717 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.713+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94051238353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9a990 con 0x558a02a66680 2024-09-12T17:13:17.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94051238353328] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.719 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 20 remove_watcher() i=1 2024-09-12T17:13:17.720 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94051238357392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a9a990 con 0x558a02a6c8a0 2024-09-12T17:13:17.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe422065640 1 -- 172.21.15.193:0/2882537873 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94051238357392] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4180ce020 con 0x558a02a6c8a0 2024-09-12T17:13:17.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 20 remove_watcher() i=2 2024-09-12T17:13:17.721 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94051238362016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a719b0 con 0x7fe418009040 2024-09-12T17:13:17.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe423067640 1 -- 172.21.15.193:0/2882537873 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94051238362016] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe41c040040 con 0x7fe418009040 2024-09-12T17:13:17.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 20 remove_watcher() i=3 2024-09-12T17:13:17.722 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.717+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94051238359520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a72990 con 0x558a02a66680 2024-09-12T17:13:17.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94051238359520] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x558a02a66680 2024-09-12T17:13:17.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe424d609c0 20 remove_watcher() i=4 2024-09-12T17:13:17.724 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94051238364224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a73ba0 con 0x7fe41c031040 2024-09-12T17:13:17.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94051238364224] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe424d609c0 20 remove_watcher() i=5 2024-09-12T17:13:17.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.721+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94051238367168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a719b0 con 0x7fe41c031040 2024-09-12T17:13:17.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.725+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94051238367168] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.725+0000 7fe424d609c0 20 remove_watcher() i=6 2024-09-12T17:13:17.728 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.725+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94051238371232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558a02a72990 con 0x7fe41c031040 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94051238371232] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe414058040 con 0x7fe41c031040 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 20 remove_watcher() i=7 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe41c031040 msgr2=0x7fe41c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7fe41c031040 0x7fe41c032940 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02a66680 msgr2=0x558a02a68b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02a66680 0x558a02a68b10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe418009040 msgr2=0x7fe4180da5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7fe418009040 0x7fe4180da5b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558a02a6c8a0 msgr2=0x558a02a6ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x558a02a6c8a0 0x558a02a6ec90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ec039a70 msgr2=0x7fe2ec03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2ec039a70 0x7fe2ec03bf30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x558a02a380e0 tx=0x7fe41c01f000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 msgr2=0x558a02a5b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe4180c7fc0 tx=0x7fe4180ea000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe422866640 1 -- 172.21.15.193:0/2882537873 reap_dead start 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 shutdown_connections 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/2882537873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a53f90 0x558a02a5b4d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 >> 172.21.15.193:0/2882537873 conn(0x558a02a503c0 msgr2=0x558a02a4e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.734 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 shutdown_connections 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/2882537873 wait complete. 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 msgr2=0x7fe2fc03bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 0x7fe2fc03bf20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x558a02a38960 tx=0x7fe41c005850 comp rx=0 tx=0).stop 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 msgr2=0x558a02a47b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe418017fe0 tx=0x7fe418018170 comp rx=0 tx=0).stop 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 shutdown_connections 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe2fc039a60 0x7fe2fc03bf20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/3442045874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a02a476f0 0x558a02a47b10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 >> 172.21.15.193:0/3442045874 conn(0x558a02a3d0a0 msgr2=0x558a02a3d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 shutdown_connections 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/3442045874 wait complete. 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 msgr2=0x558a02a37130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.735 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 0x558a02a37130 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 msgr2=0x7fe30803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 0x7fe30803bf30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe4180ad000 tx=0x7fe4180a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 msgr2=0x558a02a2ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x558a02a29880 tx=0x7fe414000bd0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 shutdown_connections 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x558a02941340 0x558a02a37130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fe308039a70 0x7fe30803bf30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 --2- 172.21.15.193:0/4027188244 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x558a0293d1f0 0x558a02a2ffc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 >> 172.21.15.193:0/4027188244 conn(0x558a028b0b00 msgr2=0x558a02a22fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 shutdown_connections 2024-09-12T17:13:17.736 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.729+0000 7fe424d609c0 1 -- 172.21.15.193:0/4027188244 wait complete. 2024-09-12T17:13:17.741 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.742 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.742 ERROR:root:0 2024-09-12T17:13:17.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:17.746 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000623351532574a7f6-0066e3212d-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:13:17.746 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:13:17.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-12T17:13:17.747 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-12T17:13:17.810 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.811 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32eb1149c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c3d3a1c340 0x55c3d3a1e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32eb1149c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c3d38ca9c0 con 0x55c3d3a181f0 2024-09-12T17:13:17.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32eb1149c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55c3d391a6d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8419640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c3d3a1c340 0x55c3d3a1e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8419640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55c3d3a1c340 0x55c3d3a1e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45678/0 (socket says 172.21.15.193:45678) 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8c1a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55c3d3a181f0 0x55c3d3a185d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:59332/0 (socket says 172.21.15.193:59332) 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8419640 1 -- 172.21.15.193:0/2450635254 learned_addr learned my addr 172.21.15.193:0/2450635254 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8419640 1 -- 172.21.15.193:0/2450635254 >> v1:172.21.15.62:6789/0 conn(0x55c3d3a181f0 legacy=0x55c3d3a185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.809+0000 7f32e8419640 1 -- 172.21.15.193:0/2450635254 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d38beca0 con 0x55c3d3a1c340 2024-09-12T17:13:17.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32e8419640 1 --2- 172.21.15.193:0/2450635254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a1c340 0x55c3d3a1e730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00a5c0 tx=0x7f32dc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e71c6316550fc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32e7c18640 1 -- 172.21.15.193:0/2450635254 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0a9590 con 0x55c3d3a1c340 2024-09-12T17:13:17.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32e7c18640 1 -- 172.21.15.193:0/2450635254 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0ae070 con 0x55c3d3a1c340 2024-09-12T17:13:17.815 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32e7c18640 1 -- 172.21.15.193:0/2450635254 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0a9880 con 0x55c3d3a1c340 2024-09-12T17:13:17.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 -- 172.21.15.193:0/2450635254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a1c340 msgr2=0x55c3d3a1e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/2450635254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a1c340 0x55c3d3a1e730 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00a5c0 tx=0x7f32dc01b3d0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 -- 172.21.15.193:0/2450635254 shutdown_connections 2024-09-12T17:13:17.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/2450635254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a1c340 0x55c3d3a1e730 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 -- 172.21.15.193:0/2450635254 >> 172.21.15.193:0/2450635254 conn(0x55c3d398bb00 msgr2=0x55c3d398bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 -- 172.21.15.193:0/2450635254 shutdown_connections 2024-09-12T17:13:17.817 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.813+0000 7f32eb1149c0 1 -- 172.21.15.193:0/2450635254 wait complete. 2024-09-12T17:13:17.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32eb1149c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.829 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32eb1149c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3d391e680 con 0x55c3d3a181f0 2024-09-12T17:13:17.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32e8c1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32e8c1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45694/0 (socket says 172.21.15.193:45694) 2024-09-12T17:13:17.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32e8c1a640 1 -- 172.21.15.193:0/3465852272 learned_addr learned my addr 172.21.15.193:0/3465852272 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.830 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32e8c1a640 1 -- 172.21.15.193:0/3465852272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d3899da0 con 0x55c3d3a181f0 2024-09-12T17:13:17.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.824+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/3465852272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32d800b270 tx=0x7f32d800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a7f3a7543d9a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d6e0d640 1 -- 172.21.15.193:0/3465852272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d800e5d0 con 0x55c3d3a181f0 2024-09-12T17:13:17.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d6e0d640 1 -- 172.21.15.193:0/3465852272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d800e770 con 0x55c3d3a181f0 2024-09-12T17:13:17.831 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d6e0d640 1 -- 172.21.15.193:0/3465852272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d800ea70 con 0x55c3d3a181f0 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3465852272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 msgr2=0x55c3d3b038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3465852272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32d800b270 tx=0x7f32d800b670 comp rx=0 tx=0).stop 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3465852272 shutdown_connections 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3465852272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b038f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3465852272 >> 172.21.15.193:0/3465852272 conn(0x55c3d398bb00 msgr2=0x55c3d3aff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3465852272 shutdown_connections 2024-09-12T17:13:17.832 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3465852272 wait complete. 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3d38c0a50 con 0x55c3d3a181f0 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32e8c1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32e8c1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45700/0 (socket says 172.21.15.193:45700) 2024-09-12T17:13:17.833 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32e8c1a640 1 -- 172.21.15.193:0/3382851077 learned_addr learned my addr 172.21.15.193:0/3382851077 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32e8c1a640 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d3b0b520 con 0x55c3d3a181f0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b04880 tx=0x7f32d8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d560a640 1 -- 172.21.15.193:0/3382851077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d800be70 con 0x55c3d3a181f0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3d3b0b7b0 con 0x55c3d3a181f0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d3b0c160 con 0x55c3d3a181f0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d560a640 1 -- 172.21.15.193:0/3382851077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d800f9f0 con 0x55c3d3a181f0 2024-09-12T17:13:17.834 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.828+0000 7f31d560a640 1 -- 172.21.15.193:0/3382851077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d802c060 con 0x55c3d3a181f0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f31d560a640 1 -- 172.21.15.193:0/3382851077 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32d8017070 con 0x55c3d3a181f0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f31d560a640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 0x7f31d003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f31d560a640 1 -- 172.21.15.193:0/3382851077 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32d8015020 con 0x55c3d3a181f0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e8419640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 0x7f31d003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 0x55c3d3b12130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b12670 con 0x55c3d3a1c340 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 0x55c3d3b12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e8419640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 0x7f31d003bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0ad000 tx=0x7f32dc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.836 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 0x55c3d3b12130 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 -- 172.21.15.193:0/3382851077 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e000a4d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.837 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b0c4b0 con 0x55c3d3a1c340 2024-09-12T17:13:17.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 -- 172.21.15.193:0/3382851077 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32e000a4d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b14430 con 0x55c3d3a1c340 2024-09-12T17:13:17.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 -- 172.21.15.193:0/3382851077 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32e000a4d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b13660 con 0x55c3d3a1c340 2024-09-12T17:13:17.838 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 -- 172.21.15.193:0/3382851077 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32e000a4d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b13ab0 con 0x55c3d3a1c340 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e941b640 1 -- 172.21.15.193:0/3382851077 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32e000a4d0 con 0x55c3d3a1c340 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32eb1149c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3d392b450 con 0x55c3d3b22710 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45716/0 (socket says 172.21.15.193:45716) 2024-09-12T17:13:17.839 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.832+0000 7f32e8419640 1 -- 172.21.15.193:0/4095544011 learned_addr learned my addr 172.21.15.193:0/4095544011 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 -- 172.21.15.193:0/4095544011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d3b23170 con 0x55c3d3b22710 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0ab040 tx=0x7f32dc018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 -- 172.21.15.193:0/4095544011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0b3ba0 con 0x55c3d3b22710 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3d3b239d0 con 0x55c3d3b22710 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 -- 172.21.15.193:0/4095544011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0b3d40 con 0x55c3d3b22710 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d3b23ee0 con 0x55c3d3b22710 2024-09-12T17:13:17.840 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 -- 172.21.15.193:0/4095544011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0c8560 con 0x55c3d3b22710 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 -- 172.21.15.193:0/4095544011 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32dc0c8700 con 0x55c3d3b22710 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 0x7f31c003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f31ce7fc640 1 -- 172.21.15.193:0/4095544011 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32dc0edf60 con 0x55c3d3b22710 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e941b640 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 0x7f31c003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.842 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32eb1149c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3d3b04140 con 0x55c3d3b2efb0 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e941b640 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 0x7f31c003bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b13180 tx=0x7f32e0005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45722/0 (socket says 172.21.15.193:45722) 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 -- 172.21.15.193:0/3568073883 learned_addr learned my addr 172.21.15.193:0/3568073883 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.836+0000 7f32e8419640 1 -- 172.21.15.193:0/3568073883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d3b2f960 con 0x55c3d3b2efb0 2024-09-12T17:13:17.843 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 --2- 172.21.15.193:0/3568073883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0befd0 tx=0x7f32dc0c7d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bdab6c218e377 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31bffff640 1 -- 172.21.15.193:0/3568073883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0be8e0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31bffff640 1 -- 172.21.15.193:0/3568073883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0be410 con 0x55c3d3b2efb0 2024-09-12T17:13:17.845 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31bffff640 1 -- 172.21.15.193:0/3568073883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0bea80 con 0x55c3d3b2efb0 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3568073883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 msgr2=0x55c3d3b2f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3568073883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0befd0 tx=0x7f32dc0c7d50 comp rx=0 tx=0).stop 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3568073883 shutdown_connections 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3568073883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b2f390 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3568073883 >> 172.21.15.193:0/3568073883 conn(0x55c3d3b2b3e0 msgr2=0x55c3d3b29620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3568073883 shutdown_connections 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3568073883 wait complete. 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 Processor -- start 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- start start 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55c3d3b2ffc0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b364e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45726/0 (socket says 172.21.15.193:45726) 2024-09-12T17:13:17.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 learned_addr learned my addr 172.21.15.193:0/4155500507 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3d3b36a40 con 0x55c3d3b2efb0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32e8419640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b364e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b37f0 tx=0x7f32dc0a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31be7fc640 1 -- 172.21.15.193:0/4155500507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0c7710 con 0x55c3d3b2efb0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c3d3b36cd0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3d3b36cd0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31be7fc640 1 -- 172.21.15.193:0/4155500507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0c78b0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.840+0000 7f31be7fc640 1 -- 172.21.15.193:0/4155500507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32dc0bd7b0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f31be7fc640 1 -- 172.21.15.193:0/4155500507 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f32dc0bd950 con 0x55c3d3b2efb0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f31be7fc640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31b4039a70 0x7f31b403bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f31be7fc640 1 -- 172.21.15.193:0/4155500507 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f32dc0e70d0 con 0x55c3d3b2efb0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31b4039a70 0x7f31b403bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3b41690 0x55c3d3b43ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b44230 con 0x55c3d3b41690 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3b41690 0x55c3d3b43ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31b4039a70 0x7f31b403bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b0c410 tx=0x7f32e001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3b41690 0x55c3d3b43ae0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 realm 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b44640 con 0x55c3d3b41690 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b44f10 con 0x55c3d3b41690 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b452b0 con 0x55c3d3b41690 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b45b00 con 0x55c3d3b41690 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 20 searching for the correct realm 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c3d3b47870 0x55c3d3b49c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8419640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c3d3b47870 0x55c3d3b49c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8419640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c3d3b47870 0x55c3d3b49c60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8419640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f32dc009040 0x7f32dc0d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f32dc009040 0x7f32dc0d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f32dc009040 0x7f32dc0d1a80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f32e0031040 0x7f32e0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.844+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f32e0031040 0x7f32e0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f32e0031040 0x7f32e0032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.848+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.861 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.852+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.862 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b47870 2024-09-12T17:13:17.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32e0031040 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x55c3d3b41690 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a1a0 con 0x7f32dc009040 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e001f070 con 0x7f32dc009040 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:17.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b46510 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b46db0 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a540 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.856+0000 7f32eb1149c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:17.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 zone default found 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 4 Realm: () 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 zonegroup default 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4a9f0 con 0x7f32e0031040 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4c4e0 con 0x55c3d3b47870 2024-09-12T17:13:17.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4c9d0 con 0x55c3d3b47870 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 started sync module instance, tier type = 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4b870 con 0x7f32dc009040 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94299558820960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4b4d0 con 0x7f32dc009040 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d900 con 0x55c3d3b41690 2024-09-12T17:13:17.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.860+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94299558820960] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94299558825520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d900 con 0x55c3d3b41690 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4e310 con 0x55c3d3b47870 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94299558825520] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94299558827088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d870 con 0x55c3d3b47870 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.864+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4f010 con 0x7f32dc009040 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94299558833296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4f8b0 con 0x7f32dc009040 2024-09-12T17:13:17.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b502b0 con 0x55c3d3b41690 2024-09-12T17:13:17.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94299558827088] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94299558833296] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94299558831792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4f400 con 0x55c3d3b41690 2024-09-12T17:13:17.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.868+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b50b50 con 0x7f32e0031040 2024-09-12T17:13:17.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94299558831792] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94299558837696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4f400 con 0x7f32e0031040 2024-09-12T17:13:17.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b50fc0 con 0x7f32e0031040 2024-09-12T17:13:17.877 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94299558837696] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94299558841008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b50f80 con 0x7f32e0031040 2024-09-12T17:13:17.878 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.872+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b51980 con 0x7f32e0031040 2024-09-12T17:13:17.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94299558841008] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94299558839360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b51940 con 0x7f32e0031040 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=0 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=1 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=2 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=3 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=4 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=5 2024-09-12T17:13:17.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.876+0000 7f32eb1149c0 20 add_watcher() i=6 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94299558839360] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 add_watcher() i=7 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b54da0 con 0x55c3d3b41690 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94299558844000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b522f0 con 0x55c3d3b41690 2024-09-12T17:13:17.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94299558844000] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f319efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 5 note: GC not initialized 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f319dfe3640 20 reqs_thread_entry: start 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 Filter name: none 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f310f7fe640 20 reqs_thread_entry: start 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:17.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b77f90 con 0x7f32e0031040 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 20 rados_obj.operate() r=0 bl.length=490 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:17.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.880+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b7e820 con 0x7f32e0031040 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32eb1149c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32eb1149c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32eb1149c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94299559027344 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b79f50 con 0x55c3d3b41690 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94299558831792 notify 146028888119 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55c3d3b0c160 con 0x55c3d3b41690 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f31bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888119 cookie 94299558831792 notifier 4909 bl.length()=636 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f31bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f31bffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94299559027344 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f31bffff640 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f31ac003eb0 con 0x55c3d3b41690 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94299559027344 notify 146028888119 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c3d3b0b7b0 con 0x55c3d3b41690 2024-09-12T17:13:17.890 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:17.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f319efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:17.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.884+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94299558844000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b75d70 con 0x55c3d3b41690 2024-09-12T17:13:17.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94299558844000] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94299558820960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b75d70 con 0x7f32dc009040 2024-09-12T17:13:17.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94299558820960] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 20 remove_watcher() i=0 2024-09-12T17:13:17.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 2 removed watcher, disabling cache 2024-09-12T17:13:17.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94299558825520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b75d70 con 0x55c3d3b41690 2024-09-12T17:13:17.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94299558825520] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 20 remove_watcher() i=1 2024-09-12T17:13:17.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.888+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94299558827088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b75d70 con 0x55c3d3b47870 2024-09-12T17:13:17.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32e8419640 1 -- 172.21.15.193:0/4155500507 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94299558827088] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32dc0f8020 con 0x55c3d3b47870 2024-09-12T17:13:17.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32eb1149c0 20 remove_watcher() i=2 2024-09-12T17:13:17.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94299558833296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d450 con 0x7f32dc009040 2024-09-12T17:13:17.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32e941b640 1 -- 172.21.15.193:0/4155500507 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94299558833296] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e0040040 con 0x7f32dc009040 2024-09-12T17:13:17.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32eb1149c0 20 remove_watcher() i=3 2024-09-12T17:13:17.897 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.892+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94299558831792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4ec90 con 0x55c3d3b41690 2024-09-12T17:13:17.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94299558831792] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x55c3d3b41690 2024-09-12T17:13:17.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32eb1149c0 20 remove_watcher() i=4 2024-09-12T17:13:17.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94299558837696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d450 con 0x7f32e0031040 2024-09-12T17:13:17.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94299558837696] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32eb1149c0 20 remove_watcher() i=5 2024-09-12T17:13:17.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.896+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94299558841008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4e6b0 con 0x7f32e0031040 2024-09-12T17:13:17.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94299558841008] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 20 remove_watcher() i=6 2024-09-12T17:13:17.903 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94299558839360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c3d3b4d450 con 0x7f32e0031040 2024-09-12T17:13:17.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94299558839360] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d802e070 con 0x7f32e0031040 2024-09-12T17:13:17.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 20 remove_watcher() i=7 2024-09-12T17:13:17.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f32e0031040 msgr2=0x7f32e0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f32e0031040 0x7f32e0032940 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3b41690 msgr2=0x55c3d3b43ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3b41690 0x55c3d3b43ae0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f32dc009040 msgr2=0x7f32dc0d1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f32dc009040 0x7f32dc0d1a80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c3d3b47870 msgr2=0x55c3d3b49c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55c3d3b47870 0x55c3d3b49c60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31b4039a70 msgr2=0x7f31b403bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31b4039a70 0x7f31b403bf30 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b0c410 tx=0x7f32e001f000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 msgr2=0x55c3d3b364e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4155500507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b2efb0 0x55c3d3b364e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b37f0 tx=0x7f32dc0a9f70 comp rx=0 tx=0).stop 2024-09-12T17:13:17.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 reap_dead start 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32e8c1a640 1 -- 172.21.15.193:0/4155500507 reap_dead start 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 shutdown_connections 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 >> 172.21.15.193:0/4155500507 conn(0x55c3d3b2b3e0 msgr2=0x55c3d3b295f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 shutdown_connections 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4155500507 wait complete. 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 msgr2=0x7f31c003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 0x7f31c003bf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b13180 tx=0x7f32e0005850 comp rx=0 tx=0).stop 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 msgr2=0x55c3d3b22b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.900+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0ab040 tx=0x7f32dc018170 comp rx=0 tx=0).stop 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 shutdown_connections 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31c0039a70 0x7f31c003bf30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/4095544011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3b22710 0x55c3d3b22b30 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 >> 172.21.15.193:0/4095544011 conn(0x55c3d3b180c0 msgr2=0x55c3d3b184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 shutdown_connections 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/4095544011 wait complete. 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 msgr2=0x55c3d3b12130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 0x55c3d3b12130 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 msgr2=0x7f31d003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 0x7f31d003bf30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0ad000 tx=0x7f32dc0a6000 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 msgr2=0x55c3d3b0afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x55c3d3b04880 tx=0x7f32d8000ee0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 shutdown_connections 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55c3d3a1c340 0x55c3d3b12130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f31d0039a70 0x7f31d003bf30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 --2- 172.21.15.193:0/3382851077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55c3d3a181f0 0x55c3d3b0afc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:17.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 >> 172.21.15.193:0/3382851077 conn(0x55c3d398bb00 msgr2=0x55c3d3afdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:17.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 shutdown_connections 2024-09-12T17:13:17.911 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.904+0000 7f32eb1149c0 1 -- 172.21.15.193:0/3382851077 wait complete. 2024-09-12T17:13:17.916 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.916 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:17.917 ERROR:root:0 2024-09-12T17:13:17.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:17.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:17.917 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:13:17.994 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:17.994 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:17.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:17.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:17.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d299319c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d730823df0 0x55d7308241d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:17.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d299319c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7306d99c0 con 0x55d730826fd0 2024-09-12T17:13:17.995 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d299319c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d7307296d0 con 0x55d730823df0 2024-09-12T17:13:17.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d27437640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d730823df0 0x55d7308241d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:17.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d27437640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d730823df0 0x55d7308241d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45742/0 (socket says 172.21.15.193:45742) 2024-09-12T17:13:17.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d27437640 1 -- 172.21.15.193:0/3409439928 learned_addr learned my addr 172.21.15.193:0/3409439928 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:17.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d27437640 1 -- 172.21.15.193:0/3409439928 >> v1:172.21.15.62:6789/0 conn(0x55d730826fd0 legacy=0x55d7308293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:17.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.992+0000 7f6d27437640 1 -- 172.21.15.193:0/3409439928 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7306cdca0 con 0x55d730823df0 2024-09-12T17:13:17.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d27437640 1 --2- 172.21.15.193:0/3409439928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730823df0 0x55d7308241d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800a4e0 tx=0x7f6d1801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf34648314adfc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:17.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d26435640 1 -- 172.21.15.193:0/3409439928 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180aa540 con 0x55d730823df0 2024-09-12T17:13:17.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d26435640 1 -- 172.21.15.193:0/3409439928 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d180aa6e0 con 0x55d730823df0 2024-09-12T17:13:17.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d26435640 1 -- 172.21.15.193:0/3409439928 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180aaa40 con 0x55d730823df0 2024-09-12T17:13:17.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 -- 172.21.15.193:0/3409439928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730823df0 msgr2=0x55d7308241d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3409439928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730823df0 0x55d7308241d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800a4e0 tx=0x7f6d1801b090 comp rx=0 tx=0).stop 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 -- 172.21.15.193:0/3409439928 shutdown_connections 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3409439928 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730823df0 0x55d7308241d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 -- 172.21.15.193:0/3409439928 >> 172.21.15.193:0/3409439928 conn(0x55d73081f910 msgr2=0x55d730821d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 -- 172.21.15.193:0/3409439928 shutdown_connections 2024-09-12T17:13:18.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:17.996+0000 7f6d299319c0 1 -- 172.21.15.193:0/3409439928 wait complete. 2024-09-12T17:13:18.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:18.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:18.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d299319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d299319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d73072d680 con 0x55d730826fd0 2024-09-12T17:13:18.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d27437640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d27437640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45744/0 (socket says 172.21.15.193:45744) 2024-09-12T17:13:18.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d27437640 1 -- 172.21.15.193:0/502053820 learned_addr learned my addr 172.21.15.193:0/502053820 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d27437640 1 -- 172.21.15.193:0/502053820 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7306a8da0 con 0x55d730826fd0 2024-09-12T17:13:18.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6d27437640 1 --2- 172.21.15.193:0/502053820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6d18019740 tx=0x7f6d180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c57948002856ae server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6c1560a640 1 -- 172.21.15.193:0/502053820 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180b9070 con 0x55d730826fd0 2024-09-12T17:13:18.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6c1560a640 1 -- 172.21.15.193:0/502053820 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d180aa910 con 0x55d730826fd0 2024-09-12T17:13:18.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.008+0000 7f6c1560a640 1 -- 172.21.15.193:0/502053820 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180aabf0 con 0x55d730826fd0 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/502053820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 msgr2=0x55d73090f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 --2- 172.21.15.193:0/502053820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6d18019740 tx=0x7f6d180033b0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/502053820 shutdown_connections 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 --2- 172.21.15.193:0/502053820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730826fd0 0x55d73090f710 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/502053820 >> 172.21.15.193:0/502053820 conn(0x55d73081f910 msgr2=0x55d73090b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/502053820 shutdown_connections 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/502053820 wait complete. 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d7306cfa50 con 0x55d730916f00 2024-09-12T17:13:18.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d27437640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d27437640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45748/0 (socket says 172.21.15.193:45748) 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d27437640 1 -- 172.21.15.193:0/1807907876 learned_addr learned my addr 172.21.15.193:0/1807907876 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d27437640 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d730917880 con 0x55d730916f00 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d27437640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6d18000f90 tx=0x7f6d18017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6c13e07640 1 -- 172.21.15.193:0/1807907876 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180b9030 con 0x55d730916f00 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d730917b10 con 0x55d730916f00 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d730918410 con 0x55d730916f00 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6c13e07640 1 -- 172.21.15.193:0/1807907876 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d180bfad0 con 0x55d730916f00 2024-09-12T17:13:18.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6c13e07640 1 -- 172.21.15.193:0/1807907876 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d180bfdb0 con 0x55d730916f00 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.012+0000 7f6c13e07640 1 -- 172.21.15.193:0/1807907876 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d180b3040 con 0x55d730916f00 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6c13e07640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 0x7f6c0c03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6c13e07640 1 -- 172.21.15.193:0/1807907876 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6d180c5030 con 0x55d730916f00 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 0x7f6c0c03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 0x55d73091d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73091db60 con 0x55d730918b40 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 0x55d73091d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 0x7f6c0c03bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001ec0 tx=0x7f6d10001440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 0x55d73091d590 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 -- 172.21.15.193:0/1807907876 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d200083f0 con 0x55d730918b40 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73091e440 con 0x55d730918b40 2024-09-12T17:13:18.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 -- 172.21.15.193:0/1807907876 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d200083f0 con 0x55d730918b40 2024-09-12T17:13:18.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73091f7f0 con 0x55d730918b40 2024-09-12T17:13:18.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 -- 172.21.15.193:0/1807907876 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d200083f0 con 0x55d730918b40 2024-09-12T17:13:18.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73091ec90 con 0x55d730918b40 2024-09-12T17:13:18.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 -- 172.21.15.193:0/1807907876 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d200083f0 con 0x55d730918b40 2024-09-12T17:13:18.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73091f0b0 con 0x55d730918b40 2024-09-12T17:13:18.022 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d27c38640 1 -- 172.21.15.193:0/1807907876 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d200083f0 con 0x55d730918b40 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d299319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d73073a450 con 0x55d73092dd10 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45760/0 (socket says 172.21.15.193:45760) 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 -- 172.21.15.193:0/3982896971 learned_addr learned my addr 172.21.15.193:0/3982896971 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.016+0000 7f6d26c36640 1 -- 172.21.15.193:0/3982896971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73092e770 con 0x55d73092dd10 2024-09-12T17:13:18.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6d10010fd0 tx=0x7f6d1000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 -- 172.21.15.193:0/3982896971 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1000a040 con 0x55d73092dd10 2024-09-12T17:13:18.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 -- 172.21.15.193:0/3982896971 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10017050 con 0x55d73092dd10 2024-09-12T17:13:18.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d73092efd0 con 0x55d73092dd10 2024-09-12T17:13:18.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 -- 172.21.15.193:0/3982896971 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1000e6b0 con 0x55d73092dd10 2024-09-12T17:13:18.025 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73092f540 con 0x55d73092dd10 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 -- 172.21.15.193:0/3982896971 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d1000e8e0 con 0x55d73092dd10 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 0x7f6c0003bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c11602640 1 -- 172.21.15.193:0/3982896971 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6d10052280 con 0x55d73092dd10 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 0x7f6c0003bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 0x7f6c0003bf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55d73091f030 tx=0x7f6d20003070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d299319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d73090fea0 con 0x55d73093a670 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45776/0 (socket says 172.21.15.193:45776) 2024-09-12T17:13:18.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 -- 172.21.15.193:0/4192729377 learned_addr learned my addr 172.21.15.193:0/4192729377 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 -- 172.21.15.193:0/4192729377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73093b020 con 0x55d73093a670 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6d26c36640 1 --2- 172.21.15.193:0/4192729377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6d10050520 tx=0x7f6d1001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b731c2316ba212 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.020+0000 7f6c0affd640 1 -- 172.21.15.193:0/4192729377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1001a310 con 0x55d73093a670 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c0affd640 1 -- 172.21.15.193:0/4192729377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1001c410 con 0x55d73093a670 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c0affd640 1 -- 172.21.15.193:0/4192729377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1001a4b0 con 0x55d73093a670 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/4192729377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 msgr2=0x55d73093aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 --2- 172.21.15.193:0/4192729377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6d10050520 tx=0x7f6d1001acd0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/4192729377 shutdown_connections 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 --2- 172.21.15.193:0/4192729377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d73093aa50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/4192729377 >> 172.21.15.193:0/4192729377 conn(0x55d730936aa0 msgr2=0x55d730934ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/4192729377 shutdown_connections 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/4192729377 wait complete. 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 Processor -- start 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- start start 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d73093b680 con 0x55d73093a670 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d26c36640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45786/0 (socket says 172.21.15.193:45786) 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 learned_addr learned my addr 172.21.15.193:0/3211408638 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7309421a0 con 0x55d73093a670 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d26c36640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001ab30 tx=0x7f6d100504b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c097fa640 1 -- 172.21.15.193:0/3211408638 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10034070 con 0x55d73093a670 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d730942430 con 0x55d73093a670 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d730942de0 con 0x55d73093a670 2024-09-12T17:13:18.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c097fa640 1 -- 172.21.15.193:0/3211408638 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10023e20 con 0x55d73093a670 2024-09-12T17:13:18.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c097fa640 1 -- 172.21.15.193:0/3211408638 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10043040 con 0x55d73093a670 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c097fa640 1 -- 172.21.15.193:0/3211408638 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f6d1001c410 con 0x55d73093a670 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.024+0000 7f6c097fa640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6bf00399d0 0x7f6bf003be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6c097fa640 1 -- 172.21.15.193:0/3211408638 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f6d10030d20 con 0x55d73093a670 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6bf00399d0 0x7f6bf003be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d73094cf70 0x55d73094f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73094fb50 con 0x55d73094cf70 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d73094cf70 0x55d73094f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6bf00399d0 0x7f6bf003be90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000f010 tx=0x7f6d2001b070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d73094cf70 0x55d73094f400 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 realm 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d73094ff60 con 0x55d73094cf70 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730950830 con 0x55d73094cf70 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.036 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730950bd0 con 0x55d73094cf70 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730951420 con 0x55d73094cf70 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 20 searching for the correct realm 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d730953190 0x55d730955580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d26c36640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d730953190 0x55d730955580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d26c36640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d730953190 0x55d730955580 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1000d040 con 0x55d730953190 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d26c36640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d1001c030 0x7f6d1001b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d1001c030 0x7f6d1001b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d1001c030 0x7f6d1001b3b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d20019040 0x7f6d20019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.028+0000 7f6d27437640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d20019040 0x7f6d20019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.038 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d20019040 0x7f6d20019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x7f6d20019040 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x7f6d20019040 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x7f6d20019040 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1000d040 con 0x55d730953190 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.032+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x7f6d20019040 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x7f6d20019040 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.044 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180b3510 con 0x55d73094cf70 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.036+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d730953190 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d20019040 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x55d73094cf70 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ac0 con 0x7f6d1001c030 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.040+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730951d70 con 0x55d73094cf70 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730952610 con 0x55d73094cf70 2024-09-12T17:13:18.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7309519b0 con 0x55d73094cf70 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 zone default found 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 4 Realm: () 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 zonegroup default 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.053 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730955ef0 con 0x7f6d20019040 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730957d00 con 0x55d730953190 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730958170 con 0x55d730953190 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 started sync module instance, tier type = 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:18.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309571a0 con 0x7f6d1001c030 2024-09-12T17:13:18.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382721430928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730956e00 con 0x7f6d1001c030 2024-09-12T17:13:18.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.044+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309590a0 con 0x55d73094cf70 2024-09-12T17:13:18.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382721430928] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382721435088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309590a0 con 0x55d73094cf70 2024-09-12T17:13:18.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730959a60 con 0x55d730953190 2024-09-12T17:13:18.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382721439152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095a2b0 con 0x55d730953190 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.048+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095ac70 con 0x7f6d1001c030 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382721435088] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382721443776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095abe0 con 0x7f6d1001c030 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095ba20 con 0x55d73094cf70 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382721439152] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382721443776] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382721441280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095b9e0 con 0x55d73094cf70 2024-09-12T17:13:18.058 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.052+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095be10 con 0x7f6d20019040 2024-09-12T17:13:18.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382721441280] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382721445984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095bdc0 con 0x7f6d20019040 2024-09-12T17:13:18.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095c750 con 0x7f6d20019040 2024-09-12T17:13:18.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382721445984] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382721450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095c710 con 0x7f6d20019040 2024-09-12T17:13:18.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.056+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095d110 con 0x7f6d20019040 2024-09-12T17:13:18.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382721450496] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382721447040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095d0d0 con 0x7f6d20019040 2024-09-12T17:13:18.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=0 2024-09-12T17:13:18.064 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=1 2024-09-12T17:13:18.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=2 2024-09-12T17:13:18.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=3 2024-09-12T17:13:18.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=4 2024-09-12T17:13:18.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=5 2024-09-12T17:13:18.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=6 2024-09-12T17:13:18.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382721447040] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 20 add_watcher() i=7 2024-09-12T17:13:18.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:18.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.060+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730960500 con 0x55d73094cf70 2024-09-12T17:13:18.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382721453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095da50 con 0x55d73094cf70 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382721453552] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 5 note: GC not initialized 2024-09-12T17:13:18.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6bdcfe1640 20 reqs_thread_entry: start 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 Filter name: none 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6b567fc640 20 reqs_thread_entry: start 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d730983790 con 0x7f6d20019040 2024-09-12T17:13:18.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T17:13:18.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:18.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:18.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.064+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730989ca0 con 0x7f6d20019040 2024-09-12T17:13:18.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x7f6d20019040 2024-09-12T17:13:18.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d299319c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d299319c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d299319c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94382721636176 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d7309853b0 con 0x55d73094cf70 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 94382721441280 notify 146028888120 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f6d180dc040 con 0x55d73094cf70 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6c0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888120 cookie 94382721441280 notifier 4916 bl.length()=649 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6c0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6c0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 94382721636176 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6c0affd640 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6bec003eb0 con 0x55d73094cf70 2024-09-12T17:13:18.073 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d180f4060 con 0x55d73094cf70 2024-09-12T17:13:18.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 94382721636176 notify 146028888120 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d180fe020 con 0x55d73094cf70 2024-09-12T17:13:18.074 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:18.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:18.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.068+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382721453552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730984aa0 con 0x55d73094cf70 2024-09-12T17:13:18.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94382721453552] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x55d73094cf70 2024-09-12T17:13:18.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382721430928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730984aa0 con 0x7f6d1001c030 2024-09-12T17:13:18.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94382721430928] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 20 remove_watcher() i=0 2024-09-12T17:13:18.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 2 removed watcher, disabling cache 2024-09-12T17:13:18.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382721435088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730957590 con 0x55d73094cf70 2024-09-12T17:13:18.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94382721435088] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x55d73094cf70 2024-09-12T17:13:18.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 20 remove_watcher() i=1 2024-09-12T17:13:18.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.072+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382721439152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730957590 con 0x55d730953190 2024-09-12T17:13:18.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d26c36640 1 -- 172.21.15.193:0/3211408638 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94382721439152] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1005f040 con 0x55d730953190 2024-09-12T17:13:18.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d299319c0 20 remove_watcher() i=2 2024-09-12T17:13:18.080 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382721443776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309595b0 con 0x7f6d1001c030 2024-09-12T17:13:18.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d27c38640 1 -- 172.21.15.193:0/3211408638 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94382721443776] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2002f040 con 0x7f6d1001c030 2024-09-12T17:13:18.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d299319c0 20 remove_watcher() i=3 2024-09-12T17:13:18.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.076+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382721441280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309595b0 con 0x55d73094cf70 2024-09-12T17:13:18.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94382721441280] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x55d73094cf70 2024-09-12T17:13:18.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 20 remove_watcher() i=4 2024-09-12T17:13:18.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382721445984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d730959e00 con 0x7f6d20019040 2024-09-12T17:13:18.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94382721445984] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x7f6d20019040 2024-09-12T17:13:18.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 20 remove_watcher() i=5 2024-09-12T17:13:18.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382721450496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d7309595b0 con 0x7f6d20019040 2024-09-12T17:13:18.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94382721450496] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x7f6d20019040 2024-09-12T17:13:18.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 20 remove_watcher() i=6 2024-09-12T17:13:18.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.080+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382721447040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d73095b060 con 0x7f6d20019040 2024-09-12T17:13:18.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94382721447040] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d18100040 con 0x7f6d20019040 2024-09-12T17:13:18.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 20 remove_watcher() i=7 2024-09-12T17:13:18.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d20019040 msgr2=0x7f6d20019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f6d20019040 0x7f6d20019930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d73094cf70 msgr2=0x55d73094f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d73094cf70 0x55d73094f400 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d1001c030 msgr2=0x7f6d1001b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f6d1001c030 0x7f6d1001b3b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d730953190 msgr2=0x55d730955580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d730953190 0x55d730955580 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6bf00399d0 msgr2=0x7f6bf003be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6bf00399d0 0x7f6bf003be90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000f010 tx=0x7f6d2001b070 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d27437640 1 -- 172.21.15.193:0/3211408638 reap_dead start 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 msgr2=0x55d730941c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6d1001ab30 tx=0x7f6d100504b0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 shutdown_connections 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3211408638 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73093a670 0x55d730941c40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 >> 172.21.15.193:0/3211408638 conn(0x55d730936aa0 msgr2=0x55d730934cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 shutdown_connections 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3211408638 wait complete. 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 msgr2=0x7f6c0003bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 0x7f6c0003bf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x55d73091f030 tx=0x7f6d20003070 comp rx=0 tx=0).stop 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 msgr2=0x55d73092e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6d10010fd0 tx=0x7f6d1000f7a0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 shutdown_connections 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c00039ac0 0x7f6c0003bf80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/3982896971 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d73092dd10 0x55d73092e130 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 >> 172.21.15.193:0/3982896971 conn(0x55d7309236c0 msgr2=0x55d730923aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 shutdown_connections 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/3982896971 wait complete. 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 msgr2=0x55d73091d590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 0x55d73091d590 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 msgr2=0x7f6c0c03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 0x7f6c0c03bf30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001ec0 tx=0x7f6d10001440 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 msgr2=0x55d730917320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f6d18000f90 tx=0x7f6d18017e30 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 shutdown_connections 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d730918b40 0x55d73091d590 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f6c0c039a70 0x7f6c0c03bf30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 --2- 172.21.15.193:0/1807907876 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d730916f00 0x55d730917320 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 >> 172.21.15.193:0/1807907876 conn(0x55d73081f910 msgr2=0x55d730909d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 shutdown_connections 2024-09-12T17:13:18.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.084+0000 7f6d299319c0 1 -- 172.21.15.193:0/1807907876 wait complete. 2024-09-12T17:13:18.099 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:18.099 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:18.099 ERROR:root:0 2024-09-12T17:13:18.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:18.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-12T17:13:18.100 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-12T17:13:18.173 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:13:18.174 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:13:18.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00175ab9c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557804ad1700 0x557804ad3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00175ab9c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578049839c0 con 0x557804ad4030 2024-09-12T17:13:18.175 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00175ab9c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x5578049d36d0 con 0x557804ad1700 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00150b1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557804ad1700 0x557804ad3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00148b0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x557804ad4030 0x557804ad6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:59364/0 (socket says 172.21.15.193:59364) 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00150b1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x557804ad1700 0x557804ad3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45800/0 (socket says 172.21.15.193:45800) 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00148b0640 1 -- 172.21.15.193:0/628125831 learned_addr learned my addr 172.21.15.193:0/628125831 (peer_addr_for_me v1:172.21.15.193:0/0) 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00150b1640 1 -- 172.21.15.193:0/628125831 >> v1:172.21.15.62:6789/0 conn(0x557804ad4030 legacy=0x557804ad6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00150b1640 1 -- 172.21.15.193:0/628125831 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804977ca0 con 0x557804ad1700 2024-09-12T17:13:18.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f00150b1640 1 --2- 172.21.15.193:0/628125831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804ad3af0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f000800a480 tx=0x7f000801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a98082a9c20cac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.172+0000 7f0007fff640 1 -- 172.21.15.193:0/628125831 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080b0070 con 0x557804ad1700 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f0007fff640 1 -- 172.21.15.193:0/628125831 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080ab540 con 0x557804ad1700 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f0007fff640 1 -- 172.21.15.193:0/628125831 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080ab840 con 0x557804ad1700 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 -- 172.21.15.193:0/628125831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 msgr2=0x557804ad3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/628125831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804ad3af0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f000800a480 tx=0x7f000801b280 comp rx=0 tx=0).stop 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 -- 172.21.15.193:0/628125831 shutdown_connections 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/628125831 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804ad3af0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 -- 172.21.15.193:0/628125831 >> 172.21.15.193:0/628125831 conn(0x557804a44a90 msgr2=0x557804a44ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 -- 172.21.15.193:0/628125831 shutdown_connections 2024-09-12T17:13:18.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.176+0000 7f00175ab9c0 1 -- 172.21.15.193:0/628125831 wait complete. 2024-09-12T17:13:18.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578049d7680 con 0x557804ad1700 2024-09-12T17:13:18.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00150b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00150b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45806/0 (socket says 172.21.15.193:45806) 2024-09-12T17:13:18.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00150b1640 1 -- 172.21.15.193:0/2959546134 learned_addr learned my addr 172.21.15.193:0/2959546134 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00150b1640 1 -- 172.21.15.193:0/2959546134 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804952da0 con 0x557804ad1700 2024-09-12T17:13:18.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00150b1640 1 --2- 172.21.15.193:0/2959546134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0008018eb0 tx=0x7f0008003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a13f6b201032453 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7eff03606640 1 -- 172.21.15.193:0/2959546134 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080b0040 con 0x557804ad1700 2024-09-12T17:13:18.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7eff03606640 1 -- 172.21.15.193:0/2959546134 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080bb070 con 0x557804ad1700 2024-09-12T17:13:18.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7eff03606640 1 -- 172.21.15.193:0/2959546134 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080ab6f0 con 0x557804ad1700 2024-09-12T17:13:18.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2959546134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 msgr2=0x557804bbc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2959546134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0008018eb0 tx=0x7f0008003030 comp rx=0 tx=0).stop 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2959546134 shutdown_connections 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2959546134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bbc8e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2959546134 >> 172.21.15.193:0/2959546134 conn(0x557804a44a90 msgr2=0x557804bb8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2959546134 shutdown_connections 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2959546134 wait complete. 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.188+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.195 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557804979a50 con 0x557804ad1700 2024-09-12T17:13:18.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00150b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00150b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45818/0 (socket says 172.21.15.193:45818) 2024-09-12T17:13:18.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00150b1640 1 -- 172.21.15.193:0/825646272 learned_addr learned my addr 172.21.15.193:0/825646272 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00150b1640 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804bc43a0 con 0x557804ad1700 2024-09-12T17:13:18.196 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00150b1640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f00080b8040 tx=0x7f0008018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 -- 172.21.15.193:0/825646272 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080b0030 con 0x557804ad1700 2024-09-12T17:13:18.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557804bc4630 con 0x557804ad1700 2024-09-12T17:13:18.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557804bc4fe0 con 0x557804ad1700 2024-09-12T17:13:18.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 -- 172.21.15.193:0/825646272 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00080bb070 con 0x557804ad1700 2024-09-12T17:13:18.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 -- 172.21.15.193:0/825646272 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00080b68e0 con 0x557804ad1700 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 -- 172.21.15.193:0/825646272 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f00080b6a80 con 0x557804ad1700 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 0x7efefc03bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7eff01e03640 1 -- 172.21.15.193:0/825646272 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f00080a8070 con 0x557804ad1700 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00148b0640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 0x7efefc03bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 0x557804bcafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bcb4f0 con 0x557804ad4030 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.192+0000 7f00158b2640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 0x557804bcafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 0x7efefc03bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f000c001d80 tx=0x7f000c0012e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 0x557804bcafb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 -- 172.21.15.193:0/825646272 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f001000a4d0 con 0x557804ad4030 2024-09-12T17:13:18.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bcb940 con 0x557804ad4030 2024-09-12T17:13:18.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 -- 172.21.15.193:0/825646272 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f001000a4d0 con 0x557804ad4030 2024-09-12T17:13:18.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bcd240 con 0x557804ad4030 2024-09-12T17:13:18.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 -- 172.21.15.193:0/825646272 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f001000a4d0 con 0x557804ad4030 2024-09-12T17:13:18.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bcc470 con 0x557804ad4030 2024-09-12T17:13:18.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 -- 172.21.15.193:0/825646272 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f001000a4d0 con 0x557804ad4030 2024-09-12T17:13:18.201 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bcc8c0 con 0x557804ad4030 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00158b2640 1 -- 172.21.15.193:0/825646272 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f001000a4d0 con 0x557804ad4030 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x5578049e4450 con 0x557804bdb550 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45820/0 (socket says 172.21.15.193:45820) 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 -- 172.21.15.193:0/1231023844 learned_addr learned my addr 172.21.15.193:0/1231023844 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 -- 172.21.15.193:0/1231023844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804bdbfb0 con 0x557804bdb550 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00148b0640 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f000c00d660 tx=0x7f000c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7efefaffd640 1 -- 172.21.15.193:0/1231023844 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c00c6b0 con 0x557804bdb550 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557804bdc810 con 0x557804bdb550 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557804bdcd80 con 0x557804bdb550 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7efefaffd640 1 -- 172.21.15.193:0/1231023844 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c00c850 con 0x557804bdb550 2024-09-12T17:13:18.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.196+0000 7efefaffd640 1 -- 172.21.15.193:0/1231023844 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c00cb30 con 0x557804bdb550 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efefaffd640 1 -- 172.21.15.193:0/1231023844 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f000c023020 con 0x557804bdb550 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efefaffd640 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 0x7efeec03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efefaffd640 1 -- 172.21.15.193:0/1231023844 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f000c021020 con 0x557804bdb550 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00158b2640 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 0x7efeec03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00158b2640 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 0x7efeec03bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x557804bcbf90 tx=0x7f0010005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557804bbd070 con 0x557804be7eb0 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45826/0 (socket says 172.21.15.193:45826) 2024-09-12T17:13:18.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00148b0640 1 -- 172.21.15.193:0/2021444596 learned_addr learned my addr 172.21.15.193:0/2021444596 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.206 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00148b0640 1 -- 172.21.15.193:0/2021444596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804be8860 con 0x557804be7eb0 2024-09-12T17:13:18.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00148b0640 1 --2- 172.21.15.193:0/2021444596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f000c050f00 tx=0x7f000c0233d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1402ade627c34ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efef8ff9640 1 -- 172.21.15.193:0/2021444596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c024710 con 0x557804be7eb0 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efef8ff9640 1 -- 172.21.15.193:0/2021444596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c00ccd0 con 0x557804be7eb0 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7efef8ff9640 1 -- 172.21.15.193:0/2021444596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c01bcc0 con 0x557804be7eb0 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2021444596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 msgr2=0x557804be8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2021444596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f000c050f00 tx=0x7f000c0233d0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2021444596 shutdown_connections 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2021444596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804be8290 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2021444596 >> 172.21.15.193:0/2021444596 conn(0x557804be42e0 msgr2=0x557804be2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2021444596 shutdown_connections 2024-09-12T17:13:18.208 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.200+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2021444596 wait complete. 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 Processor -- start 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 -- start start 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804bef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x557804be8ec0 con 0x557804be7eb0 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804bef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00148b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804bef3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:45836/0 (socket says 172.21.15.193:45836) 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 learned_addr learned my addr 172.21.15.193:0/2036523674 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557804bef940 con 0x557804be7eb0 2024-09-12T17:13:18.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00148b0640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804bef3e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f000c024900 tx=0x7f000c050e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 -- 172.21.15.193:0/2036523674 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c0236e0 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557804befbd0 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 -- 172.21.15.193:0/2036523674 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c01b420 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557804befbd0 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 -- 172.21.15.193:0/2036523674 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f000c023880 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 -- 172.21.15.193:0/2036523674 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f000c01b700 con 0x557804be7eb0 2024-09-12T17:13:18.213 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efee0039a70 0x7efee003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7efeeaffd640 1 -- 172.21.15.193:0/2036523674 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f000c005030 con 0x557804be7eb0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00158b2640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efee0039a70 0x7efee003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804bfa4a0 0x557804bfc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bfd0b0 con 0x557804bfa4a0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00150b1640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804bfa4a0 0x557804bfc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00158b2640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efee0039a70 0x7efee003bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557804bc5fa0 tx=0x7f001001f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.204+0000 7f00150b1640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804bfa4a0 0x557804bfc960 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 realm 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.214 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bfd4c0 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bfdd90 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bfe130 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bfe980 con 0x557804bfa4a0 2024-09-12T17:13:18.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 20 searching for the correct realm 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557804c006f0 0x557804c02ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00148b0640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557804c006f0 0x557804c02ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00148b0640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557804c006f0 0x557804c02ae0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00148b0640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f000c030a20 0x7f000c01e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00158b2640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f000c030a20 0x7f000c01e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00158b2640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f000c030a20 0x7f000c01e8f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00158b2640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0010031040 0x7f0010032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:13:18.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.217 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0010031040 0x7f0010032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0010031040 0x7f0010032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.208+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.212+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.228 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.216+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804c006f0 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f0010031040 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x557804bfa4a0 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557804c03020 con 0x7f000c030a20 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f001001f070 con 0x7f000c030a20 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:13:18.230 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bff2d0 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bffb70 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804bffb70 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 zone default found 2024-09-12T17:13:18.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 4 Realm: () 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 zonegroup default 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c033c0 con 0x7f0010031040 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.220+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c04eb0 con 0x557804c006f0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.232 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c052f0 con 0x557804c006f0 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 20 started sync module instance, tier type = 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c04250 con 0x7f000c030a20 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93973964146240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c05c00 con 0x7f000c030a20 2024-09-12T17:13:18.233 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c06450 con 0x557804bfa4a0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93973964146240] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93973964150608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c06060 con 0x557804bfa4a0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.224+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c06b80 con 0x557804c006f0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93973964150608] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93973964154448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c06f70 con 0x557804c006f0 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c07930 con 0x7f000c030a20 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.235 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93973964158352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08020 con 0x7f000c030a20 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.228+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08b20 con 0x557804bfa4a0 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93973964158352] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93973964154448] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93973964151664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08ae0 con 0x557804bfa4a0 2024-09-12T17:13:18.236 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08f40 con 0x7f0010031040 2024-09-12T17:13:18.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93973964151664] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.237 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93973964162576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08ef0 con 0x7f0010031040 2024-09-12T17:13:18.238 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.232+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c09950 con 0x7f0010031040 2024-09-12T17:13:18.239 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.236+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93973964162576] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.236+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.236+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93973964159600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c09950 con 0x7f0010031040 2024-09-12T17:13:18.240 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.236+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c0a310 con 0x7f0010031040 2024-09-12T17:13:18.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.236+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93973964159600] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.242 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93973964166576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c0a310 con 0x7f0010031040 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=0 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=1 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=2 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=3 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=4 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=5 2024-09-12T17:13:18.243 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=6 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93973964166576] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 add_watcher() i=7 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c0d610 con 0x557804bfa4a0 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.245 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93973964169168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c0a8a0 con 0x557804bfa4a0 2024-09-12T17:13:18.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93973964169168] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00080b3040 con 0x557804bfa4a0 2024-09-12T17:13:18.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7efecbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:18.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:13:18.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:13:18.246 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7f00175ab9c0 5 note: GC not initialized 2024-09-12T17:13:18.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.240+0000 7efecafe5640 20 reqs_thread_entry: start 2024-09-12T17:13:18.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T17:13:18.247 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 20 Filter name: none 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7efec8fe1640 20 reqs_thread_entry: start 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 20 rados->read ofs=0 len=0 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c308e0 con 0x7f0010031040 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f00080b3040 con 0x7f0010031040 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 20 rados_obj.operate() r=0 bl.length=473 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T17:13:18.248 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c37160 con 0x7f0010031040 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0008109040 con 0x7f0010031040 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.244+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93973964352528 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557804c328b0 con 0x557804bfa4a0 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== watch-notify(notify (1) cookie 93973964151664 notify 146028888121 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f0008103080 con 0x557804bfa4a0 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7efef8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888121 cookie 93973964151664 notifier 4923 bl.length()=649 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7efef8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7efef8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(64 notify.4 [notify cookie 93973964352528 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0008109040 con 0x557804bfa4a0 2024-09-12T17:13:18.251 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7efef8ff9640 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efed8003eb0 con 0x557804bfa4a0 2024-09-12T17:13:18.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x557804bfa4a0 2024-09-12T17:13:18.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== watch-notify(notify_complete (2) cookie 93973964352528 notify 146028888121 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557804bc4fe0 con 0x557804bfa4a0 2024-09-12T17:13:18.252 INFO:teuthology.orchestra.run.smithi193.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-12T17:13:15.745318Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-12T17:13:15.745303Z","tags":[],"group_ids":[]} 2024-09-12T17:13:18.252 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7efecbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:13:18.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93973964169168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c33070 con 0x557804bfa4a0 2024-09-12T17:13:18.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93973964169168] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0008109040 con 0x557804bfa4a0 2024-09-12T17:13:18.253 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93973964146240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c33070 con 0x7f000c030a20 2024-09-12T17:13:18.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93973964146240] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00175ab9c0 20 remove_watcher() i=0 2024-09-12T17:13:18.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00175ab9c0 2 removed watcher, disabling cache 2024-09-12T17:13:18.254 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.248+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93973964150608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c33070 con 0x557804bfa4a0 2024-09-12T17:13:18.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93973964150608] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x557804bfa4a0 2024-09-12T17:13:18.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00175ab9c0 20 remove_watcher() i=1 2024-09-12T17:13:18.256 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93973964154448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c33070 con 0x557804c006f0 2024-09-12T17:13:18.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00148b0640 1 -- 172.21.15.193:0/2036523674 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93973964154448] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f000c042390 con 0x557804c006f0 2024-09-12T17:13:18.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00175ab9c0 20 remove_watcher() i=2 2024-09-12T17:13:18.258 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.252+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93973964158352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c05750 con 0x7f000c030a20 2024-09-12T17:13:18.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00158b2640 1 -- 172.21.15.193:0/2036523674 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93973964158352] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0010040040 con 0x7f000c030a20 2024-09-12T17:13:18.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00175ab9c0 20 remove_watcher() i=3 2024-09-12T17:13:18.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93973964151664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c07590 con 0x557804bfa4a0 2024-09-12T17:13:18.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93973964151664] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x557804bfa4a0 2024-09-12T17:13:18.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00175ab9c0 20 remove_watcher() i=4 2024-09-12T17:13:18.261 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.256+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93973964162576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c07590 con 0x7f0010031040 2024-09-12T17:13:18.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93973964162576] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x7f0010031040 2024-09-12T17:13:18.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00175ab9c0 20 remove_watcher() i=5 2024-09-12T17:13:18.263 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93973964159600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c08610 con 0x7f0010031040 2024-09-12T17:13:18.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93973964159600] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x7f0010031040 2024-09-12T17:13:18.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00175ab9c0 20 remove_watcher() i=6 2024-09-12T17:13:18.265 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.260+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93973964166576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557804c07590 con 0x7f0010031040 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93973964166576] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0008109040 con 0x7f0010031040 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 20 remove_watcher() i=7 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0010031040 msgr2=0x7f0010032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0010031040 0x7f0010032940 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804bfa4a0 msgr2=0x557804bfc960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804bfa4a0 0x557804bfc960 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f000c030a20 msgr2=0x7f000c01e8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f000c030a20 0x7f000c01e8f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557804c006f0 msgr2=0x557804c02ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x557804c006f0 0x557804c02ae0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.269 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efee0039a70 msgr2=0x7efee003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efee0039a70 0x7efee003bf30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557804bc5fa0 tx=0x7f001001f000 comp rx=0 tx=0).stop 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 msgr2=0x557804bef3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/2036523674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804be7eb0 0x557804bef3e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f000c024900 tx=0x7f000c050e60 comp rx=0 tx=0).stop 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00150b1640 1 -- 172.21.15.193:0/2036523674 reap_dead start 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 shutdown_connections 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 >> 172.21.15.193:0/2036523674 conn(0x557804be42e0 msgr2=0x557804be24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 shutdown_connections 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/2036523674 wait complete. 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 msgr2=0x7efeec03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 0x7efeec03bf80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x557804bcbf90 tx=0x7f0010005850 comp rx=0 tx=0).stop 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 msgr2=0x557804bdb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f000c00d660 tx=0x7f000c00da60 comp rx=0 tx=0).stop 2024-09-12T17:13:18.270 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 shutdown_connections 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efeec039ac0 0x7efeec03bf80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/1231023844 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804bdb550 0x557804bdb970 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 >> 172.21.15.193:0/1231023844 conn(0x557804bd0f00 msgr2=0x557804bd12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 shutdown_connections 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/1231023844 wait complete. 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 msgr2=0x557804bcafb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 0x557804bcafb0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 msgr2=0x7efefc03bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 0x7efefc03bf30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f000c001d80 tx=0x7f000c0012e0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 msgr2=0x557804bc3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f00080b8040 tx=0x7f0008018020 comp rx=0 tx=0).stop 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 shutdown_connections 2024-09-12T17:13:18.271 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x557804ad4030 0x557804bcafb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7efefc039a70 0x7efefc03bf30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 --2- 172.21.15.193:0/825646272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557804ad1700 0x557804bc3e40 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:13:18.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 >> 172.21.15.193:0/825646272 conn(0x557804a44a90 msgr2=0x557804bb6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:13:18.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 shutdown_connections 2024-09-12T17:13:18.272 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:13:18.264+0000 7f00175ab9c0 1 -- 172.21.15.193:0/825646272 wait complete. 2024-09-12T17:13:18.278 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:18.278 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-12T17:13:15.745318Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-12T17:13:15.745303Z', 'tags': [], 'group_ids': []} 2024-09-12T17:13:18.278 ERROR:root:0 2024-09-12T17:13:18.278 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T17:13:18.285 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.285 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.289 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.289 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T17:13:18.294 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.295 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.298 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-12T17:13:18.306 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-12T17:13:18.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.310 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-12T17:13:18.318 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.321 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.321 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-12T17:13:18.328 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-12T17:13:18.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.335 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.336 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-12T17:13:18.344 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-12T17:13:18.344 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.348 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-12T17:13:18.355 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.358 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.358 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-12T17:13:18.364 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.368 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-12T17:13:18.377 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.377 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.381 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.382 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.386 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:13:18.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T17:13:18.391 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:13:18.407 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-12T17:13:18.411 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-12T17:13:18.411 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:13:18.416 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:13:18.399473Z', 'creation_time': '2024-09-12T17:13:18.395259Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:13:18.416 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-12T17:13:18.422 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:13:18.399473Z', 'creation_time': '2024-09-12T17:13:18.395259Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-12T17:13:18.429 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:13:18.433 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:13:18.399473Z', 'creation_time': '2024-09-12T17:13:18.395259Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-12T17:13:18.434 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-12T17:13:18.438 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000002cdc827fce85ea50-0066e3212e-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:13:18.445 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-12T17:13:18.454 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.455 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-12T17:13:18.468 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:13:18.522 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11'} 2024-09-12T17:13:18.543 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.546 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11'} 2024-09-12T17:13:18.566 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.567 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-12T17:13:18.587 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.599 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-12T17:13:18.612 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:13:18.612 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-12T17:13:18.619 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '8d996106-34ba-42aa-8283-014f90bfb7e7', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'marker': '51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-12T17:13:18.554472Z', 'creation_time': '2024-09-12T17:13:18.395259Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-12T17:14:18.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-12T17:14:18.774 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.774 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-12T17:14:18.803 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.803 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T17:14:18.809 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.809 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-12T17:14:18.814 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.814 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-12T17:14:18.820 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.820 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-12T17:14:18.826 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.826 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-12T17:14:18.831 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-12T17:00:00.000000Z', 'epoch': 1726160400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-12T17:14:18.831 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-12T17:14:18.841 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:18.841 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-12T17:14:18.846 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-12T17:14:18.847 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-12T17:14:18.862 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:14:18.867 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-12T17:14:18.882 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:14:19.273 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T17:14:19.279 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000e0bad83312a85064-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.459 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T17:14:19.465 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T17:14:19.476 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-12T17:14:19.482 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-12T17:14:19.633 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-12T17:14:19.727 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:19.727 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T17:14:19.737 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-12T17:14:19.737 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-12T17:14:19.746 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-12T17:14:19.773 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-12T17:14:19.779 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000b9b7c9063b013b11-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.825 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-12T17:14:19.902 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:19.903 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-12T17:14:19.908 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx0000026a4b01c71ba28ac-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-12T17:14:19.913 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '198a6104-5b15-4a13-a23d-e0904a8cd750'}]}} 2024-09-12T17:14:19.913 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-12T17:14:19.935 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-12T17:14:19.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T17:14:19.940 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:14:19.941 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-12T17:14:19.946 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000700a77e33e618bc8-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.947 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-12T17:14:19.951 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000627825d37217953c-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.975 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T17:14:19.980 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:14:19.980 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-12T17:14:19.985 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e2e5c489aa00e71e-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.985 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-12T17:14:19.990 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bb8eac793982d532-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.990 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-12T17:14:19.995 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-12T17:14:19.996 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-12T17:14:19.999 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000044c9b4d499d85014-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:19.999 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-12T17:14:20.003 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000060eb756c81282285-0066e3216b-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:20.004 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-12T17:14:20.008 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000701aad330e58e4f9-0066e3216c-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:20.008 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-12T17:14:20.012 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000027a0608785c1e99c-0066e3216c-4230-default', 'HostId': '4230-default-default'} 2024-09-12T17:14:20.012 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-12T17:14:20.031 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:20.032 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-12T17:14:20.036 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-12T17:14:20.036 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-12T17:14:20.046 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:20.047 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-12T17:14:20.055 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-12T17:14:20.056 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-12T17:14:20.067 INFO:tasks.radosgw_admin_rest: empty result 2024-09-12T17:14:20.071 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T17:14:20.081 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T17:14:20.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:14:20.082 INFO:tasks.rgw.client.0.smithi193.stdout:2024-09-12T17:14:20.075+0000 7fedde9f2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28974) UID: 0 2024-09-12T17:14:20.083 INFO:tasks.rgw.client.0.smithi193.stdout:2024-09-12T17:14:20.075+0000 7fede223aa40 -1 shutting down 2024-09-12T17:14:50.589 INFO:tasks.rgw.client.0:Stopped 2024-09-12T17:14:50.590 DEBUG:teuthology.orchestra.run.smithi193:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T17:14:50.597 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T17:14:50.653 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T17:14:50.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T17:14:50.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T17:14:50.709 DEBUG:teuthology.orchestra.run.smithi193:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T17:14:50.788 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setuser ceph since I am not root 2024-09-12T17:14:50.788 INFO:teuthology.orchestra.run.smithi193.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T17:14:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe29439c0 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d8affc6350 0x55d8affc8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.790 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe29439c0 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d8afe749c0 con 0x55d8affc2200 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe29439c0 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x55d8afec46d0 con 0x55d8affc6350 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fdfc48640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d8affc6350 0x55d8affc8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fdfc48640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x55d8affc6350 0x55d8affc8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33820/0 (socket says 172.21.15.193:33820) 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fe0449640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x55d8affc2200 0x55d8affc25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.193:53036/0 (socket says 172.21.15.193:53036) 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fdfc48640 1 -- 172.21.15.193:0/3127787810 learned_addr learned my addr 172.21.15.193:0/3127787810 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fdfc48640 1 -- 172.21.15.193:0/3127787810 >> v1:172.21.15.62:6789/0 conn(0x55d8affc2200 legacy=0x55d8affc25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:50.791 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.783+0000 7f8fdfc48640 1 -- 172.21.15.193:0/3127787810 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8afe68ca0 con 0x55d8affc6350 2024-09-12T17:14:50.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/3127787810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc6350 0x55d8affc8740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400a5c0 tx=0x7f8fd401b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d3f34f10c8149a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fdf447640 1 -- 172.21.15.193:0/3127787810 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40a9590 con 0x55d8affc6350 2024-09-12T17:14:50.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fdf447640 1 -- 172.21.15.193:0/3127787810 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd40ae070 con 0x55d8affc6350 2024-09-12T17:14:50.793 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fdf447640 1 -- 172.21.15.193:0/3127787810 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40a9880 con 0x55d8affc6350 2024-09-12T17:14:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3127787810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc6350 msgr2=0x55d8affc8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:50.794 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3127787810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc6350 0x55d8affc8740 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400a5c0 tx=0x7f8fd401b3d0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3127787810 shutdown_connections 2024-09-12T17:14:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3127787810 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc6350 0x55d8affc8740 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3127787810 >> 172.21.15.193:0/3127787810 conn(0x55d8aff35b10 msgr2=0x55d8aff35f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3127787810 shutdown_connections 2024-09-12T17:14:50.796 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.787+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3127787810 wait complete. 2024-09-12T17:14:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.803+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.803+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.803+0000 7f8fe29439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.803+0000 7f8fe29439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d8afec8680 con 0x55d8affc2200 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33832/0 (socket says 172.21.15.193:33832) 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 -- 172.21.15.193:0/1430076814 learned_addr learned my addr 172.21.15.193:0/1430076814 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 -- 172.21.15.193:0/1430076814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8afe43da0 con 0x55d8affc2200 2024-09-12T17:14:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 --2- 172.21.15.193:0/1430076814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001ec0 tx=0x7f8fd000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3920589a14d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8ece60c640 1 -- 172.21.15.193:0/1430076814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd000e5d0 con 0x55d8affc2200 2024-09-12T17:14:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8ece60c640 1 -- 172.21.15.193:0/1430076814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd000e770 con 0x55d8affc2200 2024-09-12T17:14:50.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8ece60c640 1 -- 172.21.15.193:0/1430076814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd000ea70 con 0x55d8affc2200 2024-09-12T17:14:50.821 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- 172.21.15.193:0/1430076814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 msgr2=0x55d8b00ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/1430076814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001ec0 tx=0x7f8fd000b6d0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- 172.21.15.193:0/1430076814 shutdown_connections 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/1430076814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00ad8a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- 172.21.15.193:0/1430076814 >> 172.21.15.193:0/1430076814 conn(0x55d8aff35b10 msgr2=0x55d8b00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- 172.21.15.193:0/1430076814 shutdown_connections 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- 172.21.15.193:0/1430076814 wait complete. 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.822 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe29439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d8afe6aa50 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33836/0 (socket says 172.21.15.193:33836) 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.807+0000 7f8fe0449640 1 -- 172.21.15.193:0/2197380956 learned_addr learned my addr 172.21.15.193:0/2197380956 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe0449640 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b00b54f0 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe0449640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b710 tx=0x7f8fd0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 -- 172.21.15.193:0/2197380956 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd001a7c0 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 -- 172.21.15.193:0/2197380956 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd001a960 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b00b5780 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 -- 172.21.15.193:0/2197380956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd001ac60 con 0x55d8affc2200 2024-09-12T17:14:50.823 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b00b6130 con 0x55d8affc2200 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 -- 172.21.15.193:0/2197380956 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fd0017070 con 0x55d8affc2200 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 0x7f8ec803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8ecce09640 1 -- 172.21.15.193:0/2197380956 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8fd0015020 con 0x55d8affc2200 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 0x7f8ec803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 0x55d8b00bc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00bc640 con 0x55d8affc6350 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 0x55d8b00bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 0x7f8ec803bf80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40ad000 tx=0x7f8fd40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.824 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 0x55d8b00bc100 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.811+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/2197380956 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fd800a4d0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00b6530 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/2197380956 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fd800a4d0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00be3a0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/2197380956 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fd800a4d0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00bd5d0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/2197380956 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fd800a4d0 con 0x55d8affc6350 2024-09-12T17:14:50.825 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00bda20 con 0x55d8affc6350 2024-09-12T17:14:50.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/2197380956 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fd800a4d0 con 0x55d8affc6350 2024-09-12T17:14:50.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.826 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d8afed5450 con 0x55d8b00cc6b0 2024-09-12T17:14:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33846/0 (socket says 172.21.15.193:33846) 2024-09-12T17:14:50.827 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fdfc48640 1 -- 172.21.15.193:0/3457001487 learned_addr learned my addr 172.21.15.193:0/3457001487 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fdfc48640 1 -- 172.21.15.193:0/3457001487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b00cd110 con 0x55d8b00cc6b0 2024-09-12T17:14:50.846 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4019000 tx=0x7f8fd4018170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8ec5ffb640 1 -- 172.21.15.193:0/3457001487 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40b3ba0 con 0x55d8b00cc6b0 2024-09-12T17:14:50.847 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8ec5ffb640 1 -- 172.21.15.193:0/3457001487 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd40b3d40 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b00cd970 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8ec5ffb640 1 -- 172.21.15.193:0/3457001487 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40c8580 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.815+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b00cde80 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ec5ffb640 1 -- 172.21.15.193:0/3457001487 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fd40d1440 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ec5ffb640 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 0x7f8eb803bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ec5ffb640 1 -- 172.21.15.193:0/3457001487 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8fd40ede10 con 0x55d8b00cc6b0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 0x7f8eb803bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.848 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 0x7f8eb803bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55d8b00bd0f0 tx=0x7f8fd8005850 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe29439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fe29439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d8b00ae0f0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33860/0 (socket says 172.21.15.193:33860) 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fdfc48640 1 -- 172.21.15.193:0/2317702096 learned_addr learned my addr 172.21.15.193:0/2317702096 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fdfc48640 1 -- 172.21.15.193:0/2317702096 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b00da8d0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/2317702096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c7bc0 tx=0x7f8fd40c7bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c476ddb19dd143d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ebf7fe640 1 -- 172.21.15.193:0/2317702096 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40e0070 con 0x55d8b00d9ee0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ebf7fe640 1 -- 172.21.15.193:0/2317702096 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd40bf8f0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.849 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.819+0000 7f8ebf7fe640 1 -- 172.21.15.193:0/2317702096 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40bfc50 con 0x55d8b00d9ee0 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2317702096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 msgr2=0x55d8b00da2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2317702096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c7bc0 tx=0x7f8fd40c7bf0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2317702096 shutdown_connections 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2317702096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00da2e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2317702096 >> 172.21.15.193:0/2317702096 conn(0x55d8b00d5300 msgr2=0x55d8b00d3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2317702096 shutdown_connections 2024-09-12T17:14:50.850 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2317702096 wait complete. 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 Processor -- start 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- start start 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55d8b00d8e30 con 0x55d8b00d9ee0 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fdfc48640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.193:33862/0 (socket says 172.21.15.193:33862) 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 learned_addr learned my addr 172.21.15.193:0/953763227 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8b00e09b0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c77f0 tx=0x7f8fd40ec100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8ebdffb640 1 -- 172.21.15.193:0/953763227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40e9070 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8ebdffb640 1 -- 172.21.15.193:0/953763227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd40bd5c0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8b00e0c40 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8ebdffb640 1 -- 172.21.15.193:0/953763227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fd40e0040 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8b00e15f0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.823+0000 7f8ebdffb640 1 -- 172.21.15.193:0/953763227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f8fd40bd8a0 con 0x55d8b00d9ee0 2024-09-12T17:14:50.852 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8ebdffb640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb0039a70 0x7f8eb003bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8ebdffb640 1 -- 172.21.15.193:0/953763227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f8fd40f8a90 con 0x55d8b00d9ee0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb0039a70 0x7f8eb003bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8b00eb7a0 0x55d8b00edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00ee380 con 0x55d8b00eb7a0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8b00eb7a0 0x55d8b00edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb0039a70 0x7f8eb003bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d8b00b6470 tx=0x7f8fd801f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8b00eb7a0 0x55d8b00edc30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 realm 2024-09-12T17:14:50.853 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00ee790 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00ef060 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00ef400 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:50.854 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:5 5.18 5:1ca439bd:::zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00efc50 con 0x55d8b00eb7a0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 5 ==== osd_op_reply(5 zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 20 searching for the correct realm 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d8b00f19c0 0x55d8b00f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d8b00f19c0 0x55d8b00f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d8b00f19c0 0x55d8b00f3db0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.855 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fdfc48640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8fd4009040 0x7f8fd40e6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8fd4009040 0x7f8fd40e6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.827+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8fd4009040 0x7f8fd40e6a70 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0c4a640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8fd8031040 0x7f8fd8032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8fd8031040 0x7f8fd8032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8fd8031040 0x7f8fd8032430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 6 ==== osd_op_reply(9 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.856 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 7 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.831+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=112b] v25'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.857 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=79b] v25'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.835+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.858 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.859 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.860 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.839+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00f19c0 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.866 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd8031040 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f42f0 con 0x7f8fd4009040 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fd801f070 con 0x7f8fd4009040 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got zone_info.51a3b7d9-97a7-414a-8656-afb65faf6acb 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got period_config.default 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.867 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f0530 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f0dd0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:40 5.12 5:4d82e466:::zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f4720 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 16 ==== osd_op_reply(40 zonegroup_info.8d996106-34ba-42aa-8283-014f90bfb7e7 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 zone default found 2024-09-12T17:14:50.868 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 4 Realm: () 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 4 ZoneGroup: default (8d996106-34ba-42aa-8283-014f90bfb7e7) 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 4 Zone: default (51a3b7d9-97a7-414a-8656-afb65faf6acb) 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 zonegroup default 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.843+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f4720 con 0x7f8fd8031040 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f6630 con 0x55d8b00f19c0 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.869 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 rados->read ofs=0 len=0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f6f50 con 0x55d8b00f19c0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 started sync module instance, tier type = 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 20 started zone id=51a3b7d9-97a7-414a-8656-afb65faf6acb (name=default) with tier type = 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f59d0 con 0x7f8fd4009040 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 7 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94389155091744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f72f0 con 0x7f8fd4009040 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.847+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f7b40 con 0x55d8b00eb7a0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.851+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94389155091744] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.851+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 17 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.851+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94389155099376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f7bc0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.851+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f8450 con 0x55d8b00f19c0 2024-09-12T17:14:50.870 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.851+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94389155099376] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94389155100704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f8840 con 0x55d8b00f19c0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f9200 con 0x7f8fd4009040 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 9 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94389155106400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f98f0 con 0x7f8fd4009040 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fa410 con 0x55d8b00eb7a0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94389155100704] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94389155106400] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 19 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94389155110624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fa3d0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.855+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00facb0 con 0x7f8fd8031040 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.859+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94389155110624] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.871 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.859+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 11 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.859+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94389155101824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fa880 con 0x7f8fd8031040 2024-09-12T17:14:50.872 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.859+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb130 con 0x7f8fd8031040 2024-09-12T17:14:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 12 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94389155113088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb710 con 0x7f8fd8031040 2024-09-12T17:14:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fbfc0 con 0x7f8fd8031040 2024-09-12T17:14:50.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94389155101824] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94389155113088] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 15 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94389155111888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb710 con 0x7f8fd8031040 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=0 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=1 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=2 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=3 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=4 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=5 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.863+0000 7f8fe29439c0 20 add_watcher() i=6 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94389155111888] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.874 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 20 add_watcher() i=7 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 2 all 8 watchers are set, enabling cache 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00ff0c0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94389155115616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fc540 con 0x55d8b00eb7a0 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94389155115616] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8e967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:50.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T17:14:50.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T17:14:50.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.867+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01076b0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.871+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.876 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.871+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0107b60 con 0x7f8fd8031040 2024-09-12T17:14:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0107b60 con 0x55d8b00f19c0 2024-09-12T17:14:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0107f60 con 0x55d8b00eb7a0 2024-09-12T17:14:50.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.882 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.875+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0107f40 con 0x7f8fd4009040 2024-09-12T17:14:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.879+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'85 uv52 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.879+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108590 con 0x55d8b00f19c0 2024-09-12T17:14:50.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.879+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'56 uv37 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.879+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108930 con 0x55d8b00eb7a0 2024-09-12T17:14:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.879+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.886 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.883+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108930 con 0x7f8fd8031040 2024-09-12T17:14:50.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.883+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.883+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108930 con 0x7f8fd4009040 2024-09-12T17:14:50.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108ea0 con 0x55d8b00f19c0 2024-09-12T17:14:50.892 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.893 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0108f30 con 0x7f8fd4009040 2024-09-12T17:14:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'86 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.894 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.887+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01094a0 con 0x7f8fd8031040 2024-09-12T17:14:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.891+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.896 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.891+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01094a0 con 0x7f8fd4009040 2024-09-12T17:14:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.891+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.891+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd8031040 2024-09-12T17:14:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.895+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.895+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00eb7a0 2024-09-12T17:14:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.895+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'278 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.902 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.895+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.899+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.904 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.899+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd4009040 2024-09-12T17:14:50.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.899+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'87 uv56 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.899+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.903+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.903+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00eb7a0 2024-09-12T17:14:50.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.903+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.903+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00eb7a0 2024-09-12T17:14:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.907+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'279 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.913 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.907+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.907+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.914 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.911+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd4009040 2024-09-12T17:14:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.911+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.916 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.911+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.911+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.918 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.911+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.915+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.920 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.915+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.915+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.922 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.915+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.919+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'57 uv35 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.924 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.919+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd8031040 2024-09-12T17:14:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.923+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.927 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.923+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.923+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'34 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.929 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.923+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd8031040 2024-09-12T17:14:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.927+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.932 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.927+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x55d8b00f19c0 2024-09-12T17:14:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.927+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.927+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd8031040 2024-09-12T17:14:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.931+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.931+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0109950 con 0x7f8fd4009040 2024-09-12T17:14:50.940 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8e957e2640 20 reqs_thread_entry: start 2024-09-12T17:14:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8fe29439c0 20 init_complete bucket index max shards: 11 2024-09-12T17:14:50.941 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8fe29439c0 20 Filter name: none 2024-09-12T17:14:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8e06ffd640 20 reqs_thread_entry: start 2024-09-12T17:14:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T17:14:50.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.935+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:94 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 26 ==== osd_op_reply(94 gc.27 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.943 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:95 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 27 ==== osd_op_reply(95 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:96 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 28 ==== osd_op_reply(96 gc.27 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.944 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:97 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 29 ==== osd_op_reply(97 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.945 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:98 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 30 ==== osd_op_reply(98 gc.27 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.946 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.939+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:99 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 31 ==== osd_op_reply(99 gc.27 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T17:14:50.947 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:100 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 24 ==== osd_op_reply(100 gc.28 [call] v34'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.949 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:101 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 25 ==== osd_op_reply(101 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.950 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.943+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:102 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 26 ==== osd_op_reply(102 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:103 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.951 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 27 ==== osd_op_reply(103 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:104 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.952 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 28 ==== osd_op_reply(104 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.953 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.947+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:105 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 29 ==== osd_op_reply(105 gc.28 [call] v34'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T17:14:50.955 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:106 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.957 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 32 ==== osd_op_reply(106 gc.29 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.958 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:107 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 33 ==== osd_op_reply(107 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:108 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.959 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.951+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 34 ==== osd_op_reply(108 gc.29 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:109 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 35 ==== osd_op_reply(109 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:110 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 36 ==== osd_op_reply(110 gc.29 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.960 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:111 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x55d8b00f19c0 2024-09-12T17:14:50.961 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 37 ==== osd_op_reply(111 gc.29 [call] v34'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T17:14:50.962 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.955+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:112 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.959+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 30 ==== osd_op_reply(112 gc.30 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.964 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.959+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:113 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.965 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.959+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 31 ==== osd_op_reply(113 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.959+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.959+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:114 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 32 ==== osd_op_reply(114 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.966 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:115 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 33 ==== osd_op_reply(115 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.968 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:116 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 34 ==== osd_op_reply(116 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.969 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.963+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:117 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd8031040 2024-09-12T17:14:50.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.967+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 35 ==== osd_op_reply(117 gc.30 [call] v34'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:50.971 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.967+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T17:14:50.972 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.967+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:118 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd4009040 2024-09-12T17:14:50.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.967+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 18 ==== osd_op_reply(118 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.974 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.967+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:119 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd4009040 2024-09-12T17:14:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 19 ==== osd_op_reply(119 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:120 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0124ab0 con 0x7f8fd4009040 2024-09-12T17:14:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 20 ==== osd_op_reply(120 gc.31 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.975 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:121 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd4009040 2024-09-12T17:14:50.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 21 ==== osd_op_reply(121 gc.31 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.976 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:122 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0125ac0 con 0x7f8fd4009040 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 22 ==== osd_op_reply(122 gc.31 [call out=1714b] v0'0 uv39 ondisk = 0) ==== 149+0+1714 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 20 garbage collection: RGWGC::process iterating over entry tag='51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.776374040453162198', time=2024-09-12T17:14:34.270040+0000, chain.objs.size()=7 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_1 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:123 3.10s0 3:0ab930c9:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106820 con 0x55d8b00eb7a0 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_2 2024-09-12T17:14:50.978 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:124 3.30s0 3:0ee3d6f0:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0128fa0 con 0x55d8b00f19c0 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_3 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:125 3.14s0 3:2957a972:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012ba90 con 0x55d8b00f19c0 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_4 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:126 3.15s0 3:aa2469de:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012e3a0 con 0x7f8fd4009040 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_5 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:127 3.5s0 3:a3f057a9:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0130c60 con 0x7f8fd4009040 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_6 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:128 3.2as0 3:55ece6ac:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012e3a0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_7 2024-09-12T17:14:50.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.971+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:129 3.37s0 3:ec996737:::51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0130c60 con 0x55d8b00eb7a0 2024-09-12T17:14:50.982 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 29 ==== osd_op_reply(123 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_1 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 30 ==== osd_op_reply(129 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_7 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.983 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 38 ==== osd_op_reply(124 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 39 ==== osd_op_reply(125 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_3 [call] v34'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:50.985 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 23 ==== osd_op_reply(126 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.979+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 24 ==== osd_op_reply(127 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.983+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 31 ==== osd_op_reply(128 51a3b7d9-97a7-414a-8656-afb65faf6acb.4230.11__shadow_.d0HjPig3KEv6vxPcoOwy-O09EqhpcR5_6 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.983+0000 7f8fe29439c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T17:14:50.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.983+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:130 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106200 con 0x7f8fd4009040 2024-09-12T17:14:50.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.983+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 25 ==== osd_op_reply(130 gc.31 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.990 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.983+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:131 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106200 con 0x7f8fd4009040 2024-09-12T17:14:50.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.987+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 26 ==== osd_op_reply(131 gc.31 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:50.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.987+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T17:14:50.992 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.987+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:132 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106200 con 0x55d8b00eb7a0 2024-09-12T17:14:50.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.987+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 32 ==== osd_op_reply(132 gc.0 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.987+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:133 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106200 con 0x55d8b00eb7a0 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 33 ==== osd_op_reply(133 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:134 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b0106200 con 0x55d8b00eb7a0 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 34 ==== osd_op_reply(134 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:135 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.996 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 35 ==== osd_op_reply(135 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:136 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 36 ==== osd_op_reply(136 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:50.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:137 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00eb7a0 2024-09-12T17:14:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 37 ==== osd_op_reply(137 gc.0 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T17:14:50.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.991+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:138 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 36 ==== osd_op_reply(138 gc.1 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.000 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:139 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 37 ==== osd_op_reply(139 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.001 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:140 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 38 ==== osd_op_reply(140 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.002 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.995+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:141 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 39 ==== osd_op_reply(141 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:142 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 40 ==== osd_op_reply(142 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:50.999+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:143 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 41 ==== osd_op_reply(143 gc.1 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T17:14:51.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:144 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 40 ==== osd_op_reply(144 gc.2 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:145 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 41 ==== osd_op_reply(145 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:146 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 42 ==== osd_op_reply(146 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.003+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:147 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 43 ==== osd_op_reply(147 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:148 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 44 ==== osd_op_reply(148 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:149 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 45 ==== osd_op_reply(149 gc.2 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T17:14:51.013 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.007+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:150 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 38 ==== osd_op_reply(150 gc.3 [call] v34'280 uv280 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:151 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 39 ==== osd_op_reply(151 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.016 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:152 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b510 con 0x55d8b00eb7a0 2024-09-12T17:14:51.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 40 ==== osd_op_reply(152 gc.3 [call out=24b] v0'0 uv280 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:153 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b510 con 0x55d8b00eb7a0 2024-09-12T17:14:51.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 41 ==== osd_op_reply(153 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.017 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:154 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 42 ==== osd_op_reply(154 gc.3 [call out=15b] v0'0 uv280 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.018 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.011+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:155 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 43 ==== osd_op_reply(155 gc.3 [call] v34'281 uv281 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T17:14:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:156 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 27 ==== osd_op_reply(156 gc.4 [call] v34'88 uv88 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:157 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 28 ==== osd_op_reply(157 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:158 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b510 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 29 ==== osd_op_reply(158 gc.4 [call out=24b] v0'0 uv88 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:159 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 30 ==== osd_op_reply(159 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.015+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:160 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.023 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 31 ==== osd_op_reply(160 gc.4 [call out=15b] v0'0 uv88 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:161 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 32 ==== osd_op_reply(161 gc.4 [call] v34'89 uv89 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T17:14:51.024 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:162 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 46 ==== osd_op_reply(162 gc.5 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.026 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.019+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:163 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 47 ==== osd_op_reply(163 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.027 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:164 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 48 ==== osd_op_reply(164 gc.5 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.028 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:165 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.029 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 49 ==== osd_op_reply(165 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:166 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 50 ==== osd_op_reply(166 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.030 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:167 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 51 ==== osd_op_reply(167 gc.5 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T17:14:51.031 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.023+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:168 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 44 ==== osd_op_reply(168 gc.6 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.033 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:169 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 45 ==== osd_op_reply(169 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:170 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00eb7a0 2024-09-12T17:14:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 46 ==== osd_op_reply(170 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.034 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:171 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 47 ==== osd_op_reply(171 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.027+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:172 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 48 ==== osd_op_reply(172 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.035 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:173 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 49 ==== osd_op_reply(173 gc.6 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T17:14:51.037 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.031+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:174 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 42 ==== osd_op_reply(174 gc.7 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:175 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.040 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 43 ==== osd_op_reply(175 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:176 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd8031040 2024-09-12T17:14:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 44 ==== osd_op_reply(176 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.041 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:177 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 45 ==== osd_op_reply(177 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.042 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.035+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:178 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 46 ==== osd_op_reply(178 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.043 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:179 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 47 ==== osd_op_reply(179 gc.7 [call] v34'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T17:14:51.045 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.039+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:180 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 33 ==== osd_op_reply(180 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.048 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:181 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 34 ==== osd_op_reply(181 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.049 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:182 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd4009040 2024-09-12T17:14:51.050 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 35 ==== osd_op_reply(182 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:183 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 36 ==== osd_op_reply(183 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:184 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 37 ==== osd_op_reply(184 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.051 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.043+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:185 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 38 ==== osd_op_reply(185 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T17:14:51.052 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:186 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 52 ==== osd_op_reply(186 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.054 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:187 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.055 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 53 ==== osd_op_reply(187 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.047+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:188 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 54 ==== osd_op_reply(188 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:189 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 55 ==== osd_op_reply(189 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:190 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 56 ==== osd_op_reply(190 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.056 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:191 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 57 ==== osd_op_reply(191 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T17:14:51.057 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.051+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:192 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.059 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 39 ==== osd_op_reply(192 gc.10 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:193 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 40 ==== osd_op_reply(193 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:194 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b530 con 0x7f8fd4009040 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 41 ==== osd_op_reply(194 gc.10 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.060 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:195 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 42 ==== osd_op_reply(195 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:196 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 43 ==== osd_op_reply(196 gc.10 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.061 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:197 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 44 ==== osd_op_reply(197 gc.10 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T17:14:51.062 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.055+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:198 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.059+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 48 ==== osd_op_reply(198 gc.11 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.065 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.059+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:199 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.059+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 49 ==== osd_op_reply(199 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.066 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.059+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.059+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:200 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b530 con 0x7f8fd8031040 2024-09-12T17:14:51.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 50 ==== osd_op_reply(200 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.067 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:201 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 51 ==== osd_op_reply(201 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.068 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:202 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 52 ==== osd_op_reply(202 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.069 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.063+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:203 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.067+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 53 ==== osd_op_reply(203 gc.11 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.067+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T17:14:51.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.067+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:204 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.067+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 45 ==== osd_op_reply(204 gc.12 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.067+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:205 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 46 ==== osd_op_reply(205 gc.12 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:206 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b530 con 0x7f8fd4009040 2024-09-12T17:14:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 47 ==== osd_op_reply(206 gc.12 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.075 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:207 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 48 ==== osd_op_reply(207 gc.12 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:208 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 49 ==== osd_op_reply(208 gc.12 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:209 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.077 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 50 ==== osd_op_reply(209 gc.12 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T17:14:51.078 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.071+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:210 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.075+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 54 ==== osd_op_reply(210 gc.13 [call] v34'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.075+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:211 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.075+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 55 ==== osd_op_reply(211 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.075+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.082 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.075+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:212 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b530 con 0x7f8fd8031040 2024-09-12T17:14:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 56 ==== osd_op_reply(212 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:213 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.083 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 57 ==== osd_op_reply(213 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:214 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 58 ==== osd_op_reply(214 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.079+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:215 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.083+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 59 ==== osd_op_reply(215 gc.13 [call] v34'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.083+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T17:14:51.088 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.083+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:216 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.083+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 50 ==== osd_op_reply(216 gc.14 [call] v34'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.090 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.083+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:217 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 51 ==== osd_op_reply(217 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.091 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:218 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b530 con 0x55d8b00eb7a0 2024-09-12T17:14:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 52 ==== osd_op_reply(218 gc.14 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.092 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:219 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 53 ==== osd_op_reply(219 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.093 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:220 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 54 ==== osd_op_reply(220 gc.14 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.087+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:221 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.091+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 55 ==== osd_op_reply(221 gc.14 [call] v34'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.091+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T17:14:51.096 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.091+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:222 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 58 ==== osd_op_reply(222 gc.15 [call] v34'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.099 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:223 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 59 ==== osd_op_reply(223 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:224 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 60 ==== osd_op_reply(224 gc.15 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.100 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:225 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 61 ==== osd_op_reply(225 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.101 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:226 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 62 ==== osd_op_reply(226 gc.15 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.102 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.095+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:227 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.099+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 63 ==== osd_op_reply(227 gc.15 [call] v34'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.099+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T17:14:51.105 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.099+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:228 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 51 ==== osd_op_reply(228 gc.16 [call] v34'92 uv92 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:229 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 52 ==== osd_op_reply(229 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:230 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd4009040 2024-09-12T17:14:51.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 53 ==== osd_op_reply(230 gc.16 [call out=24b] v0'0 uv92 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:231 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 54 ==== osd_op_reply(231 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.103+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:232 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 55 ==== osd_op_reply(232 gc.16 [call out=15b] v0'0 uv92 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:233 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 56 ==== osd_op_reply(233 gc.16 [call] v34'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T17:14:51.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.107+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:234 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 64 ==== osd_op_reply(234 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.116 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:235 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 65 ==== osd_op_reply(235 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:236 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.117 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 66 ==== osd_op_reply(236 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.118 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.111+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:237 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 67 ==== osd_op_reply(237 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:238 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 68 ==== osd_op_reply(238 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.119 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:239 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 69 ==== osd_op_reply(239 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T17:14:51.122 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.115+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:240 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 56 ==== osd_op_reply(240 gc.18 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.125 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:241 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 57 ==== osd_op_reply(241 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:242 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00eb7a0 2024-09-12T17:14:51.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 58 ==== osd_op_reply(242 gc.18 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.126 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.119+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:243 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 59 ==== osd_op_reply(243 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.127 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:244 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 60 ==== osd_op_reply(244 gc.18 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.128 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:245 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 61 ==== osd_op_reply(245 gc.18 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T17:14:51.131 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.123+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:246 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 62 ==== osd_op_reply(246 gc.19 [call] v34'284 uv284 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:247 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 63 ==== osd_op_reply(247 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.133 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:248 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00eb7a0 2024-09-12T17:14:51.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 64 ==== osd_op_reply(248 gc.19 [call out=24b] v0'0 uv284 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.134 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.127+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:249 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00eb7a0 2024-09-12T17:14:51.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 65 ==== osd_op_reply(249 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:250 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x55d8b00eb7a0 2024-09-12T17:14:51.135 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 66 ==== osd_op_reply(250 gc.19 [call out=15b] v0'0 uv284 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.136 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:251 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00eb7a0 2024-09-12T17:14:51.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 67 ==== osd_op_reply(251 gc.19 [call] v34'285 uv285 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T17:14:51.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.131+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:252 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 70 ==== osd_op_reply(252 gc.20 [call] v34'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:253 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 71 ==== osd_op_reply(253 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:254 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 72 ==== osd_op_reply(254 gc.20 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:255 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.135+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 73 ==== osd_op_reply(255 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:256 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 74 ==== osd_op_reply(256 gc.20 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.143 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:257 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 75 ==== osd_op_reply(257 gc.20 [call] v34'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T17:14:51.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.139+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:258 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 57 ==== osd_op_reply(258 gc.21 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:259 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.149 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 58 ==== osd_op_reply(259 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:260 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x7f8fd4009040 2024-09-12T17:14:51.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 59 ==== osd_op_reply(260 gc.21 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.150 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.143+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:261 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 60 ==== osd_op_reply(261 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:262 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.151 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 61 ==== osd_op_reply(262 gc.21 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.152 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:263 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd4009040 2024-09-12T17:14:51.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 62 ==== osd_op_reply(263 gc.21 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T17:14:51.154 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.147+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:264 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 76 ==== osd_op_reply(264 gc.22 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.156 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:265 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 77 ==== osd_op_reply(265 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.157 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:266 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 78 ==== osd_op_reply(266 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:267 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.158 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 79 ==== osd_op_reply(267 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.151+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:268 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 80 ==== osd_op_reply(268 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.159 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:269 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.161 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 81 ==== osd_op_reply(269 gc.22 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T17:14:51.162 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.155+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:270 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 82 ==== osd_op_reply(270 gc.23 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:271 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.164 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 83 ==== osd_op_reply(271 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:272 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 84 ==== osd_op_reply(272 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.165 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:273 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 85 ==== osd_op_reply(273 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:274 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 86 ==== osd_op_reply(274 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.166 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.159+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:275 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.163+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 87 ==== osd_op_reply(275 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.163+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T17:14:51.169 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.163+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:276 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 88 ==== osd_op_reply(276 gc.24 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:277 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.171 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 89 ==== osd_op_reply(277 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:278 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 90 ==== osd_op_reply(278 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.172 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:279 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 91 ==== osd_op_reply(279 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:280 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.173 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 92 ==== osd_op_reply(280 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.174 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.167+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:281 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.171+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 93 ==== osd_op_reply(281 gc.24 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.171+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T17:14:51.176 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.171+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:282 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.171+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 94 ==== osd_op_reply(282 gc.25 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.178 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.171+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:283 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 95 ==== osd_op_reply(283 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:284 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b01061d0 con 0x55d8b00f19c0 2024-09-12T17:14:51.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 96 ==== osd_op_reply(284 gc.25 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.179 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:285 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 97 ==== osd_op_reply(285 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.180 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:286 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 98 ==== osd_op_reply(286 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.181 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.175+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:287 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x55d8b00f19c0 2024-09-12T17:14:51.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.179+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 99 ==== osd_op_reply(287 gc.25 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.179+0000 7f8fe29439c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T17:14:51.183 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.179+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:288 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.179+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 60 ==== osd_op_reply(288 gc.26 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.179+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:289 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 61 ==== osd_op_reply(289 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.187 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.188 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:290 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x7f8fd8031040 2024-09-12T17:14:51.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 62 ==== osd_op_reply(290 gc.26 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.189 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:291 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x7f8fd8031040 2024-09-12T17:14:51.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 63 ==== osd_op_reply(291 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T17:14:51.190 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.183+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:292 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012a110 con 0x7f8fd8031040 2024-09-12T17:14:51.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.187+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 64 ==== osd_op_reply(292 gc.26 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.187+0000 7f8fe29439c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T17:14:51.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.187+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:293 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b120 con 0x7f8fd8031040 2024-09-12T17:14:51.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.191+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 65 ==== osd_op_reply(293 gc.26 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.191+0000 7f8e967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T17:14:51.197 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.191+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94389155115616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b012b510 con 0x55d8b00eb7a0 2024-09-12T17:14:51.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94389155115616] v34'286 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94389155091744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb260 con 0x7f8fd4009040 2024-09-12T17:14:51.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94389155091744] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe29439c0 20 remove_watcher() i=0 2024-09-12T17:14:51.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe29439c0 2 removed watcher, disabling cache 2024-09-12T17:14:51.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.195+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94389155099376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb260 con 0x55d8b00eb7a0 2024-09-12T17:14:51.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.199+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94389155099376] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.199+0000 7f8fe29439c0 20 remove_watcher() i=1 2024-09-12T17:14:51.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.199+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94389155100704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f72f0 con 0x55d8b00f19c0 2024-09-12T17:14:51.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fdfc48640 1 -- 172.21.15.193:0/953763227 <== osd.3 v2:172.21.15.193:6816/1944991354 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94389155100704] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd40eb030 con 0x55d8b00f19c0 2024-09-12T17:14:51.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fe29439c0 20 remove_watcher() i=2 2024-09-12T17:14:51.207 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94389155106400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb260 con 0x7f8fd4009040 2024-09-12T17:14:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fe0c4a640 1 -- 172.21.15.193:0/953763227 <== osd.2 v2:172.21.15.193:6800/1491583795 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94389155106400] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd8040040 con 0x7f8fd4009040 2024-09-12T17:14:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fe29439c0 20 remove_watcher() i=3 2024-09-12T17:14:51.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.203+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94389155110624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f72f0 con 0x55d8b00eb7a0 2024-09-12T17:14:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.207+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.1 v2:172.21.15.193:6808/1040547927 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94389155110624] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x55d8b00eb7a0 2024-09-12T17:14:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.207+0000 7f8fe29439c0 20 remove_watcher() i=4 2024-09-12T17:14:51.212 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.207+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94389155101824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f8e60 con 0x7f8fd8031040 2024-09-12T17:14:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94389155101824] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe29439c0 20 remove_watcher() i=5 2024-09-12T17:14:51.215 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94389155113088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00fb260 con 0x7f8fd8031040 2024-09-12T17:14:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94389155113088] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe29439c0 20 remove_watcher() i=6 2024-09-12T17:14:51.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.211+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94389155111888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d8b00f72f0 con 0x7f8fd8031040 2024-09-12T17:14:51.220 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 <== osd.0 v2:172.21.15.62:6800/4046570222 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94389155111888] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fd002e070 con 0x7f8fd8031040 2024-09-12T17:14:51.221 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 20 remove_watcher() i=7 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8fd8031040 msgr2=0x7f8fd8032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f8fd8031040 0x7f8fd8032430 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8b00eb7a0 msgr2=0x55d8b00edc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8b00eb7a0 0x55d8b00edc30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8fd4009040 msgr2=0x7f8fd40e6a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f8fd4009040 0x7f8fd40e6a70 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d8b00f19c0 msgr2=0x55d8b00f3db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x55d8b00f19c0 0x55d8b00f3db0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb0039a70 msgr2=0x7f8eb003bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb0039a70 0x7f8eb003bf30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x55d8b00b6470 tx=0x7f8fd801f000 comp rx=0 tx=0).stop 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 msgr2=0x55d8b00e0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe0449640 1 -- 172.21.15.193:0/953763227 reap_dead start 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40c77f0 tx=0x7f8fd40ec100 comp rx=0 tx=0).stop 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 shutdown_connections 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/953763227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00d9ee0 0x55d8b00e0450 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 >> 172.21.15.193:0/953763227 conn(0x55d8b00d5300 msgr2=0x55d8b00d3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 shutdown_connections 2024-09-12T17:14:51.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.215+0000 7f8fe29439c0 1 -- 172.21.15.193:0/953763227 wait complete. 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 msgr2=0x7f8eb803bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 0x7f8eb803bf30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55d8b00bd0f0 tx=0x7f8fd8005850 comp rx=0 tx=0).stop 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 msgr2=0x55d8b00ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4019000 tx=0x7f8fd4018170 comp rx=0 tx=0).stop 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 shutdown_connections 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8eb8039a70 0x7f8eb803bf30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/3457001487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8b00cc6b0 0x55d8b00ccad0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 >> 172.21.15.193:0/3457001487 conn(0x55d8b00c2060 msgr2=0x55d8b00c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 shutdown_connections 2024-09-12T17:14:51.225 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/3457001487 wait complete. 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 msgr2=0x55d8b00bc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 0x55d8b00bc100 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 msgr2=0x7f8ec803bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 0x7f8ec803bf80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8fd40ad000 tx=0x7f8fd40a6000 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 msgr2=0x55d8b00b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000b710 tx=0x7f8fd0000bd0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 shutdown_connections 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x55d8affc6350 0x55d8b00bc100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f8ec8039ac0 0x7f8ec803bf80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 --2- 172.21.15.193:0/2197380956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55d8affc2200 0x55d8b00b4f90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 >> 172.21.15.193:0/2197380956 conn(0x55d8aff35b10 msgr2=0x55d8b00a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 shutdown_connections 2024-09-12T17:14:51.226 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-12T17:14:51.219+0000 7f8fe29439c0 1 -- 172.21.15.193:0/2197380956 wait complete. 2024-09-12T17:14:51.243 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T17:14:51.253 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:14:51.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:14:51.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f511843c640 1 Processor -- start 2024-09-12T17:14:51.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f511843c640 1 -- start start 2024-09-12T17:14:51.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f511843c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5110132420 0x7f5110134810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f511843c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511012b9d0 con 0x7f511012aee0 2024-09-12T17:14:51.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f511843c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5110071e70 con 0x7f5110132420 2024-09-12T17:14:51.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51161d8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f511012aee0 0x7f511012b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41752/0 (socket says 172.21.15.62:41752) 2024-09-12T17:14:51.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51161d8640 1 -- 172.21.15.62:0/1868588615 learned_addr learned my addr 172.21.15.62:0/1868588615 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51159d7640 1 --2- 172.21.15.62:0/1868588615 >> v2:172.21.15.62:3300/0 conn(0x7f5110132420 0x7f5110134810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993158806 0 0) 0x7f511012b9d0 con 0x7f511012aee0 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50fc003530 con 0x7f511012aee0 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51159d7640 1 -- 172.21.15.62:0/1868588615 >> v1:172.21.15.62:6789/0 conn(0x7f511012aee0 legacy=0x7f511012b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2641784221 0 0) 0x7f50fc003530 con 0x7f511012aee0 2024-09-12T17:14:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.383+0000 7f51159d7640 1 -- 172.21.15.62:0/1868588615 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100008e0 con 0x7f5110132420 2024-09-12T17:14:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51159d7640 1 --2- 172.21.15.62:0/1868588615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5110132420 0x7f5110134810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5100009740 tx=0x7f510001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db103bfe21680443 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51000b0070 con 0x7f5110132420 2024-09-12T17:14:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51000ab400 con 0x7f5110132420 2024-09-12T17:14:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51151d6640 1 -- 172.21.15.62:0/1868588615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c001630 con 0x7f5110132420 2024-09-12T17:14:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/1868588615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5110132420 msgr2=0x7f5110134810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 --2- 172.21.15.62:0/1868588615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5110132420 0x7f5110134810 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5100009740 tx=0x7f510001c290 comp rx=0 tx=0).stop 2024-09-12T17:14:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/1868588615 shutdown_connections 2024-09-12T17:14:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 --2- 172.21.15.62:0/1868588615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5110132420 0x7f5110134810 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/1868588615 >> 172.21.15.62:0/1868588615 conn(0x7f51100a0a60 msgr2=0x7f511006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/1868588615 shutdown_connections 2024-09-12T17:14:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/1868588615 wait complete. 2024-09-12T17:14:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 Processor -- start 2024-09-12T17:14:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- start start 2024-09-12T17:14:51.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f51101376f0 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51161d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51161d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49038/0 (socket says 172.21.15.62:49038) 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51161d8640 1 -- 172.21.15.62:0/2572274487 learned_addr learned my addr 172.21.15.62:0/2572274487 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51161d8640 1 -- 172.21.15.62:0/2572274487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511011ce20 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f51161d8640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f510c0017a0 tx=0x7f510c00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c005a10 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c005bb0 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f511011b820 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c007070 con 0x7f511012aee0 2024-09-12T17:14:51.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.387+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5110129a90 con 0x7f511012aee0 2024-09-12T17:14:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f511011be20 con 0x7f511012aee0 2024-09-12T17:14:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f510c007210 con 0x7f511012aee0 2024-09-12T17:14:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f5106ffd640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 0x7f50f403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f510c04f490 con 0x7f511012aee0 2024-09-12T17:14:51.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f51159d7640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 0x7f50f403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.391+0000 7f51159d7640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 0x7f50f403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f51000ad000 tx=0x7f5100008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.395+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f510c0076e0 con 0x7f511012aee0 2024-09-12T17:14:51.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.563+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5110073a80 con 0x7f50f403b1d0 2024-09-12T17:14:51.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.595+0000 7f5106ffd640 1 -- 172.21.15.62:0/2572274487 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665804 (secure 0 0 0) 0x7f51000b1040 con 0x7f50f403b1d0 2024-09-12T17:14:51.607 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:14:51.614 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 msgr2=0x7f50f403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 0x7f50f403d690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f51000ad000 tx=0x7f5100008040 comp rx=0 tx=0).stop 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 msgr2=0x7f5110129550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f510c0017a0 tx=0x7f510c00cb30 comp rx=0 tx=0).stop 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 shutdown_connections 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f50f403b1d0 0x7f50f403d690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 --2- 172.21.15.62:0/2572274487 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f511012aee0 0x7f5110129550 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 >> 172.21.15.62:0/2572274487 conn(0x7f51100a0a60 msgr2=0x7f51100a10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 shutdown_connections 2024-09-12T17:14:51.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.603+0000 7f511843c640 1 -- 172.21.15.62:0/2572274487 wait complete. 2024-09-12T17:14:51.630 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T17:14:50.776568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412815,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4932,"num_read_kb":4514,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190428,"kb_used_data":40732,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296932,"statfs":{"total":386547056640,"available":386352058368,"internally_reserved":0,"allocated":41709568,"data_stored":40506410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006211"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795920+0000","last_change":"2024-09-12T17:11:04.687200+0000","last_active":"2024-09-12T17:11:43.795920+0000","last_peered":"2024-09-12T17:11:43.795920+0000","last_clean":"2024-09-12T17:11:43.795920+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:11:43.795920+0000","last_undegraded":"2024-09-12T17:11:43.795920+0000","last_fullsized":"2024-09-12T17:11:43.795920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:17.379528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'11","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.875621+0000","last_change":"2024-09-12T17:11:06.702423+0000","last_active":"2024-09-12T17:14:19.875621+0000","last_peered":"2024-09-12T17:14:19.875621+0000","last_clean":"2024-09-12T17:14:19.875621+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:14:19.875621+0000","last_undegraded":"2024-09-12T17:14:19.875621+0000","last_fullsized":"2024-09-12T17:14:19.875621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:45.099418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803085+0000","last_change":"2024-09-12T17:11:04.679163+0000","last_active":"2024-09-12T17:11:43.803085+0000","last_peered":"2024-09-12T17:11:43.803085+0000","last_clean":"2024-09-12T17:11:43.803085+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:11:43.803085+0000","last_undegraded":"2024-09-12T17:11:43.803085+0000","last_fullsized":"2024-09-12T17:11:43.803085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:05.288043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255203+0000","last_change":"2024-09-12T17:11:04.706028+0000","last_active":"2024-09-12T17:11:49.255203+0000","last_peered":"2024-09-12T17:11:49.255203+0000","last_clean":"2024-09-12T17:11:49.255203+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:11:49.255203+0000","last_undegraded":"2024-09-12T17:11:49.255203+0000","last_fullsized":"2024-09-12T17:11:49.255203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:14.130896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794976+0000","last_change":"2024-09-12T17:11:04.672236+0000","last_active":"2024-09-12T17:11:43.794976+0000","last_peered":"2024-09-12T17:11:43.794976+0000","last_clean":"2024-09-12T17:11:43.794976+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:11:43.794976+0000","last_undegraded":"2024-09-12T17:11:43.794976+0000","last_fullsized":"2024-09-12T17:11:43.794976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:53.845369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:47.737476+0000","last_change":"2024-09-12T17:11:43.812377+0000","last_active":"2024-09-12T17:11:47.737476+0000","last_peered":"2024-09-12T17:11:47.737476+0000","last_clean":"2024-09-12T17:11:47.737476+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:11:47.737476+0000","last_undegraded":"2024-09-12T17:11:47.737476+0000","last_fullsized":"2024-09-12T17:11:47.737476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:08.964697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.665616+0000","last_change":"2024-09-12T17:11:04.699008+0000","last_active":"2024-09-12T17:13:18.665616+0000","last_peered":"2024-09-12T17:13:18.665616+0000","last_clean":"2024-09-12T17:13:18.665616+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:13:18.665616+0000","last_undegraded":"2024-09-12T17:13:18.665616+0000","last_fullsized":"2024-09-12T17:13:18.665616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:36.274188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.345961+0000","last_change":"2024-09-12T17:11:06.698107+0000","last_active":"2024-09-12T17:14:19.345961+0000","last_peered":"2024-09-12T17:14:19.345961+0000","last_clean":"2024-09-12T17:14:19.345961+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:14:19.345961+0000","last_undegraded":"2024-09-12T17:14:19.345961+0000","last_fullsized":"2024-09-12T17:14:19.345961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.502410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.652066+0000","last_change":"2024-09-12T17:11:04.670384+0000","last_active":"2024-09-12T17:13:14.652066+0000","last_peered":"2024-09-12T17:13:14.652066+0000","last_clean":"2024-09-12T17:13:14.652066+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:13:14.652066+0000","last_undegraded":"2024-09-12T17:13:14.652066+0000","last_fullsized":"2024-09-12T17:13:14.652066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:45.776683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789877+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.789877+0000","last_peered":"2024-09-12T17:14:19.789877+0000","last_clean":"2024-09-12T17:14:19.789877+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.789877+0000","last_undegraded":"2024-09-12T17:14:19.789877+0000","last_fullsized":"2024-09-12T17:14:19.789877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:24.771164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.951750+0000","last_change":"2024-09-12T17:11:04.695318+0000","last_active":"2024-09-12T17:11:49.951750+0000","last_peered":"2024-09-12T17:11:49.951750+0000","last_clean":"2024-09-12T17:11:49.951750+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:11:49.951750+0000","last_undegraded":"2024-09-12T17:11:49.951750+0000","last_fullsized":"2024-09-12T17:11:49.951750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.828581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492276+0000","last_change":"2024-09-12T17:11:06.694679+0000","last_active":"2024-09-12T17:14:19.492276+0000","last_peered":"2024-09-12T17:14:19.492276+0000","last_clean":"2024-09-12T17:14:19.492276+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:14:19.492276+0000","last_undegraded":"2024-09-12T17:14:19.492276+0000","last_fullsized":"2024-09-12T17:14:19.492276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.652480+0000","last_change":"2024-09-12T17:11:04.675982+0000","last_active":"2024-09-12T17:14:19.652480+0000","last_peered":"2024-09-12T17:14:19.652480+0000","last_clean":"2024-09-12T17:14:19.652480+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:14:19.652480+0000","last_undegraded":"2024-09-12T17:14:19.652480+0000","last_fullsized":"2024-09-12T17:14:19.652480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:46.947849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.714086+0000","last_change":"2024-09-12T17:11:06.700269+0000","last_active":"2024-09-12T17:13:18.714086+0000","last_peered":"2024-09-12T17:13:18.714086+0000","last_clean":"2024-09-12T17:13:18.714086+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:13:18.714086+0000","last_undegraded":"2024-09-12T17:13:18.714086+0000","last_fullsized":"2024-09-12T17:13:18.714086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.761569+0000","last_change":"2024-09-12T17:11:04.678371+0000","last_active":"2024-09-12T17:13:29.761569+0000","last_peered":"2024-09-12T17:13:29.761569+0000","last_clean":"2024-09-12T17:13:29.761569+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:13:29.761569+0000","last_undegraded":"2024-09-12T17:13:29.761569+0000","last_fullsized":"2024-09-12T17:13:29.761569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:06.727515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491645+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:14:19.491645+0000","last_peered":"2024-09-12T17:14:19.491645+0000","last_clean":"2024-09-12T17:14:19.491645+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:14:19.491645+0000","last_undegraded":"2024-09-12T17:14:19.491645+0000","last_fullsized":"2024-09-12T17:14:19.491645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:06.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.261458+0000","last_change":"2024-09-12T17:11:04.700050+0000","last_active":"2024-09-12T17:14:19.261458+0000","last_peered":"2024-09-12T17:14:19.261458+0000","last_clean":"2024-09-12T17:14:19.261458+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:14:19.261458+0000","last_undegraded":"2024-09-12T17:14:19.261458+0000","last_fullsized":"2024-09-12T17:14:19.261458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:44.289638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699394+0000","last_change":"2024-09-12T17:11:06.702528+0000","last_active":"2024-09-12T17:14:19.699394+0000","last_peered":"2024-09-12T17:14:19.699394+0000","last_clean":"2024-09-12T17:14:19.699394+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:14:19.699394+0000","last_undegraded":"2024-09-12T17:14:19.699394+0000","last_fullsized":"2024-09-12T17:14:19.699394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:53.004454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.669138+0000","last_change":"2024-09-12T17:11:04.695415+0000","last_active":"2024-09-12T17:14:19.669138+0000","last_peered":"2024-09-12T17:14:19.669138+0000","last_clean":"2024-09-12T17:14:19.669138+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:14:19.669138+0000","last_undegraded":"2024-09-12T17:14:19.669138+0000","last_fullsized":"2024-09-12T17:14:19.669138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:47.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699210+0000","last_change":"2024-09-12T17:11:06.702654+0000","last_active":"2024-09-12T17:14:19.699210+0000","last_peered":"2024-09-12T17:14:19.699210+0000","last_clean":"2024-09-12T17:14:19.699210+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.699210+0000","last_undegraded":"2024-09-12T17:14:19.699210+0000","last_fullsized":"2024-09-12T17:14:19.699210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.299767+0000","last_change":"2024-09-12T17:11:04.669648+0000","last_active":"2024-09-12T17:14:19.299767+0000","last_peered":"2024-09-12T17:14:19.299767+0000","last_clean":"2024-09-12T17:14:19.299767+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:14:19.299767+0000","last_undegraded":"2024-09-12T17:14:19.299767+0000","last_fullsized":"2024-09-12T17:14:19.299767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:21.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699219+0000","last_change":"2024-09-12T17:11:06.700166+0000","last_active":"2024-09-12T17:14:19.699219+0000","last_peered":"2024-09-12T17:14:19.699219+0000","last_clean":"2024-09-12T17:14:19.699219+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:14:19.699219+0000","last_undegraded":"2024-09-12T17:14:19.699219+0000","last_fullsized":"2024-09-12T17:14:19.699219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.254780+0000","last_change":"2024-09-12T17:11:04.684719+0000","last_active":"2024-09-12T17:11:49.254780+0000","last_peered":"2024-09-12T17:11:49.254780+0000","last_clean":"2024-09-12T17:11:49.254780+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:11:49.254780+0000","last_undegraded":"2024-09-12T17:11:49.254780+0000","last_fullsized":"2024-09-12T17:11:49.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:35.602622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.351380+0000","last_change":"2024-09-12T17:11:06.702307+0000","last_active":"2024-09-12T17:14:19.351380+0000","last_peered":"2024-09-12T17:14:19.351380+0000","last_clean":"2024-09-12T17:14:19.351380+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.351380+0000","last_undegraded":"2024-09-12T17:14:19.351380+0000","last_fullsized":"2024-09-12T17:14:19.351380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:15.153934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801460+0000","last_change":"2024-09-12T17:11:04.693521+0000","last_active":"2024-09-12T17:11:43.801460+0000","last_peered":"2024-09-12T17:11:43.801460+0000","last_clean":"2024-09-12T17:11:43.801460+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:11:43.801460+0000","last_undegraded":"2024-09-12T17:11:43.801460+0000","last_fullsized":"2024-09-12T17:11:43.801460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.412209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491966+0000","last_change":"2024-09-12T17:11:06.695461+0000","last_active":"2024-09-12T17:14:19.491966+0000","last_peered":"2024-09-12T17:14:19.491966+0000","last_clean":"2024-09-12T17:14:19.491966+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:14:19.491966+0000","last_undegraded":"2024-09-12T17:14:19.491966+0000","last_fullsized":"2024-09-12T17:14:19.491966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:05.772132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803636+0000","last_change":"2024-09-12T17:11:04.703079+0000","last_active":"2024-09-12T17:11:43.803636+0000","last_peered":"2024-09-12T17:11:43.803636+0000","last_clean":"2024-09-12T17:11:43.803636+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:11:43.803636+0000","last_undegraded":"2024-09-12T17:11:43.803636+0000","last_fullsized":"2024-09-12T17:11:43.803636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:07.714503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.782694+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:13:16.782694+0000","last_peered":"2024-09-12T17:13:16.782694+0000","last_clean":"2024-09-12T17:13:16.782694+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:13:16.782694+0000","last_undegraded":"2024-09-12T17:13:16.782694+0000","last_fullsized":"2024-09-12T17:13:16.782694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.990500+0000","last_change":"2024-09-12T17:11:06.695753+0000","last_active":"2024-09-12T17:11:49.990500+0000","last_peered":"2024-09-12T17:11:49.990500+0000","last_clean":"2024-09-12T17:11:49.990500+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:11:49.990500+0000","last_undegraded":"2024-09-12T17:11:49.990500+0000","last_fullsized":"2024-09-12T17:11:49.990500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:25.077773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789387+0000","last_change":"2024-09-12T17:11:04.664341+0000","last_active":"2024-09-12T17:11:43.789387+0000","last_peered":"2024-09-12T17:11:43.789387+0000","last_clean":"2024-09-12T17:11:43.789387+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:11:43.789387+0000","last_undegraded":"2024-09-12T17:11:43.789387+0000","last_fullsized":"2024-09-12T17:11:43.789387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.127793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798199+0000","last_change":"2024-09-12T17:11:08.714597+0000","last_active":"2024-09-12T17:11:43.798199+0000","last_peered":"2024-09-12T17:11:43.798199+0000","last_clean":"2024-09-12T17:11:43.798199+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:11:43.798199+0000","last_undegraded":"2024-09-12T17:11:43.798199+0000","last_fullsized":"2024-09-12T17:11:43.798199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:35.426981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788656+0000","last_change":"2024-09-12T17:11:06.695233+0000","last_active":"2024-09-12T17:14:19.788656+0000","last_peered":"2024-09-12T17:14:19.788656+0000","last_clean":"2024-09-12T17:14:19.788656+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:14:19.788656+0000","last_undegraded":"2024-09-12T17:14:19.788656+0000","last_fullsized":"2024-09-12T17:14:19.788656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:07.207850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798159+0000","last_change":"2024-09-12T17:11:04.699166+0000","last_active":"2024-09-12T17:11:43.798159+0000","last_peered":"2024-09-12T17:11:43.798159+0000","last_clean":"2024-09-12T17:11:43.798159+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:11:43.798159+0000","last_undegraded":"2024-09-12T17:11:43.798159+0000","last_fullsized":"2024-09-12T17:11:43.798159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.706422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803868+0000","last_change":"2024-09-12T17:11:08.703714+0000","last_active":"2024-09-12T17:11:43.803868+0000","last_peered":"2024-09-12T17:11:43.803868+0000","last_clean":"2024-09-12T17:11:43.803868+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:11:43.803868+0000","last_undegraded":"2024-09-12T17:11:43.803868+0000","last_fullsized":"2024-09-12T17:11:43.803868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:58.130892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956001+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:18.956001+0000","last_peered":"2024-09-12T17:14:18.956001+0000","last_clean":"2024-09-12T17:14:18.956001+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:18.956001+0000","last_undegraded":"2024-09-12T17:14:18.956001+0000","last_fullsized":"2024-09-12T17:14:18.956001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856648+0000","last_change":"2024-09-12T17:11:06.709890+0000","last_active":"2024-09-12T17:14:19.856648+0000","last_peered":"2024-09-12T17:14:19.856648+0000","last_clean":"2024-09-12T17:14:19.856648+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:14:19.856648+0000","last_undegraded":"2024-09-12T17:14:19.856648+0000","last_fullsized":"2024-09-12T17:14:19.856648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:54.843124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759626+0000","last_change":"2024-09-12T17:11:04.665928+0000","last_active":"2024-09-12T17:13:24.759626+0000","last_peered":"2024-09-12T17:13:24.759626+0000","last_clean":"2024-09-12T17:13:24.759626+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:13:24.759626+0000","last_undegraded":"2024-09-12T17:13:24.759626+0000","last_fullsized":"2024-09-12T17:13:24.759626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:39.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.775565+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:13:16.775565+0000","last_peered":"2024-09-12T17:13:16.775565+0000","last_clean":"2024-09-12T17:13:16.775565+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.775565+0000","last_undegraded":"2024-09-12T17:13:16.775565+0000","last_fullsized":"2024-09-12T17:13:16.775565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.046073+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:20.046073+0000","last_peered":"2024-09-12T17:14:20.046073+0000","last_clean":"2024-09-12T17:14:20.046073+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:20.046073+0000","last_undegraded":"2024-09-12T17:14:20.046073+0000","last_fullsized":"2024-09-12T17:14:20.046073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856733+0000","last_change":"2024-09-12T17:11:06.689516+0000","last_active":"2024-09-12T17:14:19.856733+0000","last_peered":"2024-09-12T17:14:19.856733+0000","last_clean":"2024-09-12T17:14:19.856733+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:14:19.856733+0000","last_undegraded":"2024-09-12T17:14:19.856733+0000","last_fullsized":"2024-09-12T17:14:19.856733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:22.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.707062+0000","last_change":"2024-09-12T17:11:04.670479+0000","last_active":"2024-09-12T17:11:50.707062+0000","last_peered":"2024-09-12T17:11:50.707062+0000","last_clean":"2024-09-12T17:11:50.707062+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:11:50.707062+0000","last_undegraded":"2024-09-12T17:11:50.707062+0000","last_fullsized":"2024-09-12T17:11:50.707062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.055726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801252+0000","last_change":"2024-09-12T17:11:08.711989+0000","last_active":"2024-09-12T17:11:43.801252+0000","last_peered":"2024-09-12T17:11:43.801252+0000","last_clean":"2024-09-12T17:11:43.801252+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:11:43.801252+0000","last_undegraded":"2024-09-12T17:11:43.801252+0000","last_fullsized":"2024-09-12T17:11:43.801252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:37.301429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.788463+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:13:16.788463+0000","last_peered":"2024-09-12T17:13:16.788463+0000","last_clean":"2024-09-12T17:13:16.788463+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:13:16.788463+0000","last_undegraded":"2024-09-12T17:13:16.788463+0000","last_fullsized":"2024-09-12T17:13:16.788463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:45.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.700337+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:12:33.700337+0000","last_peered":"2024-09-12T17:12:33.700337+0000","last_clean":"2024-09-12T17:12:33.700337+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:12:33.700337+0000","last_undegraded":"2024-09-12T17:12:33.700337+0000","last_fullsized":"2024-09-12T17:12:33.700337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:14.320323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758366+0000","last_change":"2024-09-12T17:11:06.691496+0000","last_active":"2024-09-12T17:13:19.758366+0000","last_peered":"2024-09-12T17:13:19.758366+0000","last_clean":"2024-09-12T17:13:19.758366+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:13:19.758366+0000","last_undegraded":"2024-09-12T17:13:19.758366+0000","last_fullsized":"2024-09-12T17:13:19.758366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:04.589070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.844389+0000","last_change":"2024-09-12T17:11:04.674290+0000","last_active":"2024-09-12T17:14:19.844389+0000","last_peered":"2024-09-12T17:14:19.844389+0000","last_clean":"2024-09-12T17:14:19.844389+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:19.844389+0000","last_undegraded":"2024-09-12T17:14:19.844389+0000","last_fullsized":"2024-09-12T17:14:19.844389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:49.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797606+0000","last_change":"2024-09-12T17:11:08.703591+0000","last_active":"2024-09-12T17:11:43.797606+0000","last_peered":"2024-09-12T17:11:43.797606+0000","last_clean":"2024-09-12T17:11:43.797606+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:11:43.797606+0000","last_undegraded":"2024-09-12T17:11:43.797606+0000","last_fullsized":"2024-09-12T17:11:43.797606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:30.362634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.761879+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:13:16.761879+0000","last_peered":"2024-09-12T17:13:16.761879+0000","last_clean":"2024-09-12T17:13:16.761879+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:13:16.761879+0000","last_undegraded":"2024-09-12T17:13:16.761879+0000","last_fullsized":"2024-09-12T17:13:16.761879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797367+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:11:43.797367+0000","last_peered":"2024-09-12T17:11:43.797367+0000","last_clean":"2024-09-12T17:11:43.797367+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:11:43.797367+0000","last_undegraded":"2024-09-12T17:11:43.797367+0000","last_fullsized":"2024-09-12T17:11:43.797367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.311032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:27.988084+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:12:27.988084+0000","last_peered":"2024-09-12T17:12:27.988084+0000","last_clean":"2024-09-12T17:12:27.988084+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:12:27.988084+0000","last_undegraded":"2024-09-12T17:12:27.988084+0000","last_fullsized":"2024-09-12T17:12:27.988084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:12.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699464+0000","last_change":"2024-09-12T17:11:06.696422+0000","last_active":"2024-09-12T17:14:19.699464+0000","last_peered":"2024-09-12T17:14:19.699464+0000","last_clean":"2024-09-12T17:14:19.699464+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:14:19.699464+0000","last_undegraded":"2024-09-12T17:14:19.699464+0000","last_fullsized":"2024-09-12T17:14:19.699464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:01.613538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.666958+0000","last_change":"2024-09-12T17:11:04.702087+0000","last_active":"2024-09-12T17:12:33.666958+0000","last_peered":"2024-09-12T17:12:33.666958+0000","last_clean":"2024-09-12T17:12:33.666958+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:12:33.666958+0000","last_undegraded":"2024-09-12T17:12:33.666958+0000","last_fullsized":"2024-09-12T17:12:33.666958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:25.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802068+0000","last_change":"2024-09-12T17:11:08.703554+0000","last_active":"2024-09-12T17:11:43.802068+0000","last_peered":"2024-09-12T17:11:43.802068+0000","last_clean":"2024-09-12T17:11:43.802068+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:11:43.802068+0000","last_undegraded":"2024-09-12T17:11:43.802068+0000","last_fullsized":"2024-09-12T17:11:43.802068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:43.928545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.790598+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:13:16.790598+0000","last_peered":"2024-09-12T17:13:16.790598+0000","last_clean":"2024-09-12T17:13:16.790598+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:13:16.790598+0000","last_undegraded":"2024-09-12T17:13:16.790598+0000","last_fullsized":"2024-09-12T17:13:16.790598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:15.747423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.066822+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:20.066822+0000","last_peered":"2024-09-12T17:14:20.066822+0000","last_clean":"2024-09-12T17:14:20.066822+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:20.066822+0000","last_undegraded":"2024-09-12T17:14:20.066822+0000","last_fullsized":"2024-09-12T17:14:20.066822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:58.989870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802324+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:11:43.802324+0000","last_peered":"2024-09-12T17:11:43.802324+0000","last_clean":"2024-09-12T17:11:43.802324+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:11:43.802324+0000","last_undegraded":"2024-09-12T17:11:43.802324+0000","last_fullsized":"2024-09-12T17:11:43.802324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:27.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874529+0000","last_change":"2024-09-12T17:11:06.692668+0000","last_active":"2024-09-12T17:14:19.874529+0000","last_peered":"2024-09-12T17:14:19.874529+0000","last_clean":"2024-09-12T17:14:19.874529+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:14:19.874529+0000","last_undegraded":"2024-09-12T17:14:19.874529+0000","last_fullsized":"2024-09-12T17:14:19.874529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804443+0000","last_change":"2024-09-12T17:11:04.705352+0000","last_active":"2024-09-12T17:11:43.804443+0000","last_peered":"2024-09-12T17:11:43.804443+0000","last_clean":"2024-09-12T17:11:43.804443+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:11:43.804443+0000","last_undegraded":"2024-09-12T17:11:43.804443+0000","last_fullsized":"2024-09-12T17:11:43.804443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:32.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798335+0000","last_change":"2024-09-12T17:11:08.718239+0000","last_active":"2024-09-12T17:11:43.798335+0000","last_peered":"2024-09-12T17:11:43.798335+0000","last_clean":"2024-09-12T17:11:43.798335+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:11:43.798335+0000","last_undegraded":"2024-09-12T17:11:43.798335+0000","last_fullsized":"2024-09-12T17:11:43.798335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:05.261510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.792763+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:13:16.792763+0000","last_peered":"2024-09-12T17:13:16.792763+0000","last_clean":"2024-09-12T17:13:16.792763+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:13:16.792763+0000","last_undegraded":"2024-09-12T17:13:16.792763+0000","last_fullsized":"2024-09-12T17:13:16.792763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:08.295074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797078+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:11:43.797078+0000","last_peered":"2024-09-12T17:11:43.797078+0000","last_clean":"2024-09-12T17:11:43.797078+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:11:43.797078+0000","last_undegraded":"2024-09-12T17:11:43.797078+0000","last_fullsized":"2024-09-12T17:11:43.797078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:12.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.020204+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.020204+0000","last_peered":"2024-09-12T17:14:20.020204+0000","last_clean":"2024-09-12T17:14:20.020204+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.020204+0000","last_undegraded":"2024-09-12T17:14:20.020204+0000","last_fullsized":"2024-09-12T17:14:20.020204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:39.726074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.347636+0000","last_change":"2024-09-12T17:11:06.707317+0000","last_active":"2024-09-12T17:14:19.347636+0000","last_peered":"2024-09-12T17:14:19.347636+0000","last_clean":"2024-09-12T17:14:19.347636+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:14:19.347636+0000","last_undegraded":"2024-09-12T17:14:19.347636+0000","last_fullsized":"2024-09-12T17:14:19.347636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:08.491395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798991+0000","last_change":"2024-09-12T17:11:04.681916+0000","last_active":"2024-09-12T17:11:43.798991+0000","last_peered":"2024-09-12T17:11:43.798991+0000","last_clean":"2024-09-12T17:11:43.798991+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:11:43.798991+0000","last_undegraded":"2024-09-12T17:11:43.798991+0000","last_fullsized":"2024-09-12T17:11:43.798991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.532391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793223+0000","last_change":"2024-09-12T17:11:08.714019+0000","last_active":"2024-09-12T17:11:43.793223+0000","last_peered":"2024-09-12T17:11:43.793223+0000","last_clean":"2024-09-12T17:11:43.793223+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:11:43.793223+0000","last_undegraded":"2024-09-12T17:11:43.793223+0000","last_fullsized":"2024-09-12T17:11:43.793223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:48.242476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.760164+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:13:24.760164+0000","last_peered":"2024-09-12T17:13:24.760164+0000","last_clean":"2024-09-12T17:13:24.760164+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:13:24.760164+0000","last_undegraded":"2024-09-12T17:13:24.760164+0000","last_fullsized":"2024-09-12T17:13:24.760164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.382092+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:13:16.382092+0000","last_peered":"2024-09-12T17:13:16.382092+0000","last_clean":"2024-09-12T17:13:16.382092+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:13:16.382092+0000","last_undegraded":"2024-09-12T17:13:16.382092+0000","last_fullsized":"2024-09-12T17:13:16.382092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:53.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856766+0000","last_change":"2024-09-12T17:11:06.709152+0000","last_active":"2024-09-12T17:14:19.856766+0000","last_peered":"2024-09-12T17:14:19.856766+0000","last_clean":"2024-09-12T17:14:19.856766+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:14:19.856766+0000","last_undegraded":"2024-09-12T17:14:19.856766+0000","last_fullsized":"2024-09-12T17:14:19.856766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.578776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802317+0000","last_change":"2024-09-12T17:11:04.693394+0000","last_active":"2024-09-12T17:11:43.802317+0000","last_peered":"2024-09-12T17:11:43.802317+0000","last_clean":"2024-09-12T17:11:43.802317+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:11:43.802317+0000","last_undegraded":"2024-09-12T17:11:43.802317+0000","last_fullsized":"2024-09-12T17:11:43.802317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:25.577954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798665+0000","last_change":"2024-09-12T17:11:08.717768+0000","last_active":"2024-09-12T17:11:43.798665+0000","last_peered":"2024-09-12T17:11:43.798665+0000","last_clean":"2024-09-12T17:11:43.798665+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:11:43.798665+0000","last_undegraded":"2024-09-12T17:11:43.798665+0000","last_fullsized":"2024-09-12T17:11:43.798665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:07.209528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:27.759011+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:13:27.759011+0000","last_peered":"2024-09-12T17:13:27.759011+0000","last_clean":"2024-09-12T17:13:27.759011+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:13:27.759011+0000","last_undegraded":"2024-09-12T17:13:27.759011+0000","last_fullsized":"2024-09-12T17:13:27.759011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.031128+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:20.031128+0000","last_peered":"2024-09-12T17:14:20.031128+0000","last_clean":"2024-09-12T17:14:20.031128+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:20.031128+0000","last_undegraded":"2024-09-12T17:14:20.031128+0000","last_fullsized":"2024-09-12T17:14:20.031128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759536+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:13:18.759536+0000","last_peered":"2024-09-12T17:13:18.759536+0000","last_clean":"2024-09-12T17:13:18.759536+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:13:18.759536+0000","last_undegraded":"2024-09-12T17:13:18.759536+0000","last_fullsized":"2024-09-12T17:13:18.759536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.396693+0000","last_change":"2024-09-12T17:11:06.700331+0000","last_active":"2024-09-12T17:11:50.396693+0000","last_peered":"2024-09-12T17:11:50.396693+0000","last_clean":"2024-09-12T17:11:50.396693+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:11:50.396693+0000","last_undegraded":"2024-09-12T17:11:50.396693+0000","last_fullsized":"2024-09-12T17:11:50.396693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255080+0000","last_change":"2024-09-12T17:11:04.703034+0000","last_active":"2024-09-12T17:11:49.255080+0000","last_peered":"2024-09-12T17:11:49.255080+0000","last_clean":"2024-09-12T17:11:49.255080+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:11:49.255080+0000","last_undegraded":"2024-09-12T17:11:49.255080+0000","last_fullsized":"2024-09-12T17:11:49.255080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:43.087208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225726+0000","last_change":"2024-09-12T17:11:43.830390+0000","last_active":"2024-09-12T17:13:18.225726+0000","last_peered":"2024-09-12T17:13:18.225726+0000","last_clean":"2024-09-12T17:13:18.225726+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:13:18.225726+0000","last_undegraded":"2024-09-12T17:13:18.225726+0000","last_fullsized":"2024-09-12T17:13:18.225726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.971718+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:19.971718+0000","last_peered":"2024-09-12T17:14:19.971718+0000","last_clean":"2024-09-12T17:14:19.971718+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:19.971718+0000","last_undegraded":"2024-09-12T17:14:19.971718+0000","last_fullsized":"2024-09-12T17:14:19.971718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.965720+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:19.965720+0000","last_peered":"2024-09-12T17:14:19.965720+0000","last_clean":"2024-09-12T17:14:19.965720+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:19.965720+0000","last_undegraded":"2024-09-12T17:14:19.965720+0000","last_fullsized":"2024-09-12T17:14:19.965720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492433+0000","last_change":"2024-09-12T17:11:06.707589+0000","last_active":"2024-09-12T17:14:19.492433+0000","last_peered":"2024-09-12T17:14:19.492433+0000","last_clean":"2024-09-12T17:14:19.492433+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:14:19.492433+0000","last_undegraded":"2024-09-12T17:14:19.492433+0000","last_fullsized":"2024-09-12T17:14:19.492433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:48.926839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255268+0000","last_change":"2024-09-12T17:11:04.703521+0000","last_active":"2024-09-12T17:11:49.255268+0000","last_peered":"2024-09-12T17:11:49.255268+0000","last_clean":"2024-09-12T17:11:49.255268+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:11:49.255268+0000","last_undegraded":"2024-09-12T17:11:49.255268+0000","last_fullsized":"2024-09-12T17:11:49.255268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:58.014451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.784611+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:13:16.784611+0000","last_peered":"2024-09-12T17:13:16.784611+0000","last_clean":"2024-09-12T17:13:16.784611+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:13:16.784611+0000","last_undegraded":"2024-09-12T17:13:16.784611+0000","last_fullsized":"2024-09-12T17:13:16.784611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.928411+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:19.928411+0000","last_peered":"2024-09-12T17:14:19.928411+0000","last_clean":"2024-09-12T17:14:19.928411+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:19.928411+0000","last_undegraded":"2024-09-12T17:14:19.928411+0000","last_fullsized":"2024-09-12T17:14:19.928411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669049+0000","last_change":"2024-09-12T17:11:06.709109+0000","last_active":"2024-09-12T17:13:14.669049+0000","last_peered":"2024-09-12T17:13:14.669049+0000","last_clean":"2024-09-12T17:13:14.669049+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:13:14.669049+0000","last_undegraded":"2024-09-12T17:13:14.669049+0000","last_fullsized":"2024-09-12T17:13:14.669049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:51.560480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:49.751999+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:12:49.751999+0000","last_peered":"2024-09-12T17:12:49.751999+0000","last_clean":"2024-09-12T17:12:49.751999+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:12:49.751999+0000","last_undegraded":"2024-09-12T17:12:49.751999+0000","last_fullsized":"2024-09-12T17:12:49.751999+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804184+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:11:43.804184+0000","last_peered":"2024-09-12T17:11:43.804184+0000","last_clean":"2024-09-12T17:11:43.804184+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:11:43.804184+0000","last_undegraded":"2024-09-12T17:11:43.804184+0000","last_fullsized":"2024-09-12T17:11:43.804184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800617+0000","last_change":"2024-09-12T17:11:04.703751+0000","last_active":"2024-09-12T17:11:43.800617+0000","last_peered":"2024-09-12T17:11:43.800617+0000","last_clean":"2024-09-12T17:11:43.800617+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:11:43.800617+0000","last_undegraded":"2024-09-12T17:11:43.800617+0000","last_fullsized":"2024-09-12T17:11:43.800617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818268+0000","last_change":"2024-09-12T17:11:43.816300+0000","last_active":"2024-09-12T17:11:43.818268+0000","last_peered":"2024-09-12T17:11:43.818268+0000","last_clean":"2024-09-12T17:11:43.818268+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:11:43.818268+0000","last_undegraded":"2024-09-12T17:11:43.818268+0000","last_fullsized":"2024-09-12T17:11:43.818268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:37.695610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.800681+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:13:16.800681+0000","last_peered":"2024-09-12T17:13:16.800681+0000","last_clean":"2024-09-12T17:13:16.800681+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:13:16.800681+0000","last_undegraded":"2024-09-12T17:13:16.800681+0000","last_fullsized":"2024-09-12T17:13:16.800681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:40.493734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802475+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:11:43.802475+0000","last_peered":"2024-09-12T17:11:43.802475+0000","last_clean":"2024-09-12T17:11:43.802475+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:11:43.802475+0000","last_undegraded":"2024-09-12T17:11:43.802475+0000","last_fullsized":"2024-09-12T17:11:43.802475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:25.075965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.804563+0000","last_change":"2024-09-12T17:11:06.693422+0000","last_active":"2024-09-12T17:14:19.804563+0000","last_peered":"2024-09-12T17:14:19.804563+0000","last_clean":"2024-09-12T17:14:19.804563+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:14:19.804563+0000","last_undegraded":"2024-09-12T17:14:19.804563+0000","last_fullsized":"2024-09-12T17:14:19.804563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.467976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799232+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:11:43.799232+0000","last_peered":"2024-09-12T17:11:43.799232+0000","last_clean":"2024-09-12T17:11:43.799232+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:11:43.799232+0000","last_undegraded":"2024-09-12T17:11:43.799232+0000","last_fullsized":"2024-09-12T17:11:43.799232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796953+0000","last_change":"2024-09-12T17:11:04.677283+0000","last_active":"2024-09-12T17:11:43.796953+0000","last_peered":"2024-09-12T17:11:43.796953+0000","last_clean":"2024-09-12T17:11:43.796953+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:11:43.796953+0000","last_undegraded":"2024-09-12T17:11:43.796953+0000","last_fullsized":"2024-09-12T17:11:43.796953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.246536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819515+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:11:43.819515+0000","last_peered":"2024-09-12T17:11:43.819515+0000","last_clean":"2024-09-12T17:11:43.819515+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:11:43.819515+0000","last_undegraded":"2024-09-12T17:11:43.819515+0000","last_fullsized":"2024-09-12T17:11:43.819515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.790398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.723137+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:19.723137+0000","last_peered":"2024-09-12T17:14:19.723137+0000","last_clean":"2024-09-12T17:14:19.723137+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:19.723137+0000","last_undegraded":"2024-09-12T17:14:19.723137+0000","last_fullsized":"2024-09-12T17:14:19.723137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:01.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805519+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:11:43.805519+0000","last_peered":"2024-09-12T17:11:43.805519+0000","last_clean":"2024-09-12T17:11:43.805519+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:11:43.805519+0000","last_undegraded":"2024-09-12T17:11:43.805519+0000","last_fullsized":"2024-09-12T17:11:43.805519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:45.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.692612+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:12:33.692612+0000","last_peered":"2024-09-12T17:12:33.692612+0000","last_clean":"2024-09-12T17:12:33.692612+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:12:33.692612+0000","last_undegraded":"2024-09-12T17:12:33.692612+0000","last_fullsized":"2024-09-12T17:12:33.692612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.700288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'25","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.876594+0000","last_change":"2024-09-12T17:11:06.700482+0000","last_active":"2024-09-12T17:14:19.876594+0000","last_peered":"2024-09-12T17:14:19.876594+0000","last_clean":"2024-09-12T17:14:19.876594+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:14:19.876594+0000","last_undegraded":"2024-09-12T17:14:19.876594+0000","last_fullsized":"2024-09-12T17:14:19.876594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:53.954037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791793+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:11:43.791793+0000","last_peered":"2024-09-12T17:11:43.791793+0000","last_clean":"2024-09-12T17:11:43.791793+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:11:43.791793+0000","last_undegraded":"2024-09-12T17:11:43.791793+0000","last_fullsized":"2024-09-12T17:11:43.791793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.978777+0000","last_change":"2024-09-12T17:11:04.677831+0000","last_active":"2024-09-12T17:12:33.978777+0000","last_peered":"2024-09-12T17:12:33.978777+0000","last_clean":"2024-09-12T17:12:33.978777+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:12:33.978777+0000","last_undegraded":"2024-09-12T17:12:33.978777+0000","last_fullsized":"2024-09-12T17:12:33.978777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.505466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793377+0000","last_change":"2024-09-12T17:11:08.712933+0000","last_active":"2024-09-12T17:11:43.793377+0000","last_peered":"2024-09-12T17:11:43.793377+0000","last_clean":"2024-09-12T17:11:43.793377+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:11:43.793377+0000","last_undegraded":"2024-09-12T17:11:43.793377+0000","last_fullsized":"2024-09-12T17:11:43.793377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:59.902245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956445+0000","last_change":"2024-09-12T17:11:10.735305+0000","last_active":"2024-09-12T17:14:18.956445+0000","last_peered":"2024-09-12T17:14:18.956445+0000","last_clean":"2024-09-12T17:14:18.956445+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:14:18.956445+0000","last_undegraded":"2024-09-12T17:14:18.956445+0000","last_fullsized":"2024-09-12T17:14:18.956445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:41.801702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799591+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:11:43.799591+0000","last_peered":"2024-09-12T17:11:43.799591+0000","last_clean":"2024-09-12T17:11:43.799591+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:11:43.799591+0000","last_undegraded":"2024-09-12T17:11:43.799591+0000","last_fullsized":"2024-09-12T17:11:43.799591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:20.273638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.684614+0000","last_change":"2024-09-12T17:11:06.701808+0000","last_active":"2024-09-12T17:12:33.684614+0000","last_peered":"2024-09-12T17:12:33.684614+0000","last_clean":"2024-09-12T17:12:33.684614+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:12:33.684614+0000","last_undegraded":"2024-09-12T17:12:33.684614+0000","last_fullsized":"2024-09-12T17:12:33.684614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:46.068569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799665+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:11:43.799665+0000","last_peered":"2024-09-12T17:11:43.799665+0000","last_clean":"2024-09-12T17:11:43.799665+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.799665+0000","last_undegraded":"2024-09-12T17:11:43.799665+0000","last_fullsized":"2024-09-12T17:11:43.799665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791477+0000","last_change":"2024-09-12T17:11:04.674550+0000","last_active":"2024-09-12T17:11:43.791477+0000","last_peered":"2024-09-12T17:11:43.791477+0000","last_clean":"2024-09-12T17:11:43.791477+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:11:43.791477+0000","last_undegraded":"2024-09-12T17:11:43.791477+0000","last_fullsized":"2024-09-12T17:11:43.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800092+0000","last_change":"2024-09-12T17:11:08.711996+0000","last_active":"2024-09-12T17:11:43.800092+0000","last_peered":"2024-09-12T17:11:43.800092+0000","last_clean":"2024-09-12T17:11:43.800092+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:11:43.800092+0000","last_undegraded":"2024-09-12T17:11:43.800092+0000","last_fullsized":"2024-09-12T17:11:43.800092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:39.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.753060+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.753060+0000","last_peered":"2024-09-12T17:14:18.753060+0000","last_clean":"2024-09-12T17:14:18.753060+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.753060+0000","last_undegraded":"2024-09-12T17:14:18.753060+0000","last_fullsized":"2024-09-12T17:14:18.753060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:23.846254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818300+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:11:43.818300+0000","last_peered":"2024-09-12T17:11:43.818300+0000","last_clean":"2024-09-12T17:11:43.818300+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:11:43.818300+0000","last_undegraded":"2024-09-12T17:11:43.818300+0000","last_fullsized":"2024-09-12T17:11:43.818300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:33.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.354515+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:18.354515+0000","last_peered":"2024-09-12T17:13:18.354515+0000","last_clean":"2024-09-12T17:13:18.354515+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:18.354515+0000","last_undegraded":"2024-09-12T17:13:18.354515+0000","last_fullsized":"2024-09-12T17:13:18.354515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:16.583308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789879+0000","last_change":"2024-09-12T17:11:06.705536+0000","last_active":"2024-09-12T17:14:19.789879+0000","last_peered":"2024-09-12T17:14:19.789879+0000","last_clean":"2024-09-12T17:14:19.789879+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:14:19.789879+0000","last_undegraded":"2024-09-12T17:14:19.789879+0000","last_fullsized":"2024-09-12T17:14:19.789879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:27.457528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:12.755500+0000","last_change":"2024-09-12T17:11:04.674617+0000","last_active":"2024-09-12T17:13:12.755500+0000","last_peered":"2024-09-12T17:13:12.755500+0000","last_clean":"2024-09-12T17:13:12.755500+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:13:12.755500+0000","last_undegraded":"2024-09-12T17:13:12.755500+0000","last_fullsized":"2024-09-12T17:13:12.755500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:54.666558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799080+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:11:43.799080+0000","last_peered":"2024-09-12T17:11:43.799080+0000","last_clean":"2024-09-12T17:11:43.799080+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:11:43.799080+0000","last_undegraded":"2024-09-12T17:11:43.799080+0000","last_fullsized":"2024-09-12T17:11:43.799080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758361+0000","last_change":"2024-09-12T17:11:08.714792+0000","last_active":"2024-09-12T17:13:13.758361+0000","last_peered":"2024-09-12T17:13:13.758361+0000","last_clean":"2024-09-12T17:13:13.758361+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:13:13.758361+0000","last_undegraded":"2024-09-12T17:13:13.758361+0000","last_fullsized":"2024-09-12T17:13:13.758361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:27.037237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.802368+0000","last_change":"2024-09-12T17:11:10.745089+0000","last_active":"2024-09-12T17:13:16.802368+0000","last_peered":"2024-09-12T17:13:16.802368+0000","last_clean":"2024-09-12T17:13:16.802368+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:13:16.802368+0000","last_undegraded":"2024-09-12T17:13:16.802368+0000","last_fullsized":"2024-09-12T17:13:16.802368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.460174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791955+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:11:43.791955+0000","last_peered":"2024-09-12T17:11:43.791955+0000","last_clean":"2024-09-12T17:11:43.791955+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:11:43.791955+0000","last_undegraded":"2024-09-12T17:11:43.791955+0000","last_fullsized":"2024-09-12T17:11:43.791955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.574053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807673+0000","last_change":"2024-09-12T17:11:06.705517+0000","last_active":"2024-09-12T17:11:43.807673+0000","last_peered":"2024-09-12T17:11:43.807673+0000","last_clean":"2024-09-12T17:11:43.807673+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:11:43.807673+0000","last_undegraded":"2024-09-12T17:11:43.807673+0000","last_fullsized":"2024-09-12T17:11:43.807673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:59.554886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799985+0000","last_change":"2024-09-12T17:11:04.676312+0000","last_active":"2024-09-12T17:11:43.799985+0000","last_peered":"2024-09-12T17:11:43.799985+0000","last_clean":"2024-09-12T17:11:43.799985+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:11:43.799985+0000","last_undegraded":"2024-09-12T17:11:43.799985+0000","last_fullsized":"2024-09-12T17:11:43.799985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:42.964413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809982+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:11:43.809982+0000","last_peered":"2024-09-12T17:11:43.809982+0000","last_clean":"2024-09-12T17:11:43.809982+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.809982+0000","last_undegraded":"2024-09-12T17:11:43.809982+0000","last_fullsized":"2024-09-12T17:11:43.809982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797949+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:11:43.797949+0000","last_peered":"2024-09-12T17:11:43.797949+0000","last_clean":"2024-09-12T17:11:43.797949+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:11:43.797949+0000","last_undegraded":"2024-09-12T17:11:43.797949+0000","last_fullsized":"2024-09-12T17:11:43.797949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:09.523951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802889+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:11:43.802889+0000","last_peered":"2024-09-12T17:11:43.802889+0000","last_clean":"2024-09-12T17:11:43.802889+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:11:43.802889+0000","last_undegraded":"2024-09-12T17:11:43.802889+0000","last_fullsized":"2024-09-12T17:11:43.802889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:43.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955798+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:18.955798+0000","last_peered":"2024-09-12T17:14:18.955798+0000","last_clean":"2024-09-12T17:14:18.955798+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:18.955798+0000","last_undegraded":"2024-09-12T17:14:18.955798+0000","last_fullsized":"2024-09-12T17:14:18.955798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:29.442661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.700276+0000","last_change":"2024-09-12T17:11:06.689832+0000","last_active":"2024-09-12T17:14:19.700276+0000","last_peered":"2024-09-12T17:14:19.700276+0000","last_clean":"2024-09-12T17:14:19.700276+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:14:19.700276+0000","last_undegraded":"2024-09-12T17:14:19.700276+0000","last_fullsized":"2024-09-12T17:14:19.700276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:21.208607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819353+0000","last_change":"2024-09-12T17:11:04.694780+0000","last_active":"2024-09-12T17:11:43.819353+0000","last_peered":"2024-09-12T17:11:43.819353+0000","last_clean":"2024-09-12T17:11:43.819353+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:11:43.819353+0000","last_undegraded":"2024-09-12T17:11:43.819353+0000","last_fullsized":"2024-09-12T17:11:43.819353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.499606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802798+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:11:43.802798+0000","last_peered":"2024-09-12T17:11:43.802798+0000","last_clean":"2024-09-12T17:11:43.802798+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:11:43.802798+0000","last_undegraded":"2024-09-12T17:11:43.802798+0000","last_fullsized":"2024-09-12T17:11:43.802798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801258+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:11:43.801258+0000","last_peered":"2024-09-12T17:11:43.801258+0000","last_clean":"2024-09-12T17:11:43.801258+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:11:43.801258+0000","last_undegraded":"2024-09-12T17:11:43.801258+0000","last_fullsized":"2024-09-12T17:11:43.801258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:25.268216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:34.005760+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:12:34.005760+0000","last_peered":"2024-09-12T17:12:34.005760+0000","last_clean":"2024-09-12T17:12:34.005760+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:12:34.005760+0000","last_undegraded":"2024-09-12T17:12:34.005760+0000","last_fullsized":"2024-09-12T17:12:34.005760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:11.052561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.021940+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:20.021940+0000","last_peered":"2024-09-12T17:14:20.021940+0000","last_clean":"2024-09-12T17:14:20.021940+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:20.021940+0000","last_undegraded":"2024-09-12T17:14:20.021940+0000","last_fullsized":"2024-09-12T17:14:20.021940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.857216+0000","last_change":"2024-09-12T17:11:06.691701+0000","last_active":"2024-09-12T17:14:19.857216+0000","last_peered":"2024-09-12T17:14:19.857216+0000","last_clean":"2024-09-12T17:14:19.857216+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:14:19.857216+0000","last_undegraded":"2024-09-12T17:14:19.857216+0000","last_fullsized":"2024-09-12T17:14:19.857216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:40.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.678202+0000","last_change":"2024-09-12T17:11:04.669503+0000","last_active":"2024-09-12T17:14:19.678202+0000","last_peered":"2024-09-12T17:14:19.678202+0000","last_clean":"2024-09-12T17:14:19.678202+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:19.678202+0000","last_undegraded":"2024-09-12T17:14:19.678202+0000","last_fullsized":"2024-09-12T17:14:19.678202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:08.595800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.817481+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:11:43.817481+0000","last_peered":"2024-09-12T17:11:43.817481+0000","last_clean":"2024-09-12T17:11:43.817481+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:11:43.817481+0000","last_undegraded":"2024-09-12T17:11:43.817481+0000","last_fullsized":"2024-09-12T17:11:43.817481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801939+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:11:43.801939+0000","last_peered":"2024-09-12T17:11:43.801939+0000","last_clean":"2024-09-12T17:11:43.801939+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:11:43.801939+0000","last_undegraded":"2024-09-12T17:11:43.801939+0000","last_fullsized":"2024-09-12T17:11:43.801939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'84","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.781712+0000","last_change":"2024-09-12T17:11:10.745211+0000","last_active":"2024-09-12T17:13:16.781712+0000","last_peered":"2024-09-12T17:13:16.781712+0000","last_clean":"2024-09-12T17:13:16.781712+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:13:16.781712+0000","last_undegraded":"2024-09-12T17:13:16.781712+0000","last_fullsized":"2024-09-12T17:13:16.781712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:31.455841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799656+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:11:43.799656+0000","last_peered":"2024-09-12T17:11:43.799656+0000","last_clean":"2024-09-12T17:11:43.799656+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:11:43.799656+0000","last_undegraded":"2024-09-12T17:11:43.799656+0000","last_fullsized":"2024-09-12T17:11:43.799656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:05.933362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.399063+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:11:50.399063+0000","last_peered":"2024-09-12T17:11:50.399063+0000","last_clean":"2024-09-12T17:11:50.399063+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:11:50.399063+0000","last_undegraded":"2024-09-12T17:11:50.399063+0000","last_fullsized":"2024-09-12T17:11:50.399063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:09.467743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699249+0000","last_change":"2024-09-12T17:11:06.700916+0000","last_active":"2024-09-12T17:14:19.699249+0000","last_peered":"2024-09-12T17:14:19.699249+0000","last_clean":"2024-09-12T17:14:19.699249+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:14:19.699249+0000","last_undegraded":"2024-09-12T17:14:19.699249+0000","last_fullsized":"2024-09-12T17:14:19.699249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:56.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795133+0000","last_change":"2024-09-12T17:11:04.704630+0000","last_active":"2024-09-12T17:13:24.795133+0000","last_peered":"2024-09-12T17:13:24.795133+0000","last_clean":"2024-09-12T17:13:24.795133+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:13:24.795133+0000","last_undegraded":"2024-09-12T17:13:24.795133+0000","last_fullsized":"2024-09-12T17:13:24.795133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:49.225315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225988+0000","last_change":"2024-09-12T17:11:08.715453+0000","last_active":"2024-09-12T17:13:18.225988+0000","last_peered":"2024-09-12T17:13:18.225988+0000","last_clean":"2024-09-12T17:13:18.225988+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:13:18.225988+0000","last_undegraded":"2024-09-12T17:13:18.225988+0000","last_fullsized":"2024-09-12T17:13:18.225988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:50.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.789489+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:13:16.789489+0000","last_peered":"2024-09-12T17:13:16.789489+0000","last_clean":"2024-09-12T17:13:16.789489+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:13:16.789489+0000","last_undegraded":"2024-09-12T17:13:16.789489+0000","last_fullsized":"2024-09-12T17:13:16.789489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.384651+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.384651+0000","last_peered":"2024-09-12T17:13:16.384651+0000","last_clean":"2024-09-12T17:13:16.384651+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.384651+0000","last_undegraded":"2024-09-12T17:13:16.384651+0000","last_fullsized":"2024-09-12T17:13:16.384651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:59.671012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807517+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:11:43.807517+0000","last_peered":"2024-09-12T17:11:43.807517+0000","last_clean":"2024-09-12T17:11:43.807517+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:11:43.807517+0000","last_undegraded":"2024-09-12T17:11:43.807517+0000","last_fullsized":"2024-09-12T17:11:43.807517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:32.760064+0000","last_change":"2024-09-12T17:11:04.674643+0000","last_active":"2024-09-12T17:13:32.760064+0000","last_peered":"2024-09-12T17:13:32.760064+0000","last_clean":"2024-09-12T17:13:32.760064+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:13:32.760064+0000","last_undegraded":"2024-09-12T17:13:32.760064+0000","last_fullsized":"2024-09-12T17:13:32.760064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.872048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.668281+0000","last_change":"2024-09-12T17:11:06.691887+0000","last_active":"2024-09-12T17:13:14.668281+0000","last_peered":"2024-09-12T17:13:14.668281+0000","last_clean":"2024-09-12T17:13:14.668281+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:13:14.668281+0000","last_undegraded":"2024-09-12T17:13:14.668281+0000","last_fullsized":"2024-09-12T17:13:14.668281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794222+0000","last_change":"2024-09-12T17:11:04.688216+0000","last_active":"2024-09-12T17:11:43.794222+0000","last_peered":"2024-09-12T17:11:43.794222+0000","last_clean":"2024-09-12T17:11:43.794222+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:11:43.794222+0000","last_undegraded":"2024-09-12T17:11:43.794222+0000","last_fullsized":"2024-09-12T17:11:43.794222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790045+0000","last_change":"2024-09-12T17:11:08.715785+0000","last_active":"2024-09-12T17:11:43.790045+0000","last_peered":"2024-09-12T17:11:43.790045+0000","last_clean":"2024-09-12T17:11:43.790045+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:11:43.790045+0000","last_undegraded":"2024-09-12T17:11:43.790045+0000","last_fullsized":"2024-09-12T17:11:43.790045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:51.935358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.846470+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:18.846470+0000","last_peered":"2024-09-12T17:14:18.846470+0000","last_clean":"2024-09-12T17:14:18.846470+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:18.846470+0000","last_undegraded":"2024-09-12T17:14:18.846470+0000","last_fullsized":"2024-09-12T17:14:18.846470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789528+0000","last_change":"2024-09-12T17:11:06.689927+0000","last_active":"2024-09-12T17:14:19.789528+0000","last_peered":"2024-09-12T17:14:19.789528+0000","last_clean":"2024-09-12T17:14:19.789528+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:14:19.789528+0000","last_undegraded":"2024-09-12T17:14:19.789528+0000","last_fullsized":"2024-09-12T17:14:19.789528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820672+0000","last_change":"2024-09-12T17:11:04.693759+0000","last_active":"2024-09-12T17:11:43.820672+0000","last_peered":"2024-09-12T17:11:43.820672+0000","last_clean":"2024-09-12T17:11:43.820672+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:11:43.820672+0000","last_undegraded":"2024-09-12T17:11:43.820672+0000","last_fullsized":"2024-09-12T17:11:43.820672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:38.114303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.770620+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:13:16.770620+0000","last_peered":"2024-09-12T17:13:16.770620+0000","last_clean":"2024-09-12T17:13:16.770620+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:13:16.770620+0000","last_undegraded":"2024-09-12T17:13:16.770620+0000","last_fullsized":"2024-09-12T17:13:16.770620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874185+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.874185+0000","last_peered":"2024-09-12T17:14:19.874185+0000","last_clean":"2024-09-12T17:14:19.874185+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.874185+0000","last_undegraded":"2024-09-12T17:14:19.874185+0000","last_fullsized":"2024-09-12T17:14:19.874185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.972646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799635+0000","last_change":"2024-09-12T17:11:04.703253+0000","last_active":"2024-09-12T17:11:43.799635+0000","last_peered":"2024-09-12T17:11:43.799635+0000","last_clean":"2024-09-12T17:11:43.799635+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:11:43.799635+0000","last_undegraded":"2024-09-12T17:11:43.799635+0000","last_fullsized":"2024-09-12T17:11:43.799635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:31.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803741+0000","last_change":"2024-09-12T17:11:08.711173+0000","last_active":"2024-09-12T17:11:43.803741+0000","last_peered":"2024-09-12T17:11:43.803741+0000","last_clean":"2024-09-12T17:11:43.803741+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:11:43.803741+0000","last_undegraded":"2024-09-12T17:11:43.803741+0000","last_fullsized":"2024-09-12T17:11:43.803741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:01.083466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.798275+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:13:16.798275+0000","last_peered":"2024-09-12T17:13:16.798275+0000","last_clean":"2024-09-12T17:13:16.798275+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:13:16.798275+0000","last_undegraded":"2024-09-12T17:13:16.798275+0000","last_fullsized":"2024-09-12T17:13:16.798275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.787946+0000","last_change":"2024-09-12T17:11:06.709521+0000","last_active":"2024-09-12T17:14:19.787946+0000","last_peered":"2024-09-12T17:14:19.787946+0000","last_clean":"2024-09-12T17:14:19.787946+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:14:19.787946+0000","last_undegraded":"2024-09-12T17:14:19.787946+0000","last_fullsized":"2024-09-12T17:14:19.787946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:54.551330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800701+0000","last_change":"2024-09-12T17:11:04.666747+0000","last_active":"2024-09-12T17:11:43.800701+0000","last_peered":"2024-09-12T17:11:43.800701+0000","last_clean":"2024-09-12T17:11:43.800701+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:11:43.800701+0000","last_undegraded":"2024-09-12T17:11:43.800701+0000","last_fullsized":"2024-09-12T17:11:43.800701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:22.246442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814579+0000","last_change":"2024-09-12T17:11:43.809305+0000","last_active":"2024-09-12T17:11:43.814579+0000","last_peered":"2024-09-12T17:11:43.814579+0000","last_clean":"2024-09-12T17:11:43.814579+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:11:43.814579+0000","last_undegraded":"2024-09-12T17:11:43.814579+0000","last_fullsized":"2024-09-12T17:11:43.814579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:04.779608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.771611+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:13:16.771611+0000","last_peered":"2024-09-12T17:13:16.771611+0000","last_clean":"2024-09-12T17:13:16.771611+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:13:16.771611+0000","last_undegraded":"2024-09-12T17:13:16.771611+0000","last_fullsized":"2024-09-12T17:13:16.771611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.349327+0000","last_change":"2024-09-12T17:11:06.709586+0000","last_active":"2024-09-12T17:14:19.349327+0000","last_peered":"2024-09-12T17:14:19.349327+0000","last_clean":"2024-09-12T17:14:19.349327+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:14:19.349327+0000","last_undegraded":"2024-09-12T17:14:19.349327+0000","last_fullsized":"2024-09-12T17:14:19.349327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:43.877851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.253865+0000","last_change":"2024-09-12T17:11:04.671482+0000","last_active":"2024-09-12T17:11:49.253865+0000","last_peered":"2024-09-12T17:11:49.253865+0000","last_clean":"2024-09-12T17:11:49.253865+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:11:49.253865+0000","last_undegraded":"2024-09-12T17:11:49.253865+0000","last_fullsized":"2024-09-12T17:11:49.253865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:38.765410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795517+0000","last_change":"2024-09-12T17:11:08.714321+0000","last_active":"2024-09-12T17:11:43.795517+0000","last_peered":"2024-09-12T17:11:43.795517+0000","last_clean":"2024-09-12T17:11:43.795517+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:11:43.795517+0000","last_undegraded":"2024-09-12T17:11:43.795517+0000","last_fullsized":"2024-09-12T17:11:43.795517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.528516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.794826+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:13:16.794826+0000","last_peered":"2024-09-12T17:13:16.794826+0000","last_clean":"2024-09-12T17:13:16.794826+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:13:16.794826+0000","last_undegraded":"2024-09-12T17:13:16.794826+0000","last_fullsized":"2024-09-12T17:13:16.794826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:55.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802521+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:11:43.802521+0000","last_peered":"2024-09-12T17:11:43.802521+0000","last_clean":"2024-09-12T17:11:43.802521+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:11:43.802521+0000","last_undegraded":"2024-09-12T17:11:43.802521+0000","last_fullsized":"2024-09-12T17:11:43.802521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.882893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.732083+0000","last_change":"2024-09-12T17:11:06.701691+0000","last_active":"2024-09-12T17:13:18.732083+0000","last_peered":"2024-09-12T17:13:18.732083+0000","last_clean":"2024-09-12T17:13:18.732083+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:13:18.732083+0000","last_undegraded":"2024-09-12T17:13:18.732083+0000","last_fullsized":"2024-09-12T17:13:18.732083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:07.167115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803892+0000","last_change":"2024-09-12T17:11:04.699477+0000","last_active":"2024-09-12T17:11:43.803892+0000","last_peered":"2024-09-12T17:11:43.803892+0000","last_clean":"2024-09-12T17:11:43.803892+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:11:43.803892+0000","last_undegraded":"2024-09-12T17:11:43.803892+0000","last_fullsized":"2024-09-12T17:11:43.803892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:28.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.812713+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:11:43.812713+0000","last_peered":"2024-09-12T17:11:43.812713+0000","last_clean":"2024-09-12T17:11:43.812713+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:11:43.812713+0000","last_undegraded":"2024-09-12T17:11:43.812713+0000","last_fullsized":"2024-09-12T17:11:43.812713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:20.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955870+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:18.955870+0000","last_peered":"2024-09-12T17:14:18.955870+0000","last_clean":"2024-09-12T17:14:18.955870+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:18.955870+0000","last_undegraded":"2024-09-12T17:14:18.955870+0000","last_fullsized":"2024-09-12T17:14:18.955870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:05.585547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.999516+0000","last_change":"2024-09-12T17:11:06.691786+0000","last_active":"2024-09-12T17:12:33.999516+0000","last_peered":"2024-09-12T17:12:33.999516+0000","last_clean":"2024-09-12T17:12:33.999516+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:12:33.999516+0000","last_undegraded":"2024-09-12T17:12:33.999516+0000","last_fullsized":"2024-09-12T17:12:33.999516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:57.050067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.522609+0000","last_change":"2024-09-12T17:11:04.669381+0000","last_active":"2024-09-12T17:13:18.522609+0000","last_peered":"2024-09-12T17:13:18.522609+0000","last_clean":"2024-09-12T17:13:18.522609+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:13:18.522609+0000","last_undegraded":"2024-09-12T17:13:18.522609+0000","last_fullsized":"2024-09-12T17:13:18.522609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:12.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.759007+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:13:16.759007+0000","last_peered":"2024-09-12T17:13:16.759007+0000","last_clean":"2024-09-12T17:13:16.759007+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:13:16.759007+0000","last_undegraded":"2024-09-12T17:13:16.759007+0000","last_fullsized":"2024-09-12T17:13:16.759007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.685021+0000","last_change":"2024-09-12T17:11:06.693085+0000","last_active":"2024-09-12T17:12:33.685021+0000","last_peered":"2024-09-12T17:12:33.685021+0000","last_clean":"2024-09-12T17:12:33.685021+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:12:33.685021+0000","last_undegraded":"2024-09-12T17:12:33.685021+0000","last_fullsized":"2024-09-12T17:12:33.685021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.660908+0000","last_change":"2024-09-12T17:11:04.705899+0000","last_active":"2024-09-12T17:14:19.660908+0000","last_peered":"2024-09-12T17:14:19.660908+0000","last_clean":"2024-09-12T17:14:19.660908+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:14:19.660908+0000","last_undegraded":"2024-09-12T17:14:19.660908+0000","last_fullsized":"2024-09-12T17:14:19.660908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:02.576860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794217+0000","last_change":"2024-09-12T17:11:08.716093+0000","last_active":"2024-09-12T17:11:43.794217+0000","last_peered":"2024-09-12T17:11:43.794217+0000","last_clean":"2024-09-12T17:11:43.794217+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:11:43.794217+0000","last_undegraded":"2024-09-12T17:11:43.794217+0000","last_fullsized":"2024-09-12T17:11:43.794217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.912768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.760672+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:13:16.760672+0000","last_peered":"2024-09-12T17:13:16.760672+0000","last_clean":"2024-09-12T17:13:16.760672+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.760672+0000","last_undegraded":"2024-09-12T17:13:16.760672+0000","last_fullsized":"2024-09-12T17:13:16.760672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.791235+0000","last_change":"2024-09-12T17:11:43.823977+0000","last_active":"2024-09-12T17:14:19.791235+0000","last_peered":"2024-09-12T17:14:19.791235+0000","last_clean":"2024-09-12T17:14:19.791235+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:14:19.791235+0000","last_undegraded":"2024-09-12T17:14:19.791235+0000","last_fullsized":"2024-09-12T17:14:19.791235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:25.321871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802954+0000","last_change":"2024-09-12T17:11:04.697071+0000","last_active":"2024-09-12T17:11:43.802954+0000","last_peered":"2024-09-12T17:11:43.802954+0000","last_clean":"2024-09-12T17:11:43.802954+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:11:43.802954+0000","last_undegraded":"2024-09-12T17:11:43.802954+0000","last_fullsized":"2024-09-12T17:11:43.802954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:00.835341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.211792+0000","last_change":"2024-09-12T17:11:08.722764+0000","last_active":"2024-09-12T17:13:18.211792+0000","last_peered":"2024-09-12T17:13:18.211792+0000","last_clean":"2024-09-12T17:13:18.211792+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:13:18.211792+0000","last_undegraded":"2024-09-12T17:13:18.211792+0000","last_fullsized":"2024-09-12T17:13:18.211792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:27.090536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.791697+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:13:16.791697+0000","last_peered":"2024-09-12T17:13:16.791697+0000","last_clean":"2024-09-12T17:13:16.791697+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:13:16.791697+0000","last_undegraded":"2024-09-12T17:13:16.791697+0000","last_fullsized":"2024-09-12T17:13:16.791697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699419+0000","last_change":"2024-09-12T17:11:06.689179+0000","last_active":"2024-09-12T17:14:19.699419+0000","last_peered":"2024-09-12T17:14:19.699419+0000","last_clean":"2024-09-12T17:14:19.699419+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:14:19.699419+0000","last_undegraded":"2024-09-12T17:14:19.699419+0000","last_fullsized":"2024-09-12T17:14:19.699419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.719846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820794+0000","last_change":"2024-09-12T17:11:04.677503+0000","last_active":"2024-09-12T17:11:43.820794+0000","last_peered":"2024-09-12T17:11:43.820794+0000","last_clean":"2024-09-12T17:11:43.820794+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:11:43.820794+0000","last_undegraded":"2024-09-12T17:11:43.820794+0000","last_fullsized":"2024-09-12T17:11:43.820794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:52.031685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.793999+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:18.793999+0000","last_peered":"2024-09-12T17:14:18.793999+0000","last_clean":"2024-09-12T17:14:18.793999+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:18.793999+0000","last_undegraded":"2024-09-12T17:14:18.793999+0000","last_fullsized":"2024-09-12T17:14:18.793999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.821261+0000","last_change":"2024-09-12T17:11:06.707086+0000","last_active":"2024-09-12T17:11:43.821261+0000","last_peered":"2024-09-12T17:11:43.821261+0000","last_clean":"2024-09-12T17:11:43.821261+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:11:43.821261+0000","last_undegraded":"2024-09-12T17:11:43.821261+0000","last_fullsized":"2024-09-12T17:11:43.821261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:22.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.788395+0000","last_change":"2024-09-12T17:11:04.672228+0000","last_active":"2024-09-12T17:11:43.788395+0000","last_peered":"2024-09-12T17:11:43.788395+0000","last_clean":"2024-09-12T17:11:43.788395+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:11:43.788395+0000","last_undegraded":"2024-09-12T17:11:43.788395+0000","last_fullsized":"2024-09-12T17:11:43.788395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:53.980176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.730752+0000","last_change":"2024-09-12T17:11:06.700232+0000","last_active":"2024-09-12T17:13:18.730752+0000","last_peered":"2024-09-12T17:13:18.730752+0000","last_clean":"2024-09-12T17:13:18.730752+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:13:18.730752+0000","last_undegraded":"2024-09-12T17:13:18.730752+0000","last_fullsized":"2024-09-12T17:13:18.730752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:44.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.259200+0000","last_change":"2024-09-12T17:11:04.675280+0000","last_active":"2024-09-12T17:11:49.259200+0000","last_peered":"2024-09-12T17:11:49.259200+0000","last_clean":"2024-09-12T17:11:49.259200+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:11:49.259200+0000","last_undegraded":"2024-09-12T17:11:49.259200+0000","last_fullsized":"2024-09-12T17:11:49.259200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:30.778946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.367423+0000","last_change":"2024-09-12T17:11:06.695274+0000","last_active":"2024-09-12T17:14:19.367423+0000","last_peered":"2024-09-12T17:14:19.367423+0000","last_clean":"2024-09-12T17:14:19.367423+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:14:19.367423+0000","last_undegraded":"2024-09-12T17:14:19.367423+0000","last_fullsized":"2024-09-12T17:14:19.367423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.138206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800213+0000","last_change":"2024-09-12T17:11:04.703925+0000","last_active":"2024-09-12T17:11:43.800213+0000","last_peered":"2024-09-12T17:11:43.800213+0000","last_clean":"2024-09-12T17:11:43.800213+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:11:43.800213+0000","last_undegraded":"2024-09-12T17:11:43.800213+0000","last_fullsized":"2024-09-12T17:11:43.800213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759765+0000","last_change":"2024-09-12T17:11:06.703392+0000","last_active":"2024-09-12T17:13:18.759765+0000","last_peered":"2024-09-12T17:13:18.759765+0000","last_clean":"2024-09-12T17:13:18.759765+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:13:18.759765+0000","last_undegraded":"2024-09-12T17:13:18.759765+0000","last_fullsized":"2024-09-12T17:13:18.759765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799380+0000","last_change":"2024-09-12T17:11:04.684732+0000","last_active":"2024-09-12T17:11:43.799380+0000","last_peered":"2024-09-12T17:11:43.799380+0000","last_clean":"2024-09-12T17:11:43.799380+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:11:43.799380+0000","last_undegraded":"2024-09-12T17:11:43.799380+0000","last_fullsized":"2024-09-12T17:11:43.799380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:40.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799093+0000","last_change":"2024-09-12T17:11:06.702655+0000","last_active":"2024-09-12T17:11:43.799093+0000","last_peered":"2024-09-12T17:11:43.799093+0000","last_clean":"2024-09-12T17:11:43.799093+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:11:43.799093+0000","last_undegraded":"2024-09-12T17:11:43.799093+0000","last_fullsized":"2024-09-12T17:11:43.799093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799927+0000","last_change":"2024-09-12T17:11:04.680886+0000","last_active":"2024-09-12T17:11:43.799927+0000","last_peered":"2024-09-12T17:11:43.799927+0000","last_clean":"2024-09-12T17:11:43.799927+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:11:43.799927+0000","last_undegraded":"2024-09-12T17:11:43.799927+0000","last_fullsized":"2024-09-12T17:11:43.799927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:32.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.494618+0000","last_change":"2024-09-12T17:11:06.706847+0000","last_active":"2024-09-12T17:14:19.494618+0000","last_peered":"2024-09-12T17:14:19.494618+0000","last_clean":"2024-09-12T17:14:19.494618+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:14:19.494618+0000","last_undegraded":"2024-09-12T17:14:19.494618+0000","last_fullsized":"2024-09-12T17:14:19.494618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:47.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.693926+0000","last_change":"2024-09-12T17:11:04.669265+0000","last_active":"2024-09-12T17:11:50.693926+0000","last_peered":"2024-09-12T17:11:50.693926+0000","last_clean":"2024-09-12T17:11:50.693926+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:11:50.693926+0000","last_undegraded":"2024-09-12T17:11:50.693926+0000","last_fullsized":"2024-09-12T17:11:50.693926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.747887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758256+0000","last_change":"2024-09-12T17:11:06.699610+0000","last_active":"2024-09-12T17:13:13.758256+0000","last_peered":"2024-09-12T17:13:13.758256+0000","last_clean":"2024-09-12T17:13:13.758256+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:13:13.758256+0000","last_undegraded":"2024-09-12T17:13:13.758256+0000","last_fullsized":"2024-09-12T17:13:13.758256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794970+0000","last_change":"2024-09-12T17:11:04.688321+0000","last_active":"2024-09-12T17:11:43.794970+0000","last_peered":"2024-09-12T17:11:43.794970+0000","last_clean":"2024-09-12T17:11:43.794970+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:11:43.794970+0000","last_undegraded":"2024-09-12T17:11:43.794970+0000","last_fullsized":"2024-09-12T17:11:43.794970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:00.136516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788842+0000","last_change":"2024-09-12T17:11:06.697920+0000","last_active":"2024-09-12T17:14:19.788842+0000","last_peered":"2024-09-12T17:14:19.788842+0000","last_clean":"2024-09-12T17:14:19.788842+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:14:19.788842+0000","last_undegraded":"2024-09-12T17:14:19.788842+0000","last_fullsized":"2024-09-12T17:14:19.788842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:41.481908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803540+0000","last_change":"2024-09-12T17:11:04.678483+0000","last_active":"2024-09-12T17:11:43.803540+0000","last_peered":"2024-09-12T17:11:43.803540+0000","last_clean":"2024-09-12T17:11:43.803540+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:11:43.803540+0000","last_undegraded":"2024-09-12T17:11:43.803540+0000","last_fullsized":"2024-09-12T17:11:43.803540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:32.707968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669536+0000","last_change":"2024-09-12T17:11:06.703492+0000","last_active":"2024-09-12T17:13:14.669536+0000","last_peered":"2024-09-12T17:13:14.669536+0000","last_clean":"2024-09-12T17:13:14.669536+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:13:14.669536+0000","last_undegraded":"2024-09-12T17:13:14.669536+0000","last_fullsized":"2024-09-12T17:13:14.669536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:33.304445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800268+0000","last_change":"2024-09-12T17:11:04.699383+0000","last_active":"2024-09-12T17:11:43.800268+0000","last_peered":"2024-09-12T17:11:43.800268+0000","last_clean":"2024-09-12T17:11:43.800268+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:11:43.800268+0000","last_undegraded":"2024-09-12T17:11:43.800268+0000","last_fullsized":"2024-09-12T17:11:43.800268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:31.767352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797277+0000","last_change":"2024-09-12T17:11:04.684375+0000","last_active":"2024-09-12T17:11:43.797277+0000","last_peered":"2024-09-12T17:11:43.797277+0000","last_clean":"2024-09-12T17:11:43.797277+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:11:43.797277+0000","last_undegraded":"2024-09-12T17:11:43.797277+0000","last_fullsized":"2024-09-12T17:11:43.797277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:05.836478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491265+0000","last_change":"2024-09-12T17:11:06.702748+0000","last_active":"2024-09-12T17:14:19.491265+0000","last_peered":"2024-09-12T17:14:19.491265+0000","last_clean":"2024-09-12T17:14:19.491265+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:14:19.491265+0000","last_undegraded":"2024-09-12T17:14:19.491265+0000","last_fullsized":"2024-09-12T17:14:19.491265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758403+0000","last_change":"2024-09-12T17:11:04.671497+0000","last_active":"2024-09-12T17:13:19.758403+0000","last_peered":"2024-09-12T17:13:19.758403+0000","last_clean":"2024-09-12T17:13:19.758403+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:13:19.758403+0000","last_undegraded":"2024-09-12T17:13:19.758403+0000","last_fullsized":"2024-09-12T17:13:19.758403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:02.752436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'19","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719500+0000","last_change":"2024-09-12T17:11:06.697799+0000","last_active":"2024-09-12T17:14:19.719500+0000","last_peered":"2024-09-12T17:14:19.719500+0000","last_clean":"2024-09-12T17:14:19.719500+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:14:19.719500+0000","last_undegraded":"2024-09-12T17:14:19.719500+0000","last_fullsized":"2024-09-12T17:14:19.719500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:51.237525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807578+0000","last_change":"2024-09-12T17:11:04.669643+0000","last_active":"2024-09-12T17:11:43.807578+0000","last_peered":"2024-09-12T17:11:43.807578+0000","last_clean":"2024-09-12T17:11:43.807578+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:11:43.807578+0000","last_undegraded":"2024-09-12T17:11:43.807578+0000","last_fullsized":"2024-09-12T17:11:43.807578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:12.651503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856748+0000","last_change":"2024-09-12T17:11:06.706910+0000","last_active":"2024-09-12T17:14:19.856748+0000","last_peered":"2024-09-12T17:14:19.856748+0000","last_clean":"2024-09-12T17:14:19.856748+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:14:19.856748+0000","last_undegraded":"2024-09-12T17:14:19.856748+0000","last_fullsized":"2024-09-12T17:14:19.856748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:09.726713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255243+0000","last_change":"2024-09-12T17:11:04.698962+0000","last_active":"2024-09-12T17:11:49.255243+0000","last_peered":"2024-09-12T17:11:49.255243+0000","last_clean":"2024-09-12T17:11:49.255243+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:11:49.255243+0000","last_undegraded":"2024-09-12T17:11:49.255243+0000","last_fullsized":"2024-09-12T17:11:49.255243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:58.287096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856816+0000","last_change":"2024-09-12T17:11:06.698579+0000","last_active":"2024-09-12T17:14:19.856816+0000","last_peered":"2024-09-12T17:14:19.856816+0000","last_clean":"2024-09-12T17:14:19.856816+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:14:19.856816+0000","last_undegraded":"2024-09-12T17:14:19.856816+0000","last_fullsized":"2024-09-12T17:14:19.856816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.305167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.810471+0000","last_change":"2024-09-12T17:11:04.706258+0000","last_active":"2024-09-12T17:11:43.810471+0000","last_peered":"2024-09-12T17:11:43.810471+0000","last_clean":"2024-09-12T17:11:43.810471+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:11:43.810471+0000","last_undegraded":"2024-09-12T17:11:43.810471+0000","last_fullsized":"2024-09-12T17:11:43.810471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.595508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856680+0000","last_change":"2024-09-12T17:11:43.799543+0000","last_active":"2024-09-12T17:14:19.856680+0000","last_peered":"2024-09-12T17:14:19.856680+0000","last_clean":"2024-09-12T17:14:19.856680+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:14:19.856680+0000","last_undegraded":"2024-09-12T17:14:19.856680+0000","last_fullsized":"2024-09-12T17:14:19.856680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.634562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795628+0000","last_change":"2024-09-12T17:11:04.688801+0000","last_active":"2024-09-12T17:11:43.795628+0000","last_peered":"2024-09-12T17:11:43.795628+0000","last_clean":"2024-09-12T17:11:43.795628+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:11:43.795628+0000","last_undegraded":"2024-09-12T17:11:43.795628+0000","last_fullsized":"2024-09-12T17:11:43.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.317920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491662+0000","last_change":"2024-09-12T17:11:06.692150+0000","last_active":"2024-09-12T17:14:19.491662+0000","last_peered":"2024-09-12T17:14:19.491662+0000","last_clean":"2024-09-12T17:14:19.491662+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:14:19.491662+0000","last_undegraded":"2024-09-12T17:14:19.491662+0000","last_fullsized":"2024-09-12T17:14:19.491662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:03.537778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818404+0000","last_change":"2024-09-12T17:11:04.699011+0000","last_active":"2024-09-12T17:11:43.818404+0000","last_peered":"2024-09-12T17:11:43.818404+0000","last_clean":"2024-09-12T17:11:43.818404+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:11:43.818404+0000","last_undegraded":"2024-09-12T17:11:43.818404+0000","last_fullsized":"2024-09-12T17:11:43.818404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.663093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.794825+0000","last_change":"2024-09-12T17:11:04.699035+0000","last_active":"2024-09-12T17:13:24.794825+0000","last_peered":"2024-09-12T17:13:24.794825+0000","last_clean":"2024-09-12T17:13:24.794825+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:13:24.794825+0000","last_undegraded":"2024-09-12T17:13:24.794825+0000","last_fullsized":"2024-09-12T17:13:24.794825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788135+0000","last_change":"2024-09-12T17:11:06.699450+0000","last_active":"2024-09-12T17:14:19.788135+0000","last_peered":"2024-09-12T17:14:19.788135+0000","last_clean":"2024-09-12T17:14:19.788135+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:14:19.788135+0000","last_undegraded":"2024-09-12T17:14:19.788135+0000","last_fullsized":"2024-09-12T17:14:19.788135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.494877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797601+0000","last_change":"2024-09-12T17:11:04.683423+0000","last_active":"2024-09-12T17:11:43.797601+0000","last_peered":"2024-09-12T17:11:43.797601+0000","last_clean":"2024-09-12T17:11:43.797601+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:11:43.797601+0000","last_undegraded":"2024-09-12T17:11:43.797601+0000","last_fullsized":"2024-09-12T17:11:43.797601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.682059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.735133+0000","last_change":"2024-09-12T17:11:06.707075+0000","last_active":"2024-09-12T17:13:18.735133+0000","last_peered":"2024-09-12T17:13:18.735133+0000","last_clean":"2024-09-12T17:13:18.735133+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:13:18.735133+0000","last_undegraded":"2024-09-12T17:13:18.735133+0000","last_fullsized":"2024-09-12T17:13:18.735133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:46.709626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50532,"kb_used_data":11028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321308,"statfs":{"total":96636764160,"available":96585019392,"internally_reserved":0,"allocated":11292672,"data_stored":10961414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44864,"kb_used_data":9520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326976,"statfs":{"total":96636764160,"available":96590823424,"internally_reserved":0,"allocated":9748480,"data_stored":9453120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48136,"kb_used_data":8632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323704,"statfs":{"total":96636764160,"available":96587472896,"internally_reserved":0,"allocated":8839168,"data_stored":8541155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46896,"kb_used_data":11552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324944,"statfs":{"total":96636764160,"available":96588742656,"internally_reserved":0,"allocated":11829248,"data_stored":11550721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:14:51.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:14:51.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.791+0000 7f270fbf4640 1 Processor -- start 2024-09-12T17:14:51.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.791+0000 7f270fbf4640 1 -- start start 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270fbf4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f270812f1e0 0x7f270812f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270fbf4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2708070020 con 0x7f270812fb00 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270fbf4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2708116c80 con 0x7f270812f1e0 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d990640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f270812f1e0 0x7f270812f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d18f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f270812fb00 0x7f2708125330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41758/0 (socket says 172.21.15.62:41758) 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d18f640 1 -- 172.21.15.62:0/1389919726 learned_addr learned my addr 172.21.15.62:0/1389919726 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d990640 1 -- 172.21.15.62:0/1389919726 >> v1:172.21.15.62:6789/0 conn(0x7f270812fb00 legacy=0x7f2708125330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d990640 1 -- 172.21.15.62:0/1389919726 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2708073b50 con 0x7f270812f1e0 2024-09-12T17:14:51.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270c98e640 1 -- 172.21.15.62:0/1389919726 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851102178 0 0) 0x7f2708070020 con 0x7f270812fb00 2024-09-12T17:14:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270d990640 1 --2- 172.21.15.62:0/1389919726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f270812f5c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2704009740 tx=0x7f270401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d553cb218dc4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270c98e640 1 -- 172.21.15.62:0/1389919726 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040b0070 con 0x7f270812f1e0 2024-09-12T17:14:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270c98e640 1 -- 172.21.15.62:0/1389919726 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040ab530 con 0x7f270812f1e0 2024-09-12T17:14:51.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.795+0000 7f270c98e640 1 -- 172.21.15.62:0/1389919726 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040ab830 con 0x7f270812f1e0 2024-09-12T17:14:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/1389919726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 msgr2=0x7f270812f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 --2- 172.21.15.62:0/1389919726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f270812f5c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2704009740 tx=0x7f270401c400 comp rx=0 tx=0).stop 2024-09-12T17:14:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/1389919726 shutdown_connections 2024-09-12T17:14:51.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 --2- 172.21.15.62:0/1389919726 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f270812f5c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/1389919726 >> 172.21.15.62:0/1389919726 conn(0x7f2708071dc0 msgr2=0x7f27080721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/1389919726 shutdown_connections 2024-09-12T17:14:51.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/1389919726 wait complete. 2024-09-12T17:14:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 Processor -- start 2024-09-12T17:14:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- start start 2024-09-12T17:14:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2708137b20 con 0x7f270812f1e0 2024-09-12T17:14:51.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270d990640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270d990640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49046/0 (socket says 172.21.15.62:49046) 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270d990640 1 -- 172.21.15.62:0/2410864660 learned_addr learned my addr 172.21.15.62:0/2410864660 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270d990640 1 -- 172.21.15.62:0/2410864660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27081171e0 con 0x7f270812f1e0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270d990640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f270401a030 tx=0x7f27040191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040b9020 con 0x7f270812f1e0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27040b5480 con 0x7f270812f1e0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27040b0040 con 0x7f270812f1e0 2024-09-12T17:14:51.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2708134480 con 0x7f270812f1e0 2024-09-12T17:14:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.799+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27081242f0 con 0x7f270812f1e0 2024-09-12T17:14:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f270812f5c0 con 0x7f270812f1e0 2024-09-12T17:14:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f27040bc020 con 0x7f270812f1e0 2024-09-12T17:14:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f26fe7fc640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 0x7f26ec03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:51.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f27040e9860 con 0x7f270812f1e0 2024-09-12T17:14:51.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f270d18f640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 0x7f26ec03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:51.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.803+0000 7f270d18f640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 0x7f26ec03d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f26f8007fd0 tx=0x7f26f8007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:51.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.807+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f27040c3030 con 0x7f270812f1e0 2024-09-12T17:14:51.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:51.979+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2708129930 con 0x7f26ec03b1d0 2024-09-12T17:14:52.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.007+0000 7f26fe7fc640 1 -- 172.21.15.62:0/2410864660 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665804 (secure 0 0 0) 0x7f26f80058e0 con 0x7f26ec03b1d0 2024-09-12T17:14:52.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:14:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:14:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 msgr2=0x7f26ec03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 0x7f26ec03d690 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f26f8007fd0 tx=0x7f26f8007900 comp rx=0 tx=0).stop 2024-09-12T17:14:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 msgr2=0x7f2708123db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f270401a030 tx=0x7f27040191a0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 shutdown_connections 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f26ec03b1d0 0x7f26ec03d690 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 --2- 172.21.15.62:0/2410864660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f270812f1e0 0x7f2708123db0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 >> 172.21.15.62:0/2410864660 conn(0x7f2708071dc0 msgr2=0x7f270809bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 shutdown_connections 2024-09-12T17:14:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.015+0000 7f270fbf4640 1 -- 172.21.15.62:0/2410864660 wait complete. 2024-09-12T17:14:52.039 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T17:14:50.776568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412815,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4932,"num_read_kb":4514,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190428,"kb_used_data":40732,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296932,"statfs":{"total":386547056640,"available":386352058368,"internally_reserved":0,"allocated":41709568,"data_stored":40506410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006211"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795920+0000","last_change":"2024-09-12T17:11:04.687200+0000","last_active":"2024-09-12T17:11:43.795920+0000","last_peered":"2024-09-12T17:11:43.795920+0000","last_clean":"2024-09-12T17:11:43.795920+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:11:43.795920+0000","last_undegraded":"2024-09-12T17:11:43.795920+0000","last_fullsized":"2024-09-12T17:11:43.795920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:17.379528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'11","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.875621+0000","last_change":"2024-09-12T17:11:06.702423+0000","last_active":"2024-09-12T17:14:19.875621+0000","last_peered":"2024-09-12T17:14:19.875621+0000","last_clean":"2024-09-12T17:14:19.875621+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:14:19.875621+0000","last_undegraded":"2024-09-12T17:14:19.875621+0000","last_fullsized":"2024-09-12T17:14:19.875621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:45.099418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803085+0000","last_change":"2024-09-12T17:11:04.679163+0000","last_active":"2024-09-12T17:11:43.803085+0000","last_peered":"2024-09-12T17:11:43.803085+0000","last_clean":"2024-09-12T17:11:43.803085+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:11:43.803085+0000","last_undegraded":"2024-09-12T17:11:43.803085+0000","last_fullsized":"2024-09-12T17:11:43.803085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:05.288043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255203+0000","last_change":"2024-09-12T17:11:04.706028+0000","last_active":"2024-09-12T17:11:49.255203+0000","last_peered":"2024-09-12T17:11:49.255203+0000","last_clean":"2024-09-12T17:11:49.255203+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:11:49.255203+0000","last_undegraded":"2024-09-12T17:11:49.255203+0000","last_fullsized":"2024-09-12T17:11:49.255203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:14.130896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794976+0000","last_change":"2024-09-12T17:11:04.672236+0000","last_active":"2024-09-12T17:11:43.794976+0000","last_peered":"2024-09-12T17:11:43.794976+0000","last_clean":"2024-09-12T17:11:43.794976+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:11:43.794976+0000","last_undegraded":"2024-09-12T17:11:43.794976+0000","last_fullsized":"2024-09-12T17:11:43.794976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:53.845369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:47.737476+0000","last_change":"2024-09-12T17:11:43.812377+0000","last_active":"2024-09-12T17:11:47.737476+0000","last_peered":"2024-09-12T17:11:47.737476+0000","last_clean":"2024-09-12T17:11:47.737476+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:11:47.737476+0000","last_undegraded":"2024-09-12T17:11:47.737476+0000","last_fullsized":"2024-09-12T17:11:47.737476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:08.964697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.665616+0000","last_change":"2024-09-12T17:11:04.699008+0000","last_active":"2024-09-12T17:13:18.665616+0000","last_peered":"2024-09-12T17:13:18.665616+0000","last_clean":"2024-09-12T17:13:18.665616+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:13:18.665616+0000","last_undegraded":"2024-09-12T17:13:18.665616+0000","last_fullsized":"2024-09-12T17:13:18.665616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:36.274188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.345961+0000","last_change":"2024-09-12T17:11:06.698107+0000","last_active":"2024-09-12T17:14:19.345961+0000","last_peered":"2024-09-12T17:14:19.345961+0000","last_clean":"2024-09-12T17:14:19.345961+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:14:19.345961+0000","last_undegraded":"2024-09-12T17:14:19.345961+0000","last_fullsized":"2024-09-12T17:14:19.345961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.502410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.652066+0000","last_change":"2024-09-12T17:11:04.670384+0000","last_active":"2024-09-12T17:13:14.652066+0000","last_peered":"2024-09-12T17:13:14.652066+0000","last_clean":"2024-09-12T17:13:14.652066+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:13:14.652066+0000","last_undegraded":"2024-09-12T17:13:14.652066+0000","last_fullsized":"2024-09-12T17:13:14.652066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:45.776683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789877+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.789877+0000","last_peered":"2024-09-12T17:14:19.789877+0000","last_clean":"2024-09-12T17:14:19.789877+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.789877+0000","last_undegraded":"2024-09-12T17:14:19.789877+0000","last_fullsized":"2024-09-12T17:14:19.789877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:24.771164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.951750+0000","last_change":"2024-09-12T17:11:04.695318+0000","last_active":"2024-09-12T17:11:49.951750+0000","last_peered":"2024-09-12T17:11:49.951750+0000","last_clean":"2024-09-12T17:11:49.951750+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:11:49.951750+0000","last_undegraded":"2024-09-12T17:11:49.951750+0000","last_fullsized":"2024-09-12T17:11:49.951750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.828581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492276+0000","last_change":"2024-09-12T17:11:06.694679+0000","last_active":"2024-09-12T17:14:19.492276+0000","last_peered":"2024-09-12T17:14:19.492276+0000","last_clean":"2024-09-12T17:14:19.492276+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:14:19.492276+0000","last_undegraded":"2024-09-12T17:14:19.492276+0000","last_fullsized":"2024-09-12T17:14:19.492276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.652480+0000","last_change":"2024-09-12T17:11:04.675982+0000","last_active":"2024-09-12T17:14:19.652480+0000","last_peered":"2024-09-12T17:14:19.652480+0000","last_clean":"2024-09-12T17:14:19.652480+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:14:19.652480+0000","last_undegraded":"2024-09-12T17:14:19.652480+0000","last_fullsized":"2024-09-12T17:14:19.652480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:46.947849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.714086+0000","last_change":"2024-09-12T17:11:06.700269+0000","last_active":"2024-09-12T17:13:18.714086+0000","last_peered":"2024-09-12T17:13:18.714086+0000","last_clean":"2024-09-12T17:13:18.714086+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:13:18.714086+0000","last_undegraded":"2024-09-12T17:13:18.714086+0000","last_fullsized":"2024-09-12T17:13:18.714086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.761569+0000","last_change":"2024-09-12T17:11:04.678371+0000","last_active":"2024-09-12T17:13:29.761569+0000","last_peered":"2024-09-12T17:13:29.761569+0000","last_clean":"2024-09-12T17:13:29.761569+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:13:29.761569+0000","last_undegraded":"2024-09-12T17:13:29.761569+0000","last_fullsized":"2024-09-12T17:13:29.761569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:06.727515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491645+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:14:19.491645+0000","last_peered":"2024-09-12T17:14:19.491645+0000","last_clean":"2024-09-12T17:14:19.491645+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:14:19.491645+0000","last_undegraded":"2024-09-12T17:14:19.491645+0000","last_fullsized":"2024-09-12T17:14:19.491645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:06.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.261458+0000","last_change":"2024-09-12T17:11:04.700050+0000","last_active":"2024-09-12T17:14:19.261458+0000","last_peered":"2024-09-12T17:14:19.261458+0000","last_clean":"2024-09-12T17:14:19.261458+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:14:19.261458+0000","last_undegraded":"2024-09-12T17:14:19.261458+0000","last_fullsized":"2024-09-12T17:14:19.261458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:44.289638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699394+0000","last_change":"2024-09-12T17:11:06.702528+0000","last_active":"2024-09-12T17:14:19.699394+0000","last_peered":"2024-09-12T17:14:19.699394+0000","last_clean":"2024-09-12T17:14:19.699394+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:14:19.699394+0000","last_undegraded":"2024-09-12T17:14:19.699394+0000","last_fullsized":"2024-09-12T17:14:19.699394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:53.004454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.669138+0000","last_change":"2024-09-12T17:11:04.695415+0000","last_active":"2024-09-12T17:14:19.669138+0000","last_peered":"2024-09-12T17:14:19.669138+0000","last_clean":"2024-09-12T17:14:19.669138+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:14:19.669138+0000","last_undegraded":"2024-09-12T17:14:19.669138+0000","last_fullsized":"2024-09-12T17:14:19.669138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:47.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699210+0000","last_change":"2024-09-12T17:11:06.702654+0000","last_active":"2024-09-12T17:14:19.699210+0000","last_peered":"2024-09-12T17:14:19.699210+0000","last_clean":"2024-09-12T17:14:19.699210+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.699210+0000","last_undegraded":"2024-09-12T17:14:19.699210+0000","last_fullsized":"2024-09-12T17:14:19.699210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.299767+0000","last_change":"2024-09-12T17:11:04.669648+0000","last_active":"2024-09-12T17:14:19.299767+0000","last_peered":"2024-09-12T17:14:19.299767+0000","last_clean":"2024-09-12T17:14:19.299767+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:14:19.299767+0000","last_undegraded":"2024-09-12T17:14:19.299767+0000","last_fullsized":"2024-09-12T17:14:19.299767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:21.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699219+0000","last_change":"2024-09-12T17:11:06.700166+0000","last_active":"2024-09-12T17:14:19.699219+0000","last_peered":"2024-09-12T17:14:19.699219+0000","last_clean":"2024-09-12T17:14:19.699219+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:14:19.699219+0000","last_undegraded":"2024-09-12T17:14:19.699219+0000","last_fullsized":"2024-09-12T17:14:19.699219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.254780+0000","last_change":"2024-09-12T17:11:04.684719+0000","last_active":"2024-09-12T17:11:49.254780+0000","last_peered":"2024-09-12T17:11:49.254780+0000","last_clean":"2024-09-12T17:11:49.254780+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:11:49.254780+0000","last_undegraded":"2024-09-12T17:11:49.254780+0000","last_fullsized":"2024-09-12T17:11:49.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:35.602622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.351380+0000","last_change":"2024-09-12T17:11:06.702307+0000","last_active":"2024-09-12T17:14:19.351380+0000","last_peered":"2024-09-12T17:14:19.351380+0000","last_clean":"2024-09-12T17:14:19.351380+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.351380+0000","last_undegraded":"2024-09-12T17:14:19.351380+0000","last_fullsized":"2024-09-12T17:14:19.351380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:15.153934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801460+0000","last_change":"2024-09-12T17:11:04.693521+0000","last_active":"2024-09-12T17:11:43.801460+0000","last_peered":"2024-09-12T17:11:43.801460+0000","last_clean":"2024-09-12T17:11:43.801460+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:11:43.801460+0000","last_undegraded":"2024-09-12T17:11:43.801460+0000","last_fullsized":"2024-09-12T17:11:43.801460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.412209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491966+0000","last_change":"2024-09-12T17:11:06.695461+0000","last_active":"2024-09-12T17:14:19.491966+0000","last_peered":"2024-09-12T17:14:19.491966+0000","last_clean":"2024-09-12T17:14:19.491966+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:14:19.491966+0000","last_undegraded":"2024-09-12T17:14:19.491966+0000","last_fullsized":"2024-09-12T17:14:19.491966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:05.772132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803636+0000","last_change":"2024-09-12T17:11:04.703079+0000","last_active":"2024-09-12T17:11:43.803636+0000","last_peered":"2024-09-12T17:11:43.803636+0000","last_clean":"2024-09-12T17:11:43.803636+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:11:43.803636+0000","last_undegraded":"2024-09-12T17:11:43.803636+0000","last_fullsized":"2024-09-12T17:11:43.803636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:07.714503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.782694+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:13:16.782694+0000","last_peered":"2024-09-12T17:13:16.782694+0000","last_clean":"2024-09-12T17:13:16.782694+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:13:16.782694+0000","last_undegraded":"2024-09-12T17:13:16.782694+0000","last_fullsized":"2024-09-12T17:13:16.782694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.990500+0000","last_change":"2024-09-12T17:11:06.695753+0000","last_active":"2024-09-12T17:11:49.990500+0000","last_peered":"2024-09-12T17:11:49.990500+0000","last_clean":"2024-09-12T17:11:49.990500+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:11:49.990500+0000","last_undegraded":"2024-09-12T17:11:49.990500+0000","last_fullsized":"2024-09-12T17:11:49.990500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:25.077773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789387+0000","last_change":"2024-09-12T17:11:04.664341+0000","last_active":"2024-09-12T17:11:43.789387+0000","last_peered":"2024-09-12T17:11:43.789387+0000","last_clean":"2024-09-12T17:11:43.789387+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:11:43.789387+0000","last_undegraded":"2024-09-12T17:11:43.789387+0000","last_fullsized":"2024-09-12T17:11:43.789387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.127793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798199+0000","last_change":"2024-09-12T17:11:08.714597+0000","last_active":"2024-09-12T17:11:43.798199+0000","last_peered":"2024-09-12T17:11:43.798199+0000","last_clean":"2024-09-12T17:11:43.798199+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:11:43.798199+0000","last_undegraded":"2024-09-12T17:11:43.798199+0000","last_fullsized":"2024-09-12T17:11:43.798199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:35.426981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788656+0000","last_change":"2024-09-12T17:11:06.695233+0000","last_active":"2024-09-12T17:14:19.788656+0000","last_peered":"2024-09-12T17:14:19.788656+0000","last_clean":"2024-09-12T17:14:19.788656+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:14:19.788656+0000","last_undegraded":"2024-09-12T17:14:19.788656+0000","last_fullsized":"2024-09-12T17:14:19.788656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:07.207850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798159+0000","last_change":"2024-09-12T17:11:04.699166+0000","last_active":"2024-09-12T17:11:43.798159+0000","last_peered":"2024-09-12T17:11:43.798159+0000","last_clean":"2024-09-12T17:11:43.798159+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:11:43.798159+0000","last_undegraded":"2024-09-12T17:11:43.798159+0000","last_fullsized":"2024-09-12T17:11:43.798159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.706422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803868+0000","last_change":"2024-09-12T17:11:08.703714+0000","last_active":"2024-09-12T17:11:43.803868+0000","last_peered":"2024-09-12T17:11:43.803868+0000","last_clean":"2024-09-12T17:11:43.803868+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:11:43.803868+0000","last_undegraded":"2024-09-12T17:11:43.803868+0000","last_fullsized":"2024-09-12T17:11:43.803868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:58.130892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956001+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:18.956001+0000","last_peered":"2024-09-12T17:14:18.956001+0000","last_clean":"2024-09-12T17:14:18.956001+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:18.956001+0000","last_undegraded":"2024-09-12T17:14:18.956001+0000","last_fullsized":"2024-09-12T17:14:18.956001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856648+0000","last_change":"2024-09-12T17:11:06.709890+0000","last_active":"2024-09-12T17:14:19.856648+0000","last_peered":"2024-09-12T17:14:19.856648+0000","last_clean":"2024-09-12T17:14:19.856648+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:14:19.856648+0000","last_undegraded":"2024-09-12T17:14:19.856648+0000","last_fullsized":"2024-09-12T17:14:19.856648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:54.843124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759626+0000","last_change":"2024-09-12T17:11:04.665928+0000","last_active":"2024-09-12T17:13:24.759626+0000","last_peered":"2024-09-12T17:13:24.759626+0000","last_clean":"2024-09-12T17:13:24.759626+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:13:24.759626+0000","last_undegraded":"2024-09-12T17:13:24.759626+0000","last_fullsized":"2024-09-12T17:13:24.759626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:39.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.775565+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:13:16.775565+0000","last_peered":"2024-09-12T17:13:16.775565+0000","last_clean":"2024-09-12T17:13:16.775565+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.775565+0000","last_undegraded":"2024-09-12T17:13:16.775565+0000","last_fullsized":"2024-09-12T17:13:16.775565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.046073+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:20.046073+0000","last_peered":"2024-09-12T17:14:20.046073+0000","last_clean":"2024-09-12T17:14:20.046073+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:20.046073+0000","last_undegraded":"2024-09-12T17:14:20.046073+0000","last_fullsized":"2024-09-12T17:14:20.046073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856733+0000","last_change":"2024-09-12T17:11:06.689516+0000","last_active":"2024-09-12T17:14:19.856733+0000","last_peered":"2024-09-12T17:14:19.856733+0000","last_clean":"2024-09-12T17:14:19.856733+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:14:19.856733+0000","last_undegraded":"2024-09-12T17:14:19.856733+0000","last_fullsized":"2024-09-12T17:14:19.856733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:22.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.707062+0000","last_change":"2024-09-12T17:11:04.670479+0000","last_active":"2024-09-12T17:11:50.707062+0000","last_peered":"2024-09-12T17:11:50.707062+0000","last_clean":"2024-09-12T17:11:50.707062+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:11:50.707062+0000","last_undegraded":"2024-09-12T17:11:50.707062+0000","last_fullsized":"2024-09-12T17:11:50.707062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.055726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801252+0000","last_change":"2024-09-12T17:11:08.711989+0000","last_active":"2024-09-12T17:11:43.801252+0000","last_peered":"2024-09-12T17:11:43.801252+0000","last_clean":"2024-09-12T17:11:43.801252+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:11:43.801252+0000","last_undegraded":"2024-09-12T17:11:43.801252+0000","last_fullsized":"2024-09-12T17:11:43.801252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:37.301429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.788463+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:13:16.788463+0000","last_peered":"2024-09-12T17:13:16.788463+0000","last_clean":"2024-09-12T17:13:16.788463+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:13:16.788463+0000","last_undegraded":"2024-09-12T17:13:16.788463+0000","last_fullsized":"2024-09-12T17:13:16.788463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:45.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.700337+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:12:33.700337+0000","last_peered":"2024-09-12T17:12:33.700337+0000","last_clean":"2024-09-12T17:12:33.700337+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:12:33.700337+0000","last_undegraded":"2024-09-12T17:12:33.700337+0000","last_fullsized":"2024-09-12T17:12:33.700337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:14.320323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758366+0000","last_change":"2024-09-12T17:11:06.691496+0000","last_active":"2024-09-12T17:13:19.758366+0000","last_peered":"2024-09-12T17:13:19.758366+0000","last_clean":"2024-09-12T17:13:19.758366+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:13:19.758366+0000","last_undegraded":"2024-09-12T17:13:19.758366+0000","last_fullsized":"2024-09-12T17:13:19.758366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:04.589070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.844389+0000","last_change":"2024-09-12T17:11:04.674290+0000","last_active":"2024-09-12T17:14:19.844389+0000","last_peered":"2024-09-12T17:14:19.844389+0000","last_clean":"2024-09-12T17:14:19.844389+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:19.844389+0000","last_undegraded":"2024-09-12T17:14:19.844389+0000","last_fullsized":"2024-09-12T17:14:19.844389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:49.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797606+0000","last_change":"2024-09-12T17:11:08.703591+0000","last_active":"2024-09-12T17:11:43.797606+0000","last_peered":"2024-09-12T17:11:43.797606+0000","last_clean":"2024-09-12T17:11:43.797606+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:11:43.797606+0000","last_undegraded":"2024-09-12T17:11:43.797606+0000","last_fullsized":"2024-09-12T17:11:43.797606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:30.362634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.761879+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:13:16.761879+0000","last_peered":"2024-09-12T17:13:16.761879+0000","last_clean":"2024-09-12T17:13:16.761879+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:13:16.761879+0000","last_undegraded":"2024-09-12T17:13:16.761879+0000","last_fullsized":"2024-09-12T17:13:16.761879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797367+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:11:43.797367+0000","last_peered":"2024-09-12T17:11:43.797367+0000","last_clean":"2024-09-12T17:11:43.797367+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:11:43.797367+0000","last_undegraded":"2024-09-12T17:11:43.797367+0000","last_fullsized":"2024-09-12T17:11:43.797367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.311032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:27.988084+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:12:27.988084+0000","last_peered":"2024-09-12T17:12:27.988084+0000","last_clean":"2024-09-12T17:12:27.988084+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:12:27.988084+0000","last_undegraded":"2024-09-12T17:12:27.988084+0000","last_fullsized":"2024-09-12T17:12:27.988084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:12.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699464+0000","last_change":"2024-09-12T17:11:06.696422+0000","last_active":"2024-09-12T17:14:19.699464+0000","last_peered":"2024-09-12T17:14:19.699464+0000","last_clean":"2024-09-12T17:14:19.699464+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:14:19.699464+0000","last_undegraded":"2024-09-12T17:14:19.699464+0000","last_fullsized":"2024-09-12T17:14:19.699464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:01.613538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.666958+0000","last_change":"2024-09-12T17:11:04.702087+0000","last_active":"2024-09-12T17:12:33.666958+0000","last_peered":"2024-09-12T17:12:33.666958+0000","last_clean":"2024-09-12T17:12:33.666958+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:12:33.666958+0000","last_undegraded":"2024-09-12T17:12:33.666958+0000","last_fullsized":"2024-09-12T17:12:33.666958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:25.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802068+0000","last_change":"2024-09-12T17:11:08.703554+0000","last_active":"2024-09-12T17:11:43.802068+0000","last_peered":"2024-09-12T17:11:43.802068+0000","last_clean":"2024-09-12T17:11:43.802068+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:11:43.802068+0000","last_undegraded":"2024-09-12T17:11:43.802068+0000","last_fullsized":"2024-09-12T17:11:43.802068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:43.928545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.790598+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:13:16.790598+0000","last_peered":"2024-09-12T17:13:16.790598+0000","last_clean":"2024-09-12T17:13:16.790598+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:13:16.790598+0000","last_undegraded":"2024-09-12T17:13:16.790598+0000","last_fullsized":"2024-09-12T17:13:16.790598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:15.747423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.066822+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:20.066822+0000","last_peered":"2024-09-12T17:14:20.066822+0000","last_clean":"2024-09-12T17:14:20.066822+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:20.066822+0000","last_undegraded":"2024-09-12T17:14:20.066822+0000","last_fullsized":"2024-09-12T17:14:20.066822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:58.989870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802324+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:11:43.802324+0000","last_peered":"2024-09-12T17:11:43.802324+0000","last_clean":"2024-09-12T17:11:43.802324+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:11:43.802324+0000","last_undegraded":"2024-09-12T17:11:43.802324+0000","last_fullsized":"2024-09-12T17:11:43.802324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:27.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874529+0000","last_change":"2024-09-12T17:11:06.692668+0000","last_active":"2024-09-12T17:14:19.874529+0000","last_peered":"2024-09-12T17:14:19.874529+0000","last_clean":"2024-09-12T17:14:19.874529+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:14:19.874529+0000","last_undegraded":"2024-09-12T17:14:19.874529+0000","last_fullsized":"2024-09-12T17:14:19.874529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804443+0000","last_change":"2024-09-12T17:11:04.705352+0000","last_active":"2024-09-12T17:11:43.804443+0000","last_peered":"2024-09-12T17:11:43.804443+0000","last_clean":"2024-09-12T17:11:43.804443+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:11:43.804443+0000","last_undegraded":"2024-09-12T17:11:43.804443+0000","last_fullsized":"2024-09-12T17:11:43.804443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:32.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798335+0000","last_change":"2024-09-12T17:11:08.718239+0000","last_active":"2024-09-12T17:11:43.798335+0000","last_peered":"2024-09-12T17:11:43.798335+0000","last_clean":"2024-09-12T17:11:43.798335+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:11:43.798335+0000","last_undegraded":"2024-09-12T17:11:43.798335+0000","last_fullsized":"2024-09-12T17:11:43.798335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:05.261510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.792763+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:13:16.792763+0000","last_peered":"2024-09-12T17:13:16.792763+0000","last_clean":"2024-09-12T17:13:16.792763+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:13:16.792763+0000","last_undegraded":"2024-09-12T17:13:16.792763+0000","last_fullsized":"2024-09-12T17:13:16.792763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:08.295074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797078+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:11:43.797078+0000","last_peered":"2024-09-12T17:11:43.797078+0000","last_clean":"2024-09-12T17:11:43.797078+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:11:43.797078+0000","last_undegraded":"2024-09-12T17:11:43.797078+0000","last_fullsized":"2024-09-12T17:11:43.797078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:12.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.020204+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.020204+0000","last_peered":"2024-09-12T17:14:20.020204+0000","last_clean":"2024-09-12T17:14:20.020204+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.020204+0000","last_undegraded":"2024-09-12T17:14:20.020204+0000","last_fullsized":"2024-09-12T17:14:20.020204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:39.726074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.347636+0000","last_change":"2024-09-12T17:11:06.707317+0000","last_active":"2024-09-12T17:14:19.347636+0000","last_peered":"2024-09-12T17:14:19.347636+0000","last_clean":"2024-09-12T17:14:19.347636+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:14:19.347636+0000","last_undegraded":"2024-09-12T17:14:19.347636+0000","last_fullsized":"2024-09-12T17:14:19.347636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:08.491395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798991+0000","last_change":"2024-09-12T17:11:04.681916+0000","last_active":"2024-09-12T17:11:43.798991+0000","last_peered":"2024-09-12T17:11:43.798991+0000","last_clean":"2024-09-12T17:11:43.798991+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:11:43.798991+0000","last_undegraded":"2024-09-12T17:11:43.798991+0000","last_fullsized":"2024-09-12T17:11:43.798991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.532391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793223+0000","last_change":"2024-09-12T17:11:08.714019+0000","last_active":"2024-09-12T17:11:43.793223+0000","last_peered":"2024-09-12T17:11:43.793223+0000","last_clean":"2024-09-12T17:11:43.793223+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:11:43.793223+0000","last_undegraded":"2024-09-12T17:11:43.793223+0000","last_fullsized":"2024-09-12T17:11:43.793223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:48.242476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.760164+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:13:24.760164+0000","last_peered":"2024-09-12T17:13:24.760164+0000","last_clean":"2024-09-12T17:13:24.760164+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:13:24.760164+0000","last_undegraded":"2024-09-12T17:13:24.760164+0000","last_fullsized":"2024-09-12T17:13:24.760164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.382092+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:13:16.382092+0000","last_peered":"2024-09-12T17:13:16.382092+0000","last_clean":"2024-09-12T17:13:16.382092+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:13:16.382092+0000","last_undegraded":"2024-09-12T17:13:16.382092+0000","last_fullsized":"2024-09-12T17:13:16.382092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:53.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856766+0000","last_change":"2024-09-12T17:11:06.709152+0000","last_active":"2024-09-12T17:14:19.856766+0000","last_peered":"2024-09-12T17:14:19.856766+0000","last_clean":"2024-09-12T17:14:19.856766+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:14:19.856766+0000","last_undegraded":"2024-09-12T17:14:19.856766+0000","last_fullsized":"2024-09-12T17:14:19.856766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.578776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802317+0000","last_change":"2024-09-12T17:11:04.693394+0000","last_active":"2024-09-12T17:11:43.802317+0000","last_peered":"2024-09-12T17:11:43.802317+0000","last_clean":"2024-09-12T17:11:43.802317+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:11:43.802317+0000","last_undegraded":"2024-09-12T17:11:43.802317+0000","last_fullsized":"2024-09-12T17:11:43.802317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:25.577954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798665+0000","last_change":"2024-09-12T17:11:08.717768+0000","last_active":"2024-09-12T17:11:43.798665+0000","last_peered":"2024-09-12T17:11:43.798665+0000","last_clean":"2024-09-12T17:11:43.798665+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:11:43.798665+0000","last_undegraded":"2024-09-12T17:11:43.798665+0000","last_fullsized":"2024-09-12T17:11:43.798665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:07.209528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:27.759011+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:13:27.759011+0000","last_peered":"2024-09-12T17:13:27.759011+0000","last_clean":"2024-09-12T17:13:27.759011+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:13:27.759011+0000","last_undegraded":"2024-09-12T17:13:27.759011+0000","last_fullsized":"2024-09-12T17:13:27.759011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.031128+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:20.031128+0000","last_peered":"2024-09-12T17:14:20.031128+0000","last_clean":"2024-09-12T17:14:20.031128+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:20.031128+0000","last_undegraded":"2024-09-12T17:14:20.031128+0000","last_fullsized":"2024-09-12T17:14:20.031128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759536+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:13:18.759536+0000","last_peered":"2024-09-12T17:13:18.759536+0000","last_clean":"2024-09-12T17:13:18.759536+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:13:18.759536+0000","last_undegraded":"2024-09-12T17:13:18.759536+0000","last_fullsized":"2024-09-12T17:13:18.759536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.396693+0000","last_change":"2024-09-12T17:11:06.700331+0000","last_active":"2024-09-12T17:11:50.396693+0000","last_peered":"2024-09-12T17:11:50.396693+0000","last_clean":"2024-09-12T17:11:50.396693+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:11:50.396693+0000","last_undegraded":"2024-09-12T17:11:50.396693+0000","last_fullsized":"2024-09-12T17:11:50.396693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255080+0000","last_change":"2024-09-12T17:11:04.703034+0000","last_active":"2024-09-12T17:11:49.255080+0000","last_peered":"2024-09-12T17:11:49.255080+0000","last_clean":"2024-09-12T17:11:49.255080+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:11:49.255080+0000","last_undegraded":"2024-09-12T17:11:49.255080+0000","last_fullsized":"2024-09-12T17:11:49.255080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:43.087208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225726+0000","last_change":"2024-09-12T17:11:43.830390+0000","last_active":"2024-09-12T17:13:18.225726+0000","last_peered":"2024-09-12T17:13:18.225726+0000","last_clean":"2024-09-12T17:13:18.225726+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:13:18.225726+0000","last_undegraded":"2024-09-12T17:13:18.225726+0000","last_fullsized":"2024-09-12T17:13:18.225726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.971718+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:19.971718+0000","last_peered":"2024-09-12T17:14:19.971718+0000","last_clean":"2024-09-12T17:14:19.971718+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:19.971718+0000","last_undegraded":"2024-09-12T17:14:19.971718+0000","last_fullsized":"2024-09-12T17:14:19.971718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.965720+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:19.965720+0000","last_peered":"2024-09-12T17:14:19.965720+0000","last_clean":"2024-09-12T17:14:19.965720+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:19.965720+0000","last_undegraded":"2024-09-12T17:14:19.965720+0000","last_fullsized":"2024-09-12T17:14:19.965720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492433+0000","last_change":"2024-09-12T17:11:06.707589+0000","last_active":"2024-09-12T17:14:19.492433+0000","last_peered":"2024-09-12T17:14:19.492433+0000","last_clean":"2024-09-12T17:14:19.492433+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:14:19.492433+0000","last_undegraded":"2024-09-12T17:14:19.492433+0000","last_fullsized":"2024-09-12T17:14:19.492433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:48.926839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255268+0000","last_change":"2024-09-12T17:11:04.703521+0000","last_active":"2024-09-12T17:11:49.255268+0000","last_peered":"2024-09-12T17:11:49.255268+0000","last_clean":"2024-09-12T17:11:49.255268+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:11:49.255268+0000","last_undegraded":"2024-09-12T17:11:49.255268+0000","last_fullsized":"2024-09-12T17:11:49.255268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:58.014451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.784611+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:13:16.784611+0000","last_peered":"2024-09-12T17:13:16.784611+0000","last_clean":"2024-09-12T17:13:16.784611+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:13:16.784611+0000","last_undegraded":"2024-09-12T17:13:16.784611+0000","last_fullsized":"2024-09-12T17:13:16.784611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.928411+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:19.928411+0000","last_peered":"2024-09-12T17:14:19.928411+0000","last_clean":"2024-09-12T17:14:19.928411+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:19.928411+0000","last_undegraded":"2024-09-12T17:14:19.928411+0000","last_fullsized":"2024-09-12T17:14:19.928411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669049+0000","last_change":"2024-09-12T17:11:06.709109+0000","last_active":"2024-09-12T17:13:14.669049+0000","last_peered":"2024-09-12T17:13:14.669049+0000","last_clean":"2024-09-12T17:13:14.669049+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:13:14.669049+0000","last_undegraded":"2024-09-12T17:13:14.669049+0000","last_fullsized":"2024-09-12T17:13:14.669049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:51.560480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:49.751999+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:12:49.751999+0000","last_peered":"2024-09-12T17:12:49.751999+0000","last_clean":"2024-09-12T17:12:49.751999+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:12:49.751999+0000","last_undegraded":"2024-09-12T17:12:49.751999+0000","last_fullsized":"2024-09-12T17:12:49.751999+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804184+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:11:43.804184+0000","last_peered":"2024-09-12T17:11:43.804184+0000","last_clean":"2024-09-12T17:11:43.804184+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:11:43.804184+0000","last_undegraded":"2024-09-12T17:11:43.804184+0000","last_fullsized":"2024-09-12T17:11:43.804184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800617+0000","last_change":"2024-09-12T17:11:04.703751+0000","last_active":"2024-09-12T17:11:43.800617+0000","last_peered":"2024-09-12T17:11:43.800617+0000","last_clean":"2024-09-12T17:11:43.800617+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:11:43.800617+0000","last_undegraded":"2024-09-12T17:11:43.800617+0000","last_fullsized":"2024-09-12T17:11:43.800617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818268+0000","last_change":"2024-09-12T17:11:43.816300+0000","last_active":"2024-09-12T17:11:43.818268+0000","last_peered":"2024-09-12T17:11:43.818268+0000","last_clean":"2024-09-12T17:11:43.818268+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:11:43.818268+0000","last_undegraded":"2024-09-12T17:11:43.818268+0000","last_fullsized":"2024-09-12T17:11:43.818268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:37.695610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.800681+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:13:16.800681+0000","last_peered":"2024-09-12T17:13:16.800681+0000","last_clean":"2024-09-12T17:13:16.800681+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:13:16.800681+0000","last_undegraded":"2024-09-12T17:13:16.800681+0000","last_fullsized":"2024-09-12T17:13:16.800681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:40.493734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802475+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:11:43.802475+0000","last_peered":"2024-09-12T17:11:43.802475+0000","last_clean":"2024-09-12T17:11:43.802475+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:11:43.802475+0000","last_undegraded":"2024-09-12T17:11:43.802475+0000","last_fullsized":"2024-09-12T17:11:43.802475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:25.075965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.804563+0000","last_change":"2024-09-12T17:11:06.693422+0000","last_active":"2024-09-12T17:14:19.804563+0000","last_peered":"2024-09-12T17:14:19.804563+0000","last_clean":"2024-09-12T17:14:19.804563+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:14:19.804563+0000","last_undegraded":"2024-09-12T17:14:19.804563+0000","last_fullsized":"2024-09-12T17:14:19.804563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.467976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799232+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:11:43.799232+0000","last_peered":"2024-09-12T17:11:43.799232+0000","last_clean":"2024-09-12T17:11:43.799232+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:11:43.799232+0000","last_undegraded":"2024-09-12T17:11:43.799232+0000","last_fullsized":"2024-09-12T17:11:43.799232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796953+0000","last_change":"2024-09-12T17:11:04.677283+0000","last_active":"2024-09-12T17:11:43.796953+0000","last_peered":"2024-09-12T17:11:43.796953+0000","last_clean":"2024-09-12T17:11:43.796953+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:11:43.796953+0000","last_undegraded":"2024-09-12T17:11:43.796953+0000","last_fullsized":"2024-09-12T17:11:43.796953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.246536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819515+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:11:43.819515+0000","last_peered":"2024-09-12T17:11:43.819515+0000","last_clean":"2024-09-12T17:11:43.819515+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:11:43.819515+0000","last_undegraded":"2024-09-12T17:11:43.819515+0000","last_fullsized":"2024-09-12T17:11:43.819515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.790398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.723137+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:19.723137+0000","last_peered":"2024-09-12T17:14:19.723137+0000","last_clean":"2024-09-12T17:14:19.723137+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:19.723137+0000","last_undegraded":"2024-09-12T17:14:19.723137+0000","last_fullsized":"2024-09-12T17:14:19.723137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:01.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805519+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:11:43.805519+0000","last_peered":"2024-09-12T17:11:43.805519+0000","last_clean":"2024-09-12T17:11:43.805519+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:11:43.805519+0000","last_undegraded":"2024-09-12T17:11:43.805519+0000","last_fullsized":"2024-09-12T17:11:43.805519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:45.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.692612+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:12:33.692612+0000","last_peered":"2024-09-12T17:12:33.692612+0000","last_clean":"2024-09-12T17:12:33.692612+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:12:33.692612+0000","last_undegraded":"2024-09-12T17:12:33.692612+0000","last_fullsized":"2024-09-12T17:12:33.692612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.700288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'25","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.876594+0000","last_change":"2024-09-12T17:11:06.700482+0000","last_active":"2024-09-12T17:14:19.876594+0000","last_peered":"2024-09-12T17:14:19.876594+0000","last_clean":"2024-09-12T17:14:19.876594+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:14:19.876594+0000","last_undegraded":"2024-09-12T17:14:19.876594+0000","last_fullsized":"2024-09-12T17:14:19.876594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:53.954037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791793+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:11:43.791793+0000","last_peered":"2024-09-12T17:11:43.791793+0000","last_clean":"2024-09-12T17:11:43.791793+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:11:43.791793+0000","last_undegraded":"2024-09-12T17:11:43.791793+0000","last_fullsized":"2024-09-12T17:11:43.791793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.978777+0000","last_change":"2024-09-12T17:11:04.677831+0000","last_active":"2024-09-12T17:12:33.978777+0000","last_peered":"2024-09-12T17:12:33.978777+0000","last_clean":"2024-09-12T17:12:33.978777+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:12:33.978777+0000","last_undegraded":"2024-09-12T17:12:33.978777+0000","last_fullsized":"2024-09-12T17:12:33.978777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.505466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793377+0000","last_change":"2024-09-12T17:11:08.712933+0000","last_active":"2024-09-12T17:11:43.793377+0000","last_peered":"2024-09-12T17:11:43.793377+0000","last_clean":"2024-09-12T17:11:43.793377+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:11:43.793377+0000","last_undegraded":"2024-09-12T17:11:43.793377+0000","last_fullsized":"2024-09-12T17:11:43.793377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:59.902245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956445+0000","last_change":"2024-09-12T17:11:10.735305+0000","last_active":"2024-09-12T17:14:18.956445+0000","last_peered":"2024-09-12T17:14:18.956445+0000","last_clean":"2024-09-12T17:14:18.956445+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:14:18.956445+0000","last_undegraded":"2024-09-12T17:14:18.956445+0000","last_fullsized":"2024-09-12T17:14:18.956445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:41.801702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799591+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:11:43.799591+0000","last_peered":"2024-09-12T17:11:43.799591+0000","last_clean":"2024-09-12T17:11:43.799591+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:11:43.799591+0000","last_undegraded":"2024-09-12T17:11:43.799591+0000","last_fullsized":"2024-09-12T17:11:43.799591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:20.273638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.684614+0000","last_change":"2024-09-12T17:11:06.701808+0000","last_active":"2024-09-12T17:12:33.684614+0000","last_peered":"2024-09-12T17:12:33.684614+0000","last_clean":"2024-09-12T17:12:33.684614+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:12:33.684614+0000","last_undegraded":"2024-09-12T17:12:33.684614+0000","last_fullsized":"2024-09-12T17:12:33.684614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:46.068569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799665+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:11:43.799665+0000","last_peered":"2024-09-12T17:11:43.799665+0000","last_clean":"2024-09-12T17:11:43.799665+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.799665+0000","last_undegraded":"2024-09-12T17:11:43.799665+0000","last_fullsized":"2024-09-12T17:11:43.799665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791477+0000","last_change":"2024-09-12T17:11:04.674550+0000","last_active":"2024-09-12T17:11:43.791477+0000","last_peered":"2024-09-12T17:11:43.791477+0000","last_clean":"2024-09-12T17:11:43.791477+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:11:43.791477+0000","last_undegraded":"2024-09-12T17:11:43.791477+0000","last_fullsized":"2024-09-12T17:11:43.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800092+0000","last_change":"2024-09-12T17:11:08.711996+0000","last_active":"2024-09-12T17:11:43.800092+0000","last_peered":"2024-09-12T17:11:43.800092+0000","last_clean":"2024-09-12T17:11:43.800092+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:11:43.800092+0000","last_undegraded":"2024-09-12T17:11:43.800092+0000","last_fullsized":"2024-09-12T17:11:43.800092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:39.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.753060+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.753060+0000","last_peered":"2024-09-12T17:14:18.753060+0000","last_clean":"2024-09-12T17:14:18.753060+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.753060+0000","last_undegraded":"2024-09-12T17:14:18.753060+0000","last_fullsized":"2024-09-12T17:14:18.753060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:23.846254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818300+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:11:43.818300+0000","last_peered":"2024-09-12T17:11:43.818300+0000","last_clean":"2024-09-12T17:11:43.818300+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:11:43.818300+0000","last_undegraded":"2024-09-12T17:11:43.818300+0000","last_fullsized":"2024-09-12T17:11:43.818300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:33.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.354515+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:18.354515+0000","last_peered":"2024-09-12T17:13:18.354515+0000","last_clean":"2024-09-12T17:13:18.354515+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:18.354515+0000","last_undegraded":"2024-09-12T17:13:18.354515+0000","last_fullsized":"2024-09-12T17:13:18.354515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:16.583308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789879+0000","last_change":"2024-09-12T17:11:06.705536+0000","last_active":"2024-09-12T17:14:19.789879+0000","last_peered":"2024-09-12T17:14:19.789879+0000","last_clean":"2024-09-12T17:14:19.789879+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:14:19.789879+0000","last_undegraded":"2024-09-12T17:14:19.789879+0000","last_fullsized":"2024-09-12T17:14:19.789879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:27.457528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:12.755500+0000","last_change":"2024-09-12T17:11:04.674617+0000","last_active":"2024-09-12T17:13:12.755500+0000","last_peered":"2024-09-12T17:13:12.755500+0000","last_clean":"2024-09-12T17:13:12.755500+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:13:12.755500+0000","last_undegraded":"2024-09-12T17:13:12.755500+0000","last_fullsized":"2024-09-12T17:13:12.755500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:54.666558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799080+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:11:43.799080+0000","last_peered":"2024-09-12T17:11:43.799080+0000","last_clean":"2024-09-12T17:11:43.799080+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:11:43.799080+0000","last_undegraded":"2024-09-12T17:11:43.799080+0000","last_fullsized":"2024-09-12T17:11:43.799080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758361+0000","last_change":"2024-09-12T17:11:08.714792+0000","last_active":"2024-09-12T17:13:13.758361+0000","last_peered":"2024-09-12T17:13:13.758361+0000","last_clean":"2024-09-12T17:13:13.758361+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:13:13.758361+0000","last_undegraded":"2024-09-12T17:13:13.758361+0000","last_fullsized":"2024-09-12T17:13:13.758361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:27.037237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.802368+0000","last_change":"2024-09-12T17:11:10.745089+0000","last_active":"2024-09-12T17:13:16.802368+0000","last_peered":"2024-09-12T17:13:16.802368+0000","last_clean":"2024-09-12T17:13:16.802368+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:13:16.802368+0000","last_undegraded":"2024-09-12T17:13:16.802368+0000","last_fullsized":"2024-09-12T17:13:16.802368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.460174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791955+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:11:43.791955+0000","last_peered":"2024-09-12T17:11:43.791955+0000","last_clean":"2024-09-12T17:11:43.791955+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:11:43.791955+0000","last_undegraded":"2024-09-12T17:11:43.791955+0000","last_fullsized":"2024-09-12T17:11:43.791955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.574053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807673+0000","last_change":"2024-09-12T17:11:06.705517+0000","last_active":"2024-09-12T17:11:43.807673+0000","last_peered":"2024-09-12T17:11:43.807673+0000","last_clean":"2024-09-12T17:11:43.807673+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:11:43.807673+0000","last_undegraded":"2024-09-12T17:11:43.807673+0000","last_fullsized":"2024-09-12T17:11:43.807673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:59.554886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799985+0000","last_change":"2024-09-12T17:11:04.676312+0000","last_active":"2024-09-12T17:11:43.799985+0000","last_peered":"2024-09-12T17:11:43.799985+0000","last_clean":"2024-09-12T17:11:43.799985+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:11:43.799985+0000","last_undegraded":"2024-09-12T17:11:43.799985+0000","last_fullsized":"2024-09-12T17:11:43.799985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:42.964413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809982+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:11:43.809982+0000","last_peered":"2024-09-12T17:11:43.809982+0000","last_clean":"2024-09-12T17:11:43.809982+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.809982+0000","last_undegraded":"2024-09-12T17:11:43.809982+0000","last_fullsized":"2024-09-12T17:11:43.809982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797949+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:11:43.797949+0000","last_peered":"2024-09-12T17:11:43.797949+0000","last_clean":"2024-09-12T17:11:43.797949+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:11:43.797949+0000","last_undegraded":"2024-09-12T17:11:43.797949+0000","last_fullsized":"2024-09-12T17:11:43.797949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:09.523951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802889+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:11:43.802889+0000","last_peered":"2024-09-12T17:11:43.802889+0000","last_clean":"2024-09-12T17:11:43.802889+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:11:43.802889+0000","last_undegraded":"2024-09-12T17:11:43.802889+0000","last_fullsized":"2024-09-12T17:11:43.802889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:43.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955798+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:18.955798+0000","last_peered":"2024-09-12T17:14:18.955798+0000","last_clean":"2024-09-12T17:14:18.955798+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:18.955798+0000","last_undegraded":"2024-09-12T17:14:18.955798+0000","last_fullsized":"2024-09-12T17:14:18.955798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:29.442661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.700276+0000","last_change":"2024-09-12T17:11:06.689832+0000","last_active":"2024-09-12T17:14:19.700276+0000","last_peered":"2024-09-12T17:14:19.700276+0000","last_clean":"2024-09-12T17:14:19.700276+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:14:19.700276+0000","last_undegraded":"2024-09-12T17:14:19.700276+0000","last_fullsized":"2024-09-12T17:14:19.700276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:21.208607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819353+0000","last_change":"2024-09-12T17:11:04.694780+0000","last_active":"2024-09-12T17:11:43.819353+0000","last_peered":"2024-09-12T17:11:43.819353+0000","last_clean":"2024-09-12T17:11:43.819353+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:11:43.819353+0000","last_undegraded":"2024-09-12T17:11:43.819353+0000","last_fullsized":"2024-09-12T17:11:43.819353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.499606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802798+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:11:43.802798+0000","last_peered":"2024-09-12T17:11:43.802798+0000","last_clean":"2024-09-12T17:11:43.802798+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:11:43.802798+0000","last_undegraded":"2024-09-12T17:11:43.802798+0000","last_fullsized":"2024-09-12T17:11:43.802798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801258+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:11:43.801258+0000","last_peered":"2024-09-12T17:11:43.801258+0000","last_clean":"2024-09-12T17:11:43.801258+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:11:43.801258+0000","last_undegraded":"2024-09-12T17:11:43.801258+0000","last_fullsized":"2024-09-12T17:11:43.801258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:25.268216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:34.005760+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:12:34.005760+0000","last_peered":"2024-09-12T17:12:34.005760+0000","last_clean":"2024-09-12T17:12:34.005760+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:12:34.005760+0000","last_undegraded":"2024-09-12T17:12:34.005760+0000","last_fullsized":"2024-09-12T17:12:34.005760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:11.052561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.021940+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:20.021940+0000","last_peered":"2024-09-12T17:14:20.021940+0000","last_clean":"2024-09-12T17:14:20.021940+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:20.021940+0000","last_undegraded":"2024-09-12T17:14:20.021940+0000","last_fullsized":"2024-09-12T17:14:20.021940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.857216+0000","last_change":"2024-09-12T17:11:06.691701+0000","last_active":"2024-09-12T17:14:19.857216+0000","last_peered":"2024-09-12T17:14:19.857216+0000","last_clean":"2024-09-12T17:14:19.857216+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:14:19.857216+0000","last_undegraded":"2024-09-12T17:14:19.857216+0000","last_fullsized":"2024-09-12T17:14:19.857216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:40.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.678202+0000","last_change":"2024-09-12T17:11:04.669503+0000","last_active":"2024-09-12T17:14:19.678202+0000","last_peered":"2024-09-12T17:14:19.678202+0000","last_clean":"2024-09-12T17:14:19.678202+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:19.678202+0000","last_undegraded":"2024-09-12T17:14:19.678202+0000","last_fullsized":"2024-09-12T17:14:19.678202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:08.595800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.817481+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:11:43.817481+0000","last_peered":"2024-09-12T17:11:43.817481+0000","last_clean":"2024-09-12T17:11:43.817481+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:11:43.817481+0000","last_undegraded":"2024-09-12T17:11:43.817481+0000","last_fullsized":"2024-09-12T17:11:43.817481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801939+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:11:43.801939+0000","last_peered":"2024-09-12T17:11:43.801939+0000","last_clean":"2024-09-12T17:11:43.801939+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:11:43.801939+0000","last_undegraded":"2024-09-12T17:11:43.801939+0000","last_fullsized":"2024-09-12T17:11:43.801939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'84","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.781712+0000","last_change":"2024-09-12T17:11:10.745211+0000","last_active":"2024-09-12T17:13:16.781712+0000","last_peered":"2024-09-12T17:13:16.781712+0000","last_clean":"2024-09-12T17:13:16.781712+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:13:16.781712+0000","last_undegraded":"2024-09-12T17:13:16.781712+0000","last_fullsized":"2024-09-12T17:13:16.781712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:31.455841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799656+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:11:43.799656+0000","last_peered":"2024-09-12T17:11:43.799656+0000","last_clean":"2024-09-12T17:11:43.799656+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:11:43.799656+0000","last_undegraded":"2024-09-12T17:11:43.799656+0000","last_fullsized":"2024-09-12T17:11:43.799656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:05.933362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.399063+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:11:50.399063+0000","last_peered":"2024-09-12T17:11:50.399063+0000","last_clean":"2024-09-12T17:11:50.399063+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:11:50.399063+0000","last_undegraded":"2024-09-12T17:11:50.399063+0000","last_fullsized":"2024-09-12T17:11:50.399063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:09.467743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699249+0000","last_change":"2024-09-12T17:11:06.700916+0000","last_active":"2024-09-12T17:14:19.699249+0000","last_peered":"2024-09-12T17:14:19.699249+0000","last_clean":"2024-09-12T17:14:19.699249+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:14:19.699249+0000","last_undegraded":"2024-09-12T17:14:19.699249+0000","last_fullsized":"2024-09-12T17:14:19.699249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:56.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795133+0000","last_change":"2024-09-12T17:11:04.704630+0000","last_active":"2024-09-12T17:13:24.795133+0000","last_peered":"2024-09-12T17:13:24.795133+0000","last_clean":"2024-09-12T17:13:24.795133+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:13:24.795133+0000","last_undegraded":"2024-09-12T17:13:24.795133+0000","last_fullsized":"2024-09-12T17:13:24.795133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:49.225315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225988+0000","last_change":"2024-09-12T17:11:08.715453+0000","last_active":"2024-09-12T17:13:18.225988+0000","last_peered":"2024-09-12T17:13:18.225988+0000","last_clean":"2024-09-12T17:13:18.225988+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:13:18.225988+0000","last_undegraded":"2024-09-12T17:13:18.225988+0000","last_fullsized":"2024-09-12T17:13:18.225988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:50.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.789489+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:13:16.789489+0000","last_peered":"2024-09-12T17:13:16.789489+0000","last_clean":"2024-09-12T17:13:16.789489+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:13:16.789489+0000","last_undegraded":"2024-09-12T17:13:16.789489+0000","last_fullsized":"2024-09-12T17:13:16.789489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.384651+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.384651+0000","last_peered":"2024-09-12T17:13:16.384651+0000","last_clean":"2024-09-12T17:13:16.384651+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.384651+0000","last_undegraded":"2024-09-12T17:13:16.384651+0000","last_fullsized":"2024-09-12T17:13:16.384651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:59.671012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807517+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:11:43.807517+0000","last_peered":"2024-09-12T17:11:43.807517+0000","last_clean":"2024-09-12T17:11:43.807517+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:11:43.807517+0000","last_undegraded":"2024-09-12T17:11:43.807517+0000","last_fullsized":"2024-09-12T17:11:43.807517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:32.760064+0000","last_change":"2024-09-12T17:11:04.674643+0000","last_active":"2024-09-12T17:13:32.760064+0000","last_peered":"2024-09-12T17:13:32.760064+0000","last_clean":"2024-09-12T17:13:32.760064+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:13:32.760064+0000","last_undegraded":"2024-09-12T17:13:32.760064+0000","last_fullsized":"2024-09-12T17:13:32.760064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.872048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.668281+0000","last_change":"2024-09-12T17:11:06.691887+0000","last_active":"2024-09-12T17:13:14.668281+0000","last_peered":"2024-09-12T17:13:14.668281+0000","last_clean":"2024-09-12T17:13:14.668281+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:13:14.668281+0000","last_undegraded":"2024-09-12T17:13:14.668281+0000","last_fullsized":"2024-09-12T17:13:14.668281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794222+0000","last_change":"2024-09-12T17:11:04.688216+0000","last_active":"2024-09-12T17:11:43.794222+0000","last_peered":"2024-09-12T17:11:43.794222+0000","last_clean":"2024-09-12T17:11:43.794222+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:11:43.794222+0000","last_undegraded":"2024-09-12T17:11:43.794222+0000","last_fullsized":"2024-09-12T17:11:43.794222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790045+0000","last_change":"2024-09-12T17:11:08.715785+0000","last_active":"2024-09-12T17:11:43.790045+0000","last_peered":"2024-09-12T17:11:43.790045+0000","last_clean":"2024-09-12T17:11:43.790045+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:11:43.790045+0000","last_undegraded":"2024-09-12T17:11:43.790045+0000","last_fullsized":"2024-09-12T17:11:43.790045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:51.935358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.846470+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:18.846470+0000","last_peered":"2024-09-12T17:14:18.846470+0000","last_clean":"2024-09-12T17:14:18.846470+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:18.846470+0000","last_undegraded":"2024-09-12T17:14:18.846470+0000","last_fullsized":"2024-09-12T17:14:18.846470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789528+0000","last_change":"2024-09-12T17:11:06.689927+0000","last_active":"2024-09-12T17:14:19.789528+0000","last_peered":"2024-09-12T17:14:19.789528+0000","last_clean":"2024-09-12T17:14:19.789528+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:14:19.789528+0000","last_undegraded":"2024-09-12T17:14:19.789528+0000","last_fullsized":"2024-09-12T17:14:19.789528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820672+0000","last_change":"2024-09-12T17:11:04.693759+0000","last_active":"2024-09-12T17:11:43.820672+0000","last_peered":"2024-09-12T17:11:43.820672+0000","last_clean":"2024-09-12T17:11:43.820672+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:11:43.820672+0000","last_undegraded":"2024-09-12T17:11:43.820672+0000","last_fullsized":"2024-09-12T17:11:43.820672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:38.114303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.770620+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:13:16.770620+0000","last_peered":"2024-09-12T17:13:16.770620+0000","last_clean":"2024-09-12T17:13:16.770620+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:13:16.770620+0000","last_undegraded":"2024-09-12T17:13:16.770620+0000","last_fullsized":"2024-09-12T17:13:16.770620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874185+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.874185+0000","last_peered":"2024-09-12T17:14:19.874185+0000","last_clean":"2024-09-12T17:14:19.874185+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.874185+0000","last_undegraded":"2024-09-12T17:14:19.874185+0000","last_fullsized":"2024-09-12T17:14:19.874185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.972646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799635+0000","last_change":"2024-09-12T17:11:04.703253+0000","last_active":"2024-09-12T17:11:43.799635+0000","last_peered":"2024-09-12T17:11:43.799635+0000","last_clean":"2024-09-12T17:11:43.799635+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:11:43.799635+0000","last_undegraded":"2024-09-12T17:11:43.799635+0000","last_fullsized":"2024-09-12T17:11:43.799635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:31.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803741+0000","last_change":"2024-09-12T17:11:08.711173+0000","last_active":"2024-09-12T17:11:43.803741+0000","last_peered":"2024-09-12T17:11:43.803741+0000","last_clean":"2024-09-12T17:11:43.803741+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:11:43.803741+0000","last_undegraded":"2024-09-12T17:11:43.803741+0000","last_fullsized":"2024-09-12T17:11:43.803741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:01.083466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.798275+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:13:16.798275+0000","last_peered":"2024-09-12T17:13:16.798275+0000","last_clean":"2024-09-12T17:13:16.798275+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:13:16.798275+0000","last_undegraded":"2024-09-12T17:13:16.798275+0000","last_fullsized":"2024-09-12T17:13:16.798275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.787946+0000","last_change":"2024-09-12T17:11:06.709521+0000","last_active":"2024-09-12T17:14:19.787946+0000","last_peered":"2024-09-12T17:14:19.787946+0000","last_clean":"2024-09-12T17:14:19.787946+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:14:19.787946+0000","last_undegraded":"2024-09-12T17:14:19.787946+0000","last_fullsized":"2024-09-12T17:14:19.787946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:54.551330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800701+0000","last_change":"2024-09-12T17:11:04.666747+0000","last_active":"2024-09-12T17:11:43.800701+0000","last_peered":"2024-09-12T17:11:43.800701+0000","last_clean":"2024-09-12T17:11:43.800701+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:11:43.800701+0000","last_undegraded":"2024-09-12T17:11:43.800701+0000","last_fullsized":"2024-09-12T17:11:43.800701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:22.246442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814579+0000","last_change":"2024-09-12T17:11:43.809305+0000","last_active":"2024-09-12T17:11:43.814579+0000","last_peered":"2024-09-12T17:11:43.814579+0000","last_clean":"2024-09-12T17:11:43.814579+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:11:43.814579+0000","last_undegraded":"2024-09-12T17:11:43.814579+0000","last_fullsized":"2024-09-12T17:11:43.814579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:04.779608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.771611+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:13:16.771611+0000","last_peered":"2024-09-12T17:13:16.771611+0000","last_clean":"2024-09-12T17:13:16.771611+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:13:16.771611+0000","last_undegraded":"2024-09-12T17:13:16.771611+0000","last_fullsized":"2024-09-12T17:13:16.771611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.349327+0000","last_change":"2024-09-12T17:11:06.709586+0000","last_active":"2024-09-12T17:14:19.349327+0000","last_peered":"2024-09-12T17:14:19.349327+0000","last_clean":"2024-09-12T17:14:19.349327+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:14:19.349327+0000","last_undegraded":"2024-09-12T17:14:19.349327+0000","last_fullsized":"2024-09-12T17:14:19.349327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:43.877851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.253865+0000","last_change":"2024-09-12T17:11:04.671482+0000","last_active":"2024-09-12T17:11:49.253865+0000","last_peered":"2024-09-12T17:11:49.253865+0000","last_clean":"2024-09-12T17:11:49.253865+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:11:49.253865+0000","last_undegraded":"2024-09-12T17:11:49.253865+0000","last_fullsized":"2024-09-12T17:11:49.253865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:38.765410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795517+0000","last_change":"2024-09-12T17:11:08.714321+0000","last_active":"2024-09-12T17:11:43.795517+0000","last_peered":"2024-09-12T17:11:43.795517+0000","last_clean":"2024-09-12T17:11:43.795517+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:11:43.795517+0000","last_undegraded":"2024-09-12T17:11:43.795517+0000","last_fullsized":"2024-09-12T17:11:43.795517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.528516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.794826+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:13:16.794826+0000","last_peered":"2024-09-12T17:13:16.794826+0000","last_clean":"2024-09-12T17:13:16.794826+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:13:16.794826+0000","last_undegraded":"2024-09-12T17:13:16.794826+0000","last_fullsized":"2024-09-12T17:13:16.794826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:55.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802521+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:11:43.802521+0000","last_peered":"2024-09-12T17:11:43.802521+0000","last_clean":"2024-09-12T17:11:43.802521+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:11:43.802521+0000","last_undegraded":"2024-09-12T17:11:43.802521+0000","last_fullsized":"2024-09-12T17:11:43.802521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.882893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.732083+0000","last_change":"2024-09-12T17:11:06.701691+0000","last_active":"2024-09-12T17:13:18.732083+0000","last_peered":"2024-09-12T17:13:18.732083+0000","last_clean":"2024-09-12T17:13:18.732083+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:13:18.732083+0000","last_undegraded":"2024-09-12T17:13:18.732083+0000","last_fullsized":"2024-09-12T17:13:18.732083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:07.167115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803892+0000","last_change":"2024-09-12T17:11:04.699477+0000","last_active":"2024-09-12T17:11:43.803892+0000","last_peered":"2024-09-12T17:11:43.803892+0000","last_clean":"2024-09-12T17:11:43.803892+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:11:43.803892+0000","last_undegraded":"2024-09-12T17:11:43.803892+0000","last_fullsized":"2024-09-12T17:11:43.803892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:28.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.812713+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:11:43.812713+0000","last_peered":"2024-09-12T17:11:43.812713+0000","last_clean":"2024-09-12T17:11:43.812713+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:11:43.812713+0000","last_undegraded":"2024-09-12T17:11:43.812713+0000","last_fullsized":"2024-09-12T17:11:43.812713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:20.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955870+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:18.955870+0000","last_peered":"2024-09-12T17:14:18.955870+0000","last_clean":"2024-09-12T17:14:18.955870+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:18.955870+0000","last_undegraded":"2024-09-12T17:14:18.955870+0000","last_fullsized":"2024-09-12T17:14:18.955870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:05.585547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.999516+0000","last_change":"2024-09-12T17:11:06.691786+0000","last_active":"2024-09-12T17:12:33.999516+0000","last_peered":"2024-09-12T17:12:33.999516+0000","last_clean":"2024-09-12T17:12:33.999516+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:12:33.999516+0000","last_undegraded":"2024-09-12T17:12:33.999516+0000","last_fullsized":"2024-09-12T17:12:33.999516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:57.050067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.522609+0000","last_change":"2024-09-12T17:11:04.669381+0000","last_active":"2024-09-12T17:13:18.522609+0000","last_peered":"2024-09-12T17:13:18.522609+0000","last_clean":"2024-09-12T17:13:18.522609+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:13:18.522609+0000","last_undegraded":"2024-09-12T17:13:18.522609+0000","last_fullsized":"2024-09-12T17:13:18.522609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:12.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.759007+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:13:16.759007+0000","last_peered":"2024-09-12T17:13:16.759007+0000","last_clean":"2024-09-12T17:13:16.759007+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:13:16.759007+0000","last_undegraded":"2024-09-12T17:13:16.759007+0000","last_fullsized":"2024-09-12T17:13:16.759007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.685021+0000","last_change":"2024-09-12T17:11:06.693085+0000","last_active":"2024-09-12T17:12:33.685021+0000","last_peered":"2024-09-12T17:12:33.685021+0000","last_clean":"2024-09-12T17:12:33.685021+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:12:33.685021+0000","last_undegraded":"2024-09-12T17:12:33.685021+0000","last_fullsized":"2024-09-12T17:12:33.685021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.660908+0000","last_change":"2024-09-12T17:11:04.705899+0000","last_active":"2024-09-12T17:14:19.660908+0000","last_peered":"2024-09-12T17:14:19.660908+0000","last_clean":"2024-09-12T17:14:19.660908+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:14:19.660908+0000","last_undegraded":"2024-09-12T17:14:19.660908+0000","last_fullsized":"2024-09-12T17:14:19.660908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:02.576860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794217+0000","last_change":"2024-09-12T17:11:08.716093+0000","last_active":"2024-09-12T17:11:43.794217+0000","last_peered":"2024-09-12T17:11:43.794217+0000","last_clean":"2024-09-12T17:11:43.794217+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:11:43.794217+0000","last_undegraded":"2024-09-12T17:11:43.794217+0000","last_fullsized":"2024-09-12T17:11:43.794217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.912768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.760672+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:13:16.760672+0000","last_peered":"2024-09-12T17:13:16.760672+0000","last_clean":"2024-09-12T17:13:16.760672+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.760672+0000","last_undegraded":"2024-09-12T17:13:16.760672+0000","last_fullsized":"2024-09-12T17:13:16.760672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.791235+0000","last_change":"2024-09-12T17:11:43.823977+0000","last_active":"2024-09-12T17:14:19.791235+0000","last_peered":"2024-09-12T17:14:19.791235+0000","last_clean":"2024-09-12T17:14:19.791235+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:14:19.791235+0000","last_undegraded":"2024-09-12T17:14:19.791235+0000","last_fullsized":"2024-09-12T17:14:19.791235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:25.321871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802954+0000","last_change":"2024-09-12T17:11:04.697071+0000","last_active":"2024-09-12T17:11:43.802954+0000","last_peered":"2024-09-12T17:11:43.802954+0000","last_clean":"2024-09-12T17:11:43.802954+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:11:43.802954+0000","last_undegraded":"2024-09-12T17:11:43.802954+0000","last_fullsized":"2024-09-12T17:11:43.802954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:00.835341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.211792+0000","last_change":"2024-09-12T17:11:08.722764+0000","last_active":"2024-09-12T17:13:18.211792+0000","last_peered":"2024-09-12T17:13:18.211792+0000","last_clean":"2024-09-12T17:13:18.211792+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:13:18.211792+0000","last_undegraded":"2024-09-12T17:13:18.211792+0000","last_fullsized":"2024-09-12T17:13:18.211792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:27.090536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.791697+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:13:16.791697+0000","last_peered":"2024-09-12T17:13:16.791697+0000","last_clean":"2024-09-12T17:13:16.791697+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:13:16.791697+0000","last_undegraded":"2024-09-12T17:13:16.791697+0000","last_fullsized":"2024-09-12T17:13:16.791697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699419+0000","last_change":"2024-09-12T17:11:06.689179+0000","last_active":"2024-09-12T17:14:19.699419+0000","last_peered":"2024-09-12T17:14:19.699419+0000","last_clean":"2024-09-12T17:14:19.699419+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:14:19.699419+0000","last_undegraded":"2024-09-12T17:14:19.699419+0000","last_fullsized":"2024-09-12T17:14:19.699419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.719846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820794+0000","last_change":"2024-09-12T17:11:04.677503+0000","last_active":"2024-09-12T17:11:43.820794+0000","last_peered":"2024-09-12T17:11:43.820794+0000","last_clean":"2024-09-12T17:11:43.820794+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:11:43.820794+0000","last_undegraded":"2024-09-12T17:11:43.820794+0000","last_fullsized":"2024-09-12T17:11:43.820794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:52.031685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.793999+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:18.793999+0000","last_peered":"2024-09-12T17:14:18.793999+0000","last_clean":"2024-09-12T17:14:18.793999+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:18.793999+0000","last_undegraded":"2024-09-12T17:14:18.793999+0000","last_fullsized":"2024-09-12T17:14:18.793999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.821261+0000","last_change":"2024-09-12T17:11:06.707086+0000","last_active":"2024-09-12T17:11:43.821261+0000","last_peered":"2024-09-12T17:11:43.821261+0000","last_clean":"2024-09-12T17:11:43.821261+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:11:43.821261+0000","last_undegraded":"2024-09-12T17:11:43.821261+0000","last_fullsized":"2024-09-12T17:11:43.821261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:22.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.788395+0000","last_change":"2024-09-12T17:11:04.672228+0000","last_active":"2024-09-12T17:11:43.788395+0000","last_peered":"2024-09-12T17:11:43.788395+0000","last_clean":"2024-09-12T17:11:43.788395+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:11:43.788395+0000","last_undegraded":"2024-09-12T17:11:43.788395+0000","last_fullsized":"2024-09-12T17:11:43.788395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:53.980176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.730752+0000","last_change":"2024-09-12T17:11:06.700232+0000","last_active":"2024-09-12T17:13:18.730752+0000","last_peered":"2024-09-12T17:13:18.730752+0000","last_clean":"2024-09-12T17:13:18.730752+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:13:18.730752+0000","last_undegraded":"2024-09-12T17:13:18.730752+0000","last_fullsized":"2024-09-12T17:13:18.730752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:44.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.259200+0000","last_change":"2024-09-12T17:11:04.675280+0000","last_active":"2024-09-12T17:11:49.259200+0000","last_peered":"2024-09-12T17:11:49.259200+0000","last_clean":"2024-09-12T17:11:49.259200+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:11:49.259200+0000","last_undegraded":"2024-09-12T17:11:49.259200+0000","last_fullsized":"2024-09-12T17:11:49.259200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:30.778946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.367423+0000","last_change":"2024-09-12T17:11:06.695274+0000","last_active":"2024-09-12T17:14:19.367423+0000","last_peered":"2024-09-12T17:14:19.367423+0000","last_clean":"2024-09-12T17:14:19.367423+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:14:19.367423+0000","last_undegraded":"2024-09-12T17:14:19.367423+0000","last_fullsized":"2024-09-12T17:14:19.367423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.138206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800213+0000","last_change":"2024-09-12T17:11:04.703925+0000","last_active":"2024-09-12T17:11:43.800213+0000","last_peered":"2024-09-12T17:11:43.800213+0000","last_clean":"2024-09-12T17:11:43.800213+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:11:43.800213+0000","last_undegraded":"2024-09-12T17:11:43.800213+0000","last_fullsized":"2024-09-12T17:11:43.800213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759765+0000","last_change":"2024-09-12T17:11:06.703392+0000","last_active":"2024-09-12T17:13:18.759765+0000","last_peered":"2024-09-12T17:13:18.759765+0000","last_clean":"2024-09-12T17:13:18.759765+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:13:18.759765+0000","last_undegraded":"2024-09-12T17:13:18.759765+0000","last_fullsized":"2024-09-12T17:13:18.759765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799380+0000","last_change":"2024-09-12T17:11:04.684732+0000","last_active":"2024-09-12T17:11:43.799380+0000","last_peered":"2024-09-12T17:11:43.799380+0000","last_clean":"2024-09-12T17:11:43.799380+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:11:43.799380+0000","last_undegraded":"2024-09-12T17:11:43.799380+0000","last_fullsized":"2024-09-12T17:11:43.799380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:40.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799093+0000","last_change":"2024-09-12T17:11:06.702655+0000","last_active":"2024-09-12T17:11:43.799093+0000","last_peered":"2024-09-12T17:11:43.799093+0000","last_clean":"2024-09-12T17:11:43.799093+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:11:43.799093+0000","last_undegraded":"2024-09-12T17:11:43.799093+0000","last_fullsized":"2024-09-12T17:11:43.799093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799927+0000","last_change":"2024-09-12T17:11:04.680886+0000","last_active":"2024-09-12T17:11:43.799927+0000","last_peered":"2024-09-12T17:11:43.799927+0000","last_clean":"2024-09-12T17:11:43.799927+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:11:43.799927+0000","last_undegraded":"2024-09-12T17:11:43.799927+0000","last_fullsized":"2024-09-12T17:11:43.799927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:32.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.494618+0000","last_change":"2024-09-12T17:11:06.706847+0000","last_active":"2024-09-12T17:14:19.494618+0000","last_peered":"2024-09-12T17:14:19.494618+0000","last_clean":"2024-09-12T17:14:19.494618+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:14:19.494618+0000","last_undegraded":"2024-09-12T17:14:19.494618+0000","last_fullsized":"2024-09-12T17:14:19.494618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:47.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.693926+0000","last_change":"2024-09-12T17:11:04.669265+0000","last_active":"2024-09-12T17:11:50.693926+0000","last_peered":"2024-09-12T17:11:50.693926+0000","last_clean":"2024-09-12T17:11:50.693926+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:11:50.693926+0000","last_undegraded":"2024-09-12T17:11:50.693926+0000","last_fullsized":"2024-09-12T17:11:50.693926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.747887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758256+0000","last_change":"2024-09-12T17:11:06.699610+0000","last_active":"2024-09-12T17:13:13.758256+0000","last_peered":"2024-09-12T17:13:13.758256+0000","last_clean":"2024-09-12T17:13:13.758256+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:13:13.758256+0000","last_undegraded":"2024-09-12T17:13:13.758256+0000","last_fullsized":"2024-09-12T17:13:13.758256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794970+0000","last_change":"2024-09-12T17:11:04.688321+0000","last_active":"2024-09-12T17:11:43.794970+0000","last_peered":"2024-09-12T17:11:43.794970+0000","last_clean":"2024-09-12T17:11:43.794970+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:11:43.794970+0000","last_undegraded":"2024-09-12T17:11:43.794970+0000","last_fullsized":"2024-09-12T17:11:43.794970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:00.136516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788842+0000","last_change":"2024-09-12T17:11:06.697920+0000","last_active":"2024-09-12T17:14:19.788842+0000","last_peered":"2024-09-12T17:14:19.788842+0000","last_clean":"2024-09-12T17:14:19.788842+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:14:19.788842+0000","last_undegraded":"2024-09-12T17:14:19.788842+0000","last_fullsized":"2024-09-12T17:14:19.788842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:41.481908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803540+0000","last_change":"2024-09-12T17:11:04.678483+0000","last_active":"2024-09-12T17:11:43.803540+0000","last_peered":"2024-09-12T17:11:43.803540+0000","last_clean":"2024-09-12T17:11:43.803540+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:11:43.803540+0000","last_undegraded":"2024-09-12T17:11:43.803540+0000","last_fullsized":"2024-09-12T17:11:43.803540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:32.707968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669536+0000","last_change":"2024-09-12T17:11:06.703492+0000","last_active":"2024-09-12T17:13:14.669536+0000","last_peered":"2024-09-12T17:13:14.669536+0000","last_clean":"2024-09-12T17:13:14.669536+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:13:14.669536+0000","last_undegraded":"2024-09-12T17:13:14.669536+0000","last_fullsized":"2024-09-12T17:13:14.669536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:33.304445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800268+0000","last_change":"2024-09-12T17:11:04.699383+0000","last_active":"2024-09-12T17:11:43.800268+0000","last_peered":"2024-09-12T17:11:43.800268+0000","last_clean":"2024-09-12T17:11:43.800268+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:11:43.800268+0000","last_undegraded":"2024-09-12T17:11:43.800268+0000","last_fullsized":"2024-09-12T17:11:43.800268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:31.767352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797277+0000","last_change":"2024-09-12T17:11:04.684375+0000","last_active":"2024-09-12T17:11:43.797277+0000","last_peered":"2024-09-12T17:11:43.797277+0000","last_clean":"2024-09-12T17:11:43.797277+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:11:43.797277+0000","last_undegraded":"2024-09-12T17:11:43.797277+0000","last_fullsized":"2024-09-12T17:11:43.797277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:05.836478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491265+0000","last_change":"2024-09-12T17:11:06.702748+0000","last_active":"2024-09-12T17:14:19.491265+0000","last_peered":"2024-09-12T17:14:19.491265+0000","last_clean":"2024-09-12T17:14:19.491265+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:14:19.491265+0000","last_undegraded":"2024-09-12T17:14:19.491265+0000","last_fullsized":"2024-09-12T17:14:19.491265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758403+0000","last_change":"2024-09-12T17:11:04.671497+0000","last_active":"2024-09-12T17:13:19.758403+0000","last_peered":"2024-09-12T17:13:19.758403+0000","last_clean":"2024-09-12T17:13:19.758403+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:13:19.758403+0000","last_undegraded":"2024-09-12T17:13:19.758403+0000","last_fullsized":"2024-09-12T17:13:19.758403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:02.752436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'19","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719500+0000","last_change":"2024-09-12T17:11:06.697799+0000","last_active":"2024-09-12T17:14:19.719500+0000","last_peered":"2024-09-12T17:14:19.719500+0000","last_clean":"2024-09-12T17:14:19.719500+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:14:19.719500+0000","last_undegraded":"2024-09-12T17:14:19.719500+0000","last_fullsized":"2024-09-12T17:14:19.719500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:51.237525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807578+0000","last_change":"2024-09-12T17:11:04.669643+0000","last_active":"2024-09-12T17:11:43.807578+0000","last_peered":"2024-09-12T17:11:43.807578+0000","last_clean":"2024-09-12T17:11:43.807578+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:11:43.807578+0000","last_undegraded":"2024-09-12T17:11:43.807578+0000","last_fullsized":"2024-09-12T17:11:43.807578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:12.651503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856748+0000","last_change":"2024-09-12T17:11:06.706910+0000","last_active":"2024-09-12T17:14:19.856748+0000","last_peered":"2024-09-12T17:14:19.856748+0000","last_clean":"2024-09-12T17:14:19.856748+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:14:19.856748+0000","last_undegraded":"2024-09-12T17:14:19.856748+0000","last_fullsized":"2024-09-12T17:14:19.856748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:09.726713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255243+0000","last_change":"2024-09-12T17:11:04.698962+0000","last_active":"2024-09-12T17:11:49.255243+0000","last_peered":"2024-09-12T17:11:49.255243+0000","last_clean":"2024-09-12T17:11:49.255243+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:11:49.255243+0000","last_undegraded":"2024-09-12T17:11:49.255243+0000","last_fullsized":"2024-09-12T17:11:49.255243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:58.287096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856816+0000","last_change":"2024-09-12T17:11:06.698579+0000","last_active":"2024-09-12T17:14:19.856816+0000","last_peered":"2024-09-12T17:14:19.856816+0000","last_clean":"2024-09-12T17:14:19.856816+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:14:19.856816+0000","last_undegraded":"2024-09-12T17:14:19.856816+0000","last_fullsized":"2024-09-12T17:14:19.856816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.305167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.810471+0000","last_change":"2024-09-12T17:11:04.706258+0000","last_active":"2024-09-12T17:11:43.810471+0000","last_peered":"2024-09-12T17:11:43.810471+0000","last_clean":"2024-09-12T17:11:43.810471+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:11:43.810471+0000","last_undegraded":"2024-09-12T17:11:43.810471+0000","last_fullsized":"2024-09-12T17:11:43.810471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.595508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856680+0000","last_change":"2024-09-12T17:11:43.799543+0000","last_active":"2024-09-12T17:14:19.856680+0000","last_peered":"2024-09-12T17:14:19.856680+0000","last_clean":"2024-09-12T17:14:19.856680+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:14:19.856680+0000","last_undegraded":"2024-09-12T17:14:19.856680+0000","last_fullsized":"2024-09-12T17:14:19.856680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.634562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795628+0000","last_change":"2024-09-12T17:11:04.688801+0000","last_active":"2024-09-12T17:11:43.795628+0000","last_peered":"2024-09-12T17:11:43.795628+0000","last_clean":"2024-09-12T17:11:43.795628+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:11:43.795628+0000","last_undegraded":"2024-09-12T17:11:43.795628+0000","last_fullsized":"2024-09-12T17:11:43.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.317920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491662+0000","last_change":"2024-09-12T17:11:06.692150+0000","last_active":"2024-09-12T17:14:19.491662+0000","last_peered":"2024-09-12T17:14:19.491662+0000","last_clean":"2024-09-12T17:14:19.491662+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:14:19.491662+0000","last_undegraded":"2024-09-12T17:14:19.491662+0000","last_fullsized":"2024-09-12T17:14:19.491662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:03.537778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818404+0000","last_change":"2024-09-12T17:11:04.699011+0000","last_active":"2024-09-12T17:11:43.818404+0000","last_peered":"2024-09-12T17:11:43.818404+0000","last_clean":"2024-09-12T17:11:43.818404+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:11:43.818404+0000","last_undegraded":"2024-09-12T17:11:43.818404+0000","last_fullsized":"2024-09-12T17:11:43.818404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.663093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.794825+0000","last_change":"2024-09-12T17:11:04.699035+0000","last_active":"2024-09-12T17:13:24.794825+0000","last_peered":"2024-09-12T17:13:24.794825+0000","last_clean":"2024-09-12T17:13:24.794825+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:13:24.794825+0000","last_undegraded":"2024-09-12T17:13:24.794825+0000","last_fullsized":"2024-09-12T17:13:24.794825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788135+0000","last_change":"2024-09-12T17:11:06.699450+0000","last_active":"2024-09-12T17:14:19.788135+0000","last_peered":"2024-09-12T17:14:19.788135+0000","last_clean":"2024-09-12T17:14:19.788135+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:14:19.788135+0000","last_undegraded":"2024-09-12T17:14:19.788135+0000","last_fullsized":"2024-09-12T17:14:19.788135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.494877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797601+0000","last_change":"2024-09-12T17:11:04.683423+0000","last_active":"2024-09-12T17:11:43.797601+0000","last_peered":"2024-09-12T17:11:43.797601+0000","last_clean":"2024-09-12T17:11:43.797601+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:11:43.797601+0000","last_undegraded":"2024-09-12T17:11:43.797601+0000","last_fullsized":"2024-09-12T17:11:43.797601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.682059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.735133+0000","last_change":"2024-09-12T17:11:06.707075+0000","last_active":"2024-09-12T17:13:18.735133+0000","last_peered":"2024-09-12T17:13:18.735133+0000","last_clean":"2024-09-12T17:13:18.735133+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:13:18.735133+0000","last_undegraded":"2024-09-12T17:13:18.735133+0000","last_fullsized":"2024-09-12T17:13:18.735133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:46.709626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50532,"kb_used_data":11028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321308,"statfs":{"total":96636764160,"available":96585019392,"internally_reserved":0,"allocated":11292672,"data_stored":10961414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44864,"kb_used_data":9520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326976,"statfs":{"total":96636764160,"available":96590823424,"internally_reserved":0,"allocated":9748480,"data_stored":9453120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48136,"kb_used_data":8632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323704,"statfs":{"total":96636764160,"available":96587472896,"internally_reserved":0,"allocated":8839168,"data_stored":8541155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46896,"kb_used_data":11552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324944,"statfs":{"total":96636764160,"available":96588742656,"internally_reserved":0,"allocated":11829248,"data_stored":11550721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:14:52.049 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:14:52.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:14:52.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.187+0000 7f625c582640 1 Processor -- start 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.187+0000 7f625c582640 1 -- start start 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.187+0000 7f625c582640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6254110da0 0x7f6254111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625c582640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6254073a90 con 0x7f62541116c0 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625c582640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f62540696e0 con 0x7f6254110da0 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625a31e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6254110da0 0x7f6254111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f6259b1d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f62541116c0 0x7f62541231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:41768/0 (socket says 172.21.15.62:41768) 2024-09-12T17:14:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f6259b1d640 1 -- 172.21.15.62:0/4167481486 learned_addr learned my addr 172.21.15.62:0/4167481486 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:52.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625a31e640 1 -- 172.21.15.62:0/4167481486 >> v1:172.21.15.62:6789/0 conn(0x7f62541116c0 legacy=0x7f62541231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625a31e640 1 -- 172.21.15.62:0/4167481486 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625406dd50 con 0x7f6254110da0 2024-09-12T17:14:52.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625931c640 1 -- 172.21.15.62:0/4167481486 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163434048 0 0) 0x7f6254073a90 con 0x7f62541116c0 2024-09-12T17:14:52.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625a31e640 1 --2- 172.21.15.62:0/4167481486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254111180 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f624c009740 tx=0x7f624c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4424fbcc1f8b7977 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625931c640 1 -- 172.21.15.62:0/4167481486 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0b0070 con 0x7f6254110da0 2024-09-12T17:14:52.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625931c640 1 -- 172.21.15.62:0/4167481486 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0ab530 con 0x7f6254110da0 2024-09-12T17:14:52.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.191+0000 7f625931c640 1 -- 172.21.15.62:0/4167481486 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0ab830 con 0x7f6254110da0 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/4167481486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 msgr2=0x7f6254111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 --2- 172.21.15.62:0/4167481486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254111180 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f624c009740 tx=0x7f624c01c370 comp rx=0 tx=0).stop 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/4167481486 shutdown_connections 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 --2- 172.21.15.62:0/4167481486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254111180 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/4167481486 >> 172.21.15.62:0/4167481486 conn(0x7f6254070900 msgr2=0x7f6254072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:52.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/4167481486 shutdown_connections 2024-09-12T17:14:52.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/4167481486 wait complete. 2024-09-12T17:14:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 Processor -- start 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- start start 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6254135470 con 0x7f6254110da0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625a31e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625a31e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49064/0 (socket says 172.21.15.62:49064) 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625a31e640 1 -- 172.21.15.62:0/1940470509 learned_addr learned my addr 172.21.15.62:0/1940470509 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625a31e640 1 -- 172.21.15.62:0/1940470509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6254127610 con 0x7f6254110da0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625a31e640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f624c019fa0 tx=0x7f624c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0b0050 con 0x7f6254110da0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f624c0b1040 con 0x7f6254110da0 2024-09-12T17:14:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f624c0042a0 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6254116670 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6254116b80 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625412d730 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.195+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f624c0be060 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.199+0000 7f624affd640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 0x7f624003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.199+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f624c0e9540 con 0x7f6254110da0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.199+0000 7f6259b1d640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 0x7f624003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.199+0000 7f6259b1d640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 0x7f624003d6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6250000f90 tx=0x7f6250007c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.203+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f6254127610 con 0x7f6254110da0 2024-09-12T17:14:52.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.367+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62541120e0 con 0x7f624003b200 2024-09-12T17:14:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.399+0000 7f624affd640 1 -- 172.21.15.62:0/1940470509 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665804 (secure 0 0 0) 0x7f625000c810 con 0x7f624003b200 2024-09-12T17:14:52.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 msgr2=0x7f624003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 0x7f624003d6c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6250000f90 tx=0x7f6250007c60 comp rx=0 tx=0).stop 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 msgr2=0x7f6254115000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f624c019fa0 tx=0x7f624c01abb0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 shutdown_connections 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f624003b200 0x7f624003d6c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 --2- 172.21.15.62:0/1940470509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6254110da0 0x7f6254115000 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 >> 172.21.15.62:0/1940470509 conn(0x7f6254070900 msgr2=0x7f6254132840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 shutdown_connections 2024-09-12T17:14:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.403+0000 7f625c582640 1 -- 172.21.15.62:0/1940470509 wait complete. 2024-09-12T17:14:52.776 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T17:14:50.776568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412815,"num_objects":229,"num_object_clones":0,"num_object_copies":465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4932,"num_read_kb":4514,"num_write":2050,"num_write_kb":60587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4435,"ondisk_log_size":4435,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190428,"kb_used_data":40732,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377296932,"statfs":{"total":386547056640,"available":386352058368,"internally_reserved":0,"allocated":41709568,"data_stored":40506410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006211"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795920+0000","last_change":"2024-09-12T17:11:04.687200+0000","last_active":"2024-09-12T17:11:43.795920+0000","last_peered":"2024-09-12T17:11:43.795920+0000","last_clean":"2024-09-12T17:11:43.795920+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:11:43.795920+0000","last_undegraded":"2024-09-12T17:11:43.795920+0000","last_fullsized":"2024-09-12T17:11:43.795920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:17.379528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'11","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.875621+0000","last_change":"2024-09-12T17:11:06.702423+0000","last_active":"2024-09-12T17:14:19.875621+0000","last_peered":"2024-09-12T17:14:19.875621+0000","last_clean":"2024-09-12T17:14:19.875621+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:14:19.875621+0000","last_undegraded":"2024-09-12T17:14:19.875621+0000","last_fullsized":"2024-09-12T17:14:19.875621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:45.099418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803085+0000","last_change":"2024-09-12T17:11:04.679163+0000","last_active":"2024-09-12T17:11:43.803085+0000","last_peered":"2024-09-12T17:11:43.803085+0000","last_clean":"2024-09-12T17:11:43.803085+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:11:43.803085+0000","last_undegraded":"2024-09-12T17:11:43.803085+0000","last_fullsized":"2024-09-12T17:11:43.803085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:05.288043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255203+0000","last_change":"2024-09-12T17:11:04.706028+0000","last_active":"2024-09-12T17:11:49.255203+0000","last_peered":"2024-09-12T17:11:49.255203+0000","last_clean":"2024-09-12T17:11:49.255203+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:11:49.255203+0000","last_undegraded":"2024-09-12T17:11:49.255203+0000","last_fullsized":"2024-09-12T17:11:49.255203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:14.130896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794976+0000","last_change":"2024-09-12T17:11:04.672236+0000","last_active":"2024-09-12T17:11:43.794976+0000","last_peered":"2024-09-12T17:11:43.794976+0000","last_clean":"2024-09-12T17:11:43.794976+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:11:43.794976+0000","last_undegraded":"2024-09-12T17:11:43.794976+0000","last_fullsized":"2024-09-12T17:11:43.794976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:53.845369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:47.737476+0000","last_change":"2024-09-12T17:11:43.812377+0000","last_active":"2024-09-12T17:11:47.737476+0000","last_peered":"2024-09-12T17:11:47.737476+0000","last_clean":"2024-09-12T17:11:47.737476+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:11:47.737476+0000","last_undegraded":"2024-09-12T17:11:47.737476+0000","last_fullsized":"2024-09-12T17:11:47.737476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:08.964697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.665616+0000","last_change":"2024-09-12T17:11:04.699008+0000","last_active":"2024-09-12T17:13:18.665616+0000","last_peered":"2024-09-12T17:13:18.665616+0000","last_clean":"2024-09-12T17:13:18.665616+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:13:18.665616+0000","last_undegraded":"2024-09-12T17:13:18.665616+0000","last_fullsized":"2024-09-12T17:13:18.665616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:36.274188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.345961+0000","last_change":"2024-09-12T17:11:06.698107+0000","last_active":"2024-09-12T17:14:19.345961+0000","last_peered":"2024-09-12T17:14:19.345961+0000","last_clean":"2024-09-12T17:14:19.345961+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:14:19.345961+0000","last_undegraded":"2024-09-12T17:14:19.345961+0000","last_fullsized":"2024-09-12T17:14:19.345961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.502410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.652066+0000","last_change":"2024-09-12T17:11:04.670384+0000","last_active":"2024-09-12T17:13:14.652066+0000","last_peered":"2024-09-12T17:13:14.652066+0000","last_clean":"2024-09-12T17:13:14.652066+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:13:14.652066+0000","last_undegraded":"2024-09-12T17:13:14.652066+0000","last_fullsized":"2024-09-12T17:13:14.652066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:45.776683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789877+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.789877+0000","last_peered":"2024-09-12T17:14:19.789877+0000","last_clean":"2024-09-12T17:14:19.789877+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.789877+0000","last_undegraded":"2024-09-12T17:14:19.789877+0000","last_fullsized":"2024-09-12T17:14:19.789877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:24.771164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.951750+0000","last_change":"2024-09-12T17:11:04.695318+0000","last_active":"2024-09-12T17:11:49.951750+0000","last_peered":"2024-09-12T17:11:49.951750+0000","last_clean":"2024-09-12T17:11:49.951750+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:11:49.951750+0000","last_undegraded":"2024-09-12T17:11:49.951750+0000","last_fullsized":"2024-09-12T17:11:49.951750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.828581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492276+0000","last_change":"2024-09-12T17:11:06.694679+0000","last_active":"2024-09-12T17:14:19.492276+0000","last_peered":"2024-09-12T17:14:19.492276+0000","last_clean":"2024-09-12T17:14:19.492276+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:14:19.492276+0000","last_undegraded":"2024-09-12T17:14:19.492276+0000","last_fullsized":"2024-09-12T17:14:19.492276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.652480+0000","last_change":"2024-09-12T17:11:04.675982+0000","last_active":"2024-09-12T17:14:19.652480+0000","last_peered":"2024-09-12T17:14:19.652480+0000","last_clean":"2024-09-12T17:14:19.652480+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:14:19.652480+0000","last_undegraded":"2024-09-12T17:14:19.652480+0000","last_fullsized":"2024-09-12T17:14:19.652480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:46.947849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.714086+0000","last_change":"2024-09-12T17:11:06.700269+0000","last_active":"2024-09-12T17:13:18.714086+0000","last_peered":"2024-09-12T17:13:18.714086+0000","last_clean":"2024-09-12T17:13:18.714086+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:13:18.714086+0000","last_undegraded":"2024-09-12T17:13:18.714086+0000","last_fullsized":"2024-09-12T17:13:18.714086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.761569+0000","last_change":"2024-09-12T17:11:04.678371+0000","last_active":"2024-09-12T17:13:29.761569+0000","last_peered":"2024-09-12T17:13:29.761569+0000","last_clean":"2024-09-12T17:13:29.761569+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:13:29.761569+0000","last_undegraded":"2024-09-12T17:13:29.761569+0000","last_fullsized":"2024-09-12T17:13:29.761569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:06.727515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491645+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:14:19.491645+0000","last_peered":"2024-09-12T17:14:19.491645+0000","last_clean":"2024-09-12T17:14:19.491645+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:14:19.491645+0000","last_undegraded":"2024-09-12T17:14:19.491645+0000","last_fullsized":"2024-09-12T17:14:19.491645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:06.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.261458+0000","last_change":"2024-09-12T17:11:04.700050+0000","last_active":"2024-09-12T17:14:19.261458+0000","last_peered":"2024-09-12T17:14:19.261458+0000","last_clean":"2024-09-12T17:14:19.261458+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:14:19.261458+0000","last_undegraded":"2024-09-12T17:14:19.261458+0000","last_fullsized":"2024-09-12T17:14:19.261458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:44.289638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699394+0000","last_change":"2024-09-12T17:11:06.702528+0000","last_active":"2024-09-12T17:14:19.699394+0000","last_peered":"2024-09-12T17:14:19.699394+0000","last_clean":"2024-09-12T17:14:19.699394+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:14:19.699394+0000","last_undegraded":"2024-09-12T17:14:19.699394+0000","last_fullsized":"2024-09-12T17:14:19.699394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:53.004454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.669138+0000","last_change":"2024-09-12T17:11:04.695415+0000","last_active":"2024-09-12T17:14:19.669138+0000","last_peered":"2024-09-12T17:14:19.669138+0000","last_clean":"2024-09-12T17:14:19.669138+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:14:19.669138+0000","last_undegraded":"2024-09-12T17:14:19.669138+0000","last_fullsized":"2024-09-12T17:14:19.669138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:47.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699210+0000","last_change":"2024-09-12T17:11:06.702654+0000","last_active":"2024-09-12T17:14:19.699210+0000","last_peered":"2024-09-12T17:14:19.699210+0000","last_clean":"2024-09-12T17:14:19.699210+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.699210+0000","last_undegraded":"2024-09-12T17:14:19.699210+0000","last_fullsized":"2024-09-12T17:14:19.699210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.299767+0000","last_change":"2024-09-12T17:11:04.669648+0000","last_active":"2024-09-12T17:14:19.299767+0000","last_peered":"2024-09-12T17:14:19.299767+0000","last_clean":"2024-09-12T17:14:19.299767+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:14:19.299767+0000","last_undegraded":"2024-09-12T17:14:19.299767+0000","last_fullsized":"2024-09-12T17:14:19.299767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:21.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699219+0000","last_change":"2024-09-12T17:11:06.700166+0000","last_active":"2024-09-12T17:14:19.699219+0000","last_peered":"2024-09-12T17:14:19.699219+0000","last_clean":"2024-09-12T17:14:19.699219+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:14:19.699219+0000","last_undegraded":"2024-09-12T17:14:19.699219+0000","last_fullsized":"2024-09-12T17:14:19.699219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.254780+0000","last_change":"2024-09-12T17:11:04.684719+0000","last_active":"2024-09-12T17:11:49.254780+0000","last_peered":"2024-09-12T17:11:49.254780+0000","last_clean":"2024-09-12T17:11:49.254780+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:11:49.254780+0000","last_undegraded":"2024-09-12T17:11:49.254780+0000","last_fullsized":"2024-09-12T17:11:49.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:35.602622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.351380+0000","last_change":"2024-09-12T17:11:06.702307+0000","last_active":"2024-09-12T17:14:19.351380+0000","last_peered":"2024-09-12T17:14:19.351380+0000","last_clean":"2024-09-12T17:14:19.351380+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.351380+0000","last_undegraded":"2024-09-12T17:14:19.351380+0000","last_fullsized":"2024-09-12T17:14:19.351380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:15.153934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801460+0000","last_change":"2024-09-12T17:11:04.693521+0000","last_active":"2024-09-12T17:11:43.801460+0000","last_peered":"2024-09-12T17:11:43.801460+0000","last_clean":"2024-09-12T17:11:43.801460+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:11:43.801460+0000","last_undegraded":"2024-09-12T17:11:43.801460+0000","last_fullsized":"2024-09-12T17:11:43.801460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.412209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491966+0000","last_change":"2024-09-12T17:11:06.695461+0000","last_active":"2024-09-12T17:14:19.491966+0000","last_peered":"2024-09-12T17:14:19.491966+0000","last_clean":"2024-09-12T17:14:19.491966+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:14:19.491966+0000","last_undegraded":"2024-09-12T17:14:19.491966+0000","last_fullsized":"2024-09-12T17:14:19.491966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:05.772132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803636+0000","last_change":"2024-09-12T17:11:04.703079+0000","last_active":"2024-09-12T17:11:43.803636+0000","last_peered":"2024-09-12T17:11:43.803636+0000","last_clean":"2024-09-12T17:11:43.803636+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:11:43.803636+0000","last_undegraded":"2024-09-12T17:11:43.803636+0000","last_fullsized":"2024-09-12T17:11:43.803636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:07.714503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.782694+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:13:16.782694+0000","last_peered":"2024-09-12T17:13:16.782694+0000","last_clean":"2024-09-12T17:13:16.782694+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:13:16.782694+0000","last_undegraded":"2024-09-12T17:13:16.782694+0000","last_fullsized":"2024-09-12T17:13:16.782694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.990500+0000","last_change":"2024-09-12T17:11:06.695753+0000","last_active":"2024-09-12T17:11:49.990500+0000","last_peered":"2024-09-12T17:11:49.990500+0000","last_clean":"2024-09-12T17:11:49.990500+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:11:49.990500+0000","last_undegraded":"2024-09-12T17:11:49.990500+0000","last_fullsized":"2024-09-12T17:11:49.990500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:25.077773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789387+0000","last_change":"2024-09-12T17:11:04.664341+0000","last_active":"2024-09-12T17:11:43.789387+0000","last_peered":"2024-09-12T17:11:43.789387+0000","last_clean":"2024-09-12T17:11:43.789387+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:11:43.789387+0000","last_undegraded":"2024-09-12T17:11:43.789387+0000","last_fullsized":"2024-09-12T17:11:43.789387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.127793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798199+0000","last_change":"2024-09-12T17:11:08.714597+0000","last_active":"2024-09-12T17:11:43.798199+0000","last_peered":"2024-09-12T17:11:43.798199+0000","last_clean":"2024-09-12T17:11:43.798199+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:11:43.798199+0000","last_undegraded":"2024-09-12T17:11:43.798199+0000","last_fullsized":"2024-09-12T17:11:43.798199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:35.426981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788656+0000","last_change":"2024-09-12T17:11:06.695233+0000","last_active":"2024-09-12T17:14:19.788656+0000","last_peered":"2024-09-12T17:14:19.788656+0000","last_clean":"2024-09-12T17:14:19.788656+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:14:19.788656+0000","last_undegraded":"2024-09-12T17:14:19.788656+0000","last_fullsized":"2024-09-12T17:14:19.788656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:07.207850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798159+0000","last_change":"2024-09-12T17:11:04.699166+0000","last_active":"2024-09-12T17:11:43.798159+0000","last_peered":"2024-09-12T17:11:43.798159+0000","last_clean":"2024-09-12T17:11:43.798159+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:11:43.798159+0000","last_undegraded":"2024-09-12T17:11:43.798159+0000","last_fullsized":"2024-09-12T17:11:43.798159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.706422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803868+0000","last_change":"2024-09-12T17:11:08.703714+0000","last_active":"2024-09-12T17:11:43.803868+0000","last_peered":"2024-09-12T17:11:43.803868+0000","last_clean":"2024-09-12T17:11:43.803868+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:11:43.803868+0000","last_undegraded":"2024-09-12T17:11:43.803868+0000","last_fullsized":"2024-09-12T17:11:43.803868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:58.130892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956001+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:18.956001+0000","last_peered":"2024-09-12T17:14:18.956001+0000","last_clean":"2024-09-12T17:14:18.956001+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:18.956001+0000","last_undegraded":"2024-09-12T17:14:18.956001+0000","last_fullsized":"2024-09-12T17:14:18.956001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856648+0000","last_change":"2024-09-12T17:11:06.709890+0000","last_active":"2024-09-12T17:14:19.856648+0000","last_peered":"2024-09-12T17:14:19.856648+0000","last_clean":"2024-09-12T17:14:19.856648+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:14:19.856648+0000","last_undegraded":"2024-09-12T17:14:19.856648+0000","last_fullsized":"2024-09-12T17:14:19.856648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:54.843124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759626+0000","last_change":"2024-09-12T17:11:04.665928+0000","last_active":"2024-09-12T17:13:24.759626+0000","last_peered":"2024-09-12T17:13:24.759626+0000","last_clean":"2024-09-12T17:13:24.759626+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:13:24.759626+0000","last_undegraded":"2024-09-12T17:13:24.759626+0000","last_fullsized":"2024-09-12T17:13:24.759626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:39.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'32","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.775565+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:13:16.775565+0000","last_peered":"2024-09-12T17:13:16.775565+0000","last_clean":"2024-09-12T17:13:16.775565+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.775565+0000","last_undegraded":"2024-09-12T17:13:16.775565+0000","last_fullsized":"2024-09-12T17:13:16.775565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":44,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":407,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.046073+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:20.046073+0000","last_peered":"2024-09-12T17:14:20.046073+0000","last_clean":"2024-09-12T17:14:20.046073+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:20.046073+0000","last_undegraded":"2024-09-12T17:14:20.046073+0000","last_fullsized":"2024-09-12T17:14:20.046073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856733+0000","last_change":"2024-09-12T17:11:06.689516+0000","last_active":"2024-09-12T17:14:19.856733+0000","last_peered":"2024-09-12T17:14:19.856733+0000","last_clean":"2024-09-12T17:14:19.856733+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:14:19.856733+0000","last_undegraded":"2024-09-12T17:14:19.856733+0000","last_fullsized":"2024-09-12T17:14:19.856733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:22.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.707062+0000","last_change":"2024-09-12T17:11:04.670479+0000","last_active":"2024-09-12T17:11:50.707062+0000","last_peered":"2024-09-12T17:11:50.707062+0000","last_clean":"2024-09-12T17:11:50.707062+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:11:50.707062+0000","last_undegraded":"2024-09-12T17:11:50.707062+0000","last_fullsized":"2024-09-12T17:11:50.707062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.055726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801252+0000","last_change":"2024-09-12T17:11:08.711989+0000","last_active":"2024-09-12T17:11:43.801252+0000","last_peered":"2024-09-12T17:11:43.801252+0000","last_clean":"2024-09-12T17:11:43.801252+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:11:43.801252+0000","last_undegraded":"2024-09-12T17:11:43.801252+0000","last_fullsized":"2024-09-12T17:11:43.801252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:37.301429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'41","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.788463+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:13:16.788463+0000","last_peered":"2024-09-12T17:13:16.788463+0000","last_clean":"2024-09-12T17:13:16.788463+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:13:16.788463+0000","last_undegraded":"2024-09-12T17:13:16.788463+0000","last_fullsized":"2024-09-12T17:13:16.788463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:45.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.700337+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:12:33.700337+0000","last_peered":"2024-09-12T17:12:33.700337+0000","last_clean":"2024-09-12T17:12:33.700337+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:12:33.700337+0000","last_undegraded":"2024-09-12T17:12:33.700337+0000","last_fullsized":"2024-09-12T17:12:33.700337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:14.320323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758366+0000","last_change":"2024-09-12T17:11:06.691496+0000","last_active":"2024-09-12T17:13:19.758366+0000","last_peered":"2024-09-12T17:13:19.758366+0000","last_clean":"2024-09-12T17:13:19.758366+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:13:19.758366+0000","last_undegraded":"2024-09-12T17:13:19.758366+0000","last_fullsized":"2024-09-12T17:13:19.758366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:04.589070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.844389+0000","last_change":"2024-09-12T17:11:04.674290+0000","last_active":"2024-09-12T17:14:19.844389+0000","last_peered":"2024-09-12T17:14:19.844389+0000","last_clean":"2024-09-12T17:14:19.844389+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:19.844389+0000","last_undegraded":"2024-09-12T17:14:19.844389+0000","last_fullsized":"2024-09-12T17:14:19.844389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:49.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797606+0000","last_change":"2024-09-12T17:11:08.703591+0000","last_active":"2024-09-12T17:11:43.797606+0000","last_peered":"2024-09-12T17:11:43.797606+0000","last_clean":"2024-09-12T17:11:43.797606+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:11:43.797606+0000","last_undegraded":"2024-09-12T17:11:43.797606+0000","last_fullsized":"2024-09-12T17:11:43.797606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:30.362634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.761879+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:13:16.761879+0000","last_peered":"2024-09-12T17:13:16.761879+0000","last_clean":"2024-09-12T17:13:16.761879+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:13:16.761879+0000","last_undegraded":"2024-09-12T17:13:16.761879+0000","last_fullsized":"2024-09-12T17:13:16.761879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797367+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:11:43.797367+0000","last_peered":"2024-09-12T17:11:43.797367+0000","last_clean":"2024-09-12T17:11:43.797367+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:11:43.797367+0000","last_undegraded":"2024-09-12T17:11:43.797367+0000","last_fullsized":"2024-09-12T17:11:43.797367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.311032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:27.988084+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:12:27.988084+0000","last_peered":"2024-09-12T17:12:27.988084+0000","last_clean":"2024-09-12T17:12:27.988084+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:12:27.988084+0000","last_undegraded":"2024-09-12T17:12:27.988084+0000","last_fullsized":"2024-09-12T17:12:27.988084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:12.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699464+0000","last_change":"2024-09-12T17:11:06.696422+0000","last_active":"2024-09-12T17:14:19.699464+0000","last_peered":"2024-09-12T17:14:19.699464+0000","last_clean":"2024-09-12T17:14:19.699464+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:14:19.699464+0000","last_undegraded":"2024-09-12T17:14:19.699464+0000","last_fullsized":"2024-09-12T17:14:19.699464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:01.613538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.666958+0000","last_change":"2024-09-12T17:11:04.702087+0000","last_active":"2024-09-12T17:12:33.666958+0000","last_peered":"2024-09-12T17:12:33.666958+0000","last_clean":"2024-09-12T17:12:33.666958+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:12:33.666958+0000","last_undegraded":"2024-09-12T17:12:33.666958+0000","last_fullsized":"2024-09-12T17:12:33.666958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:25.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802068+0000","last_change":"2024-09-12T17:11:08.703554+0000","last_active":"2024-09-12T17:11:43.802068+0000","last_peered":"2024-09-12T17:11:43.802068+0000","last_clean":"2024-09-12T17:11:43.802068+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:11:43.802068+0000","last_undegraded":"2024-09-12T17:11:43.802068+0000","last_fullsized":"2024-09-12T17:11:43.802068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:43.928545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.790598+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:13:16.790598+0000","last_peered":"2024-09-12T17:13:16.790598+0000","last_clean":"2024-09-12T17:13:16.790598+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:13:16.790598+0000","last_undegraded":"2024-09-12T17:13:16.790598+0000","last_fullsized":"2024-09-12T17:13:16.790598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:15.747423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":350,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.066822+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:20.066822+0000","last_peered":"2024-09-12T17:14:20.066822+0000","last_clean":"2024-09-12T17:14:20.066822+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:20.066822+0000","last_undegraded":"2024-09-12T17:14:20.066822+0000","last_fullsized":"2024-09-12T17:14:20.066822+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:58.989870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802324+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:11:43.802324+0000","last_peered":"2024-09-12T17:11:43.802324+0000","last_clean":"2024-09-12T17:11:43.802324+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:11:43.802324+0000","last_undegraded":"2024-09-12T17:11:43.802324+0000","last_fullsized":"2024-09-12T17:11:43.802324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:27.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874529+0000","last_change":"2024-09-12T17:11:06.692668+0000","last_active":"2024-09-12T17:14:19.874529+0000","last_peered":"2024-09-12T17:14:19.874529+0000","last_clean":"2024-09-12T17:14:19.874529+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:14:19.874529+0000","last_undegraded":"2024-09-12T17:14:19.874529+0000","last_fullsized":"2024-09-12T17:14:19.874529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804443+0000","last_change":"2024-09-12T17:11:04.705352+0000","last_active":"2024-09-12T17:11:43.804443+0000","last_peered":"2024-09-12T17:11:43.804443+0000","last_clean":"2024-09-12T17:11:43.804443+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:11:43.804443+0000","last_undegraded":"2024-09-12T17:11:43.804443+0000","last_fullsized":"2024-09-12T17:11:43.804443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:32.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798335+0000","last_change":"2024-09-12T17:11:08.718239+0000","last_active":"2024-09-12T17:11:43.798335+0000","last_peered":"2024-09-12T17:11:43.798335+0000","last_clean":"2024-09-12T17:11:43.798335+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:11:43.798335+0000","last_undegraded":"2024-09-12T17:11:43.798335+0000","last_fullsized":"2024-09-12T17:11:43.798335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:05.261510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.792763+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:13:16.792763+0000","last_peered":"2024-09-12T17:13:16.792763+0000","last_clean":"2024-09-12T17:13:16.792763+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:13:16.792763+0000","last_undegraded":"2024-09-12T17:13:16.792763+0000","last_fullsized":"2024-09-12T17:13:16.792763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:08.295074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797078+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:11:43.797078+0000","last_peered":"2024-09-12T17:11:43.797078+0000","last_clean":"2024-09-12T17:11:43.797078+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:11:43.797078+0000","last_undegraded":"2024-09-12T17:11:43.797078+0000","last_fullsized":"2024-09-12T17:11:43.797078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:12.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.020204+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.020204+0000","last_peered":"2024-09-12T17:14:20.020204+0000","last_clean":"2024-09-12T17:14:20.020204+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.020204+0000","last_undegraded":"2024-09-12T17:14:20.020204+0000","last_fullsized":"2024-09-12T17:14:20.020204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:39.726074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.347636+0000","last_change":"2024-09-12T17:11:06.707317+0000","last_active":"2024-09-12T17:14:19.347636+0000","last_peered":"2024-09-12T17:14:19.347636+0000","last_clean":"2024-09-12T17:14:19.347636+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:14:19.347636+0000","last_undegraded":"2024-09-12T17:14:19.347636+0000","last_fullsized":"2024-09-12T17:14:19.347636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:08.491395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798991+0000","last_change":"2024-09-12T17:11:04.681916+0000","last_active":"2024-09-12T17:11:43.798991+0000","last_peered":"2024-09-12T17:11:43.798991+0000","last_clean":"2024-09-12T17:11:43.798991+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:11:43.798991+0000","last_undegraded":"2024-09-12T17:11:43.798991+0000","last_fullsized":"2024-09-12T17:11:43.798991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.532391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793223+0000","last_change":"2024-09-12T17:11:08.714019+0000","last_active":"2024-09-12T17:11:43.793223+0000","last_peered":"2024-09-12T17:11:43.793223+0000","last_clean":"2024-09-12T17:11:43.793223+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:11:43.793223+0000","last_undegraded":"2024-09-12T17:11:43.793223+0000","last_fullsized":"2024-09-12T17:11:43.793223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:48.242476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.760164+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:13:24.760164+0000","last_peered":"2024-09-12T17:13:24.760164+0000","last_clean":"2024-09-12T17:13:24.760164+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:13:24.760164+0000","last_undegraded":"2024-09-12T17:13:24.760164+0000","last_fullsized":"2024-09-12T17:13:24.760164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.382092+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:13:16.382092+0000","last_peered":"2024-09-12T17:13:16.382092+0000","last_clean":"2024-09-12T17:13:16.382092+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:13:16.382092+0000","last_undegraded":"2024-09-12T17:13:16.382092+0000","last_fullsized":"2024-09-12T17:13:16.382092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:53.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856766+0000","last_change":"2024-09-12T17:11:06.709152+0000","last_active":"2024-09-12T17:14:19.856766+0000","last_peered":"2024-09-12T17:14:19.856766+0000","last_clean":"2024-09-12T17:14:19.856766+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:14:19.856766+0000","last_undegraded":"2024-09-12T17:14:19.856766+0000","last_fullsized":"2024-09-12T17:14:19.856766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.578776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802317+0000","last_change":"2024-09-12T17:11:04.693394+0000","last_active":"2024-09-12T17:11:43.802317+0000","last_peered":"2024-09-12T17:11:43.802317+0000","last_clean":"2024-09-12T17:11:43.802317+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:11:43.802317+0000","last_undegraded":"2024-09-12T17:11:43.802317+0000","last_fullsized":"2024-09-12T17:11:43.802317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:25.577954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798665+0000","last_change":"2024-09-12T17:11:08.717768+0000","last_active":"2024-09-12T17:11:43.798665+0000","last_peered":"2024-09-12T17:11:43.798665+0000","last_clean":"2024-09-12T17:11:43.798665+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:11:43.798665+0000","last_undegraded":"2024-09-12T17:11:43.798665+0000","last_fullsized":"2024-09-12T17:11:43.798665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:07.209528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'37","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:27.759011+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:13:27.759011+0000","last_peered":"2024-09-12T17:13:27.759011+0000","last_clean":"2024-09-12T17:13:27.759011+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:13:27.759011+0000","last_undegraded":"2024-09-12T17:13:27.759011+0000","last_fullsized":"2024-09-12T17:13:27.759011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5805,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":40,"num_read_kb":31,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":405,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.031128+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:20.031128+0000","last_peered":"2024-09-12T17:14:20.031128+0000","last_clean":"2024-09-12T17:14:20.031128+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:20.031128+0000","last_undegraded":"2024-09-12T17:14:20.031128+0000","last_fullsized":"2024-09-12T17:14:20.031128+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759536+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:13:18.759536+0000","last_peered":"2024-09-12T17:13:18.759536+0000","last_clean":"2024-09-12T17:13:18.759536+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:13:18.759536+0000","last_undegraded":"2024-09-12T17:13:18.759536+0000","last_fullsized":"2024-09-12T17:13:18.759536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.396693+0000","last_change":"2024-09-12T17:11:06.700331+0000","last_active":"2024-09-12T17:11:50.396693+0000","last_peered":"2024-09-12T17:11:50.396693+0000","last_clean":"2024-09-12T17:11:50.396693+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:11:50.396693+0000","last_undegraded":"2024-09-12T17:11:50.396693+0000","last_fullsized":"2024-09-12T17:11:50.396693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255080+0000","last_change":"2024-09-12T17:11:04.703034+0000","last_active":"2024-09-12T17:11:49.255080+0000","last_peered":"2024-09-12T17:11:49.255080+0000","last_clean":"2024-09-12T17:11:49.255080+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:11:49.255080+0000","last_undegraded":"2024-09-12T17:11:49.255080+0000","last_fullsized":"2024-09-12T17:11:49.255080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:43.087208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225726+0000","last_change":"2024-09-12T17:11:43.830390+0000","last_active":"2024-09-12T17:13:18.225726+0000","last_peered":"2024-09-12T17:13:18.225726+0000","last_clean":"2024-09-12T17:13:18.225726+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:13:18.225726+0000","last_undegraded":"2024-09-12T17:13:18.225726+0000","last_fullsized":"2024-09-12T17:13:18.225726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.971718+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:19.971718+0000","last_peered":"2024-09-12T17:14:19.971718+0000","last_clean":"2024-09-12T17:14:19.971718+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:19.971718+0000","last_undegraded":"2024-09-12T17:14:19.971718+0000","last_fullsized":"2024-09-12T17:14:19.971718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.965720+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:19.965720+0000","last_peered":"2024-09-12T17:14:19.965720+0000","last_clean":"2024-09-12T17:14:19.965720+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:19.965720+0000","last_undegraded":"2024-09-12T17:14:19.965720+0000","last_fullsized":"2024-09-12T17:14:19.965720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492433+0000","last_change":"2024-09-12T17:11:06.707589+0000","last_active":"2024-09-12T17:14:19.492433+0000","last_peered":"2024-09-12T17:14:19.492433+0000","last_clean":"2024-09-12T17:14:19.492433+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:14:19.492433+0000","last_undegraded":"2024-09-12T17:14:19.492433+0000","last_fullsized":"2024-09-12T17:14:19.492433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:48.926839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255268+0000","last_change":"2024-09-12T17:11:04.703521+0000","last_active":"2024-09-12T17:11:49.255268+0000","last_peered":"2024-09-12T17:11:49.255268+0000","last_clean":"2024-09-12T17:11:49.255268+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:11:49.255268+0000","last_undegraded":"2024-09-12T17:11:49.255268+0000","last_fullsized":"2024-09-12T17:11:49.255268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:58.014451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.784611+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:13:16.784611+0000","last_peered":"2024-09-12T17:13:16.784611+0000","last_clean":"2024-09-12T17:13:16.784611+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:13:16.784611+0000","last_undegraded":"2024-09-12T17:13:16.784611+0000","last_fullsized":"2024-09-12T17:13:16.784611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.928411+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:19.928411+0000","last_peered":"2024-09-12T17:14:19.928411+0000","last_clean":"2024-09-12T17:14:19.928411+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:19.928411+0000","last_undegraded":"2024-09-12T17:14:19.928411+0000","last_fullsized":"2024-09-12T17:14:19.928411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669049+0000","last_change":"2024-09-12T17:11:06.709109+0000","last_active":"2024-09-12T17:13:14.669049+0000","last_peered":"2024-09-12T17:13:14.669049+0000","last_clean":"2024-09-12T17:13:14.669049+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:13:14.669049+0000","last_undegraded":"2024-09-12T17:13:14.669049+0000","last_fullsized":"2024-09-12T17:13:14.669049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:51.560480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:49.751999+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:12:49.751999+0000","last_peered":"2024-09-12T17:12:49.751999+0000","last_clean":"2024-09-12T17:12:49.751999+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:12:49.751999+0000","last_undegraded":"2024-09-12T17:12:49.751999+0000","last_fullsized":"2024-09-12T17:12:49.751999+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804184+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:11:43.804184+0000","last_peered":"2024-09-12T17:11:43.804184+0000","last_clean":"2024-09-12T17:11:43.804184+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:11:43.804184+0000","last_undegraded":"2024-09-12T17:11:43.804184+0000","last_fullsized":"2024-09-12T17:11:43.804184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800617+0000","last_change":"2024-09-12T17:11:04.703751+0000","last_active":"2024-09-12T17:11:43.800617+0000","last_peered":"2024-09-12T17:11:43.800617+0000","last_clean":"2024-09-12T17:11:43.800617+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:11:43.800617+0000","last_undegraded":"2024-09-12T17:11:43.800617+0000","last_fullsized":"2024-09-12T17:11:43.800617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818268+0000","last_change":"2024-09-12T17:11:43.816300+0000","last_active":"2024-09-12T17:11:43.818268+0000","last_peered":"2024-09-12T17:11:43.818268+0000","last_clean":"2024-09-12T17:11:43.818268+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:11:43.818268+0000","last_undegraded":"2024-09-12T17:11:43.818268+0000","last_fullsized":"2024-09-12T17:11:43.818268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:37.695610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.800681+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:13:16.800681+0000","last_peered":"2024-09-12T17:13:16.800681+0000","last_clean":"2024-09-12T17:13:16.800681+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:13:16.800681+0000","last_undegraded":"2024-09-12T17:13:16.800681+0000","last_fullsized":"2024-09-12T17:13:16.800681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:40.493734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802475+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:11:43.802475+0000","last_peered":"2024-09-12T17:11:43.802475+0000","last_clean":"2024-09-12T17:11:43.802475+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:11:43.802475+0000","last_undegraded":"2024-09-12T17:11:43.802475+0000","last_fullsized":"2024-09-12T17:11:43.802475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:25.075965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.804563+0000","last_change":"2024-09-12T17:11:06.693422+0000","last_active":"2024-09-12T17:14:19.804563+0000","last_peered":"2024-09-12T17:14:19.804563+0000","last_clean":"2024-09-12T17:14:19.804563+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:14:19.804563+0000","last_undegraded":"2024-09-12T17:14:19.804563+0000","last_fullsized":"2024-09-12T17:14:19.804563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.467976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799232+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:11:43.799232+0000","last_peered":"2024-09-12T17:11:43.799232+0000","last_clean":"2024-09-12T17:11:43.799232+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:11:43.799232+0000","last_undegraded":"2024-09-12T17:11:43.799232+0000","last_fullsized":"2024-09-12T17:11:43.799232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796953+0000","last_change":"2024-09-12T17:11:04.677283+0000","last_active":"2024-09-12T17:11:43.796953+0000","last_peered":"2024-09-12T17:11:43.796953+0000","last_clean":"2024-09-12T17:11:43.796953+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:11:43.796953+0000","last_undegraded":"2024-09-12T17:11:43.796953+0000","last_fullsized":"2024-09-12T17:11:43.796953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.246536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819515+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:11:43.819515+0000","last_peered":"2024-09-12T17:11:43.819515+0000","last_clean":"2024-09-12T17:11:43.819515+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:11:43.819515+0000","last_undegraded":"2024-09-12T17:11:43.819515+0000","last_fullsized":"2024-09-12T17:11:43.819515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.790398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.723137+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:19.723137+0000","last_peered":"2024-09-12T17:14:19.723137+0000","last_clean":"2024-09-12T17:14:19.723137+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:19.723137+0000","last_undegraded":"2024-09-12T17:14:19.723137+0000","last_fullsized":"2024-09-12T17:14:19.723137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:01.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805519+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:11:43.805519+0000","last_peered":"2024-09-12T17:11:43.805519+0000","last_clean":"2024-09-12T17:11:43.805519+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:11:43.805519+0000","last_undegraded":"2024-09-12T17:11:43.805519+0000","last_fullsized":"2024-09-12T17:11:43.805519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:45.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.692612+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:12:33.692612+0000","last_peered":"2024-09-12T17:12:33.692612+0000","last_clean":"2024-09-12T17:12:33.692612+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:12:33.692612+0000","last_undegraded":"2024-09-12T17:12:33.692612+0000","last_fullsized":"2024-09-12T17:12:33.692612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.700288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'25","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.876594+0000","last_change":"2024-09-12T17:11:06.700482+0000","last_active":"2024-09-12T17:14:19.876594+0000","last_peered":"2024-09-12T17:14:19.876594+0000","last_clean":"2024-09-12T17:14:19.876594+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:14:19.876594+0000","last_undegraded":"2024-09-12T17:14:19.876594+0000","last_fullsized":"2024-09-12T17:14:19.876594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:53.954037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791793+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:11:43.791793+0000","last_peered":"2024-09-12T17:11:43.791793+0000","last_clean":"2024-09-12T17:11:43.791793+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:11:43.791793+0000","last_undegraded":"2024-09-12T17:11:43.791793+0000","last_fullsized":"2024-09-12T17:11:43.791793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.978777+0000","last_change":"2024-09-12T17:11:04.677831+0000","last_active":"2024-09-12T17:12:33.978777+0000","last_peered":"2024-09-12T17:12:33.978777+0000","last_clean":"2024-09-12T17:12:33.978777+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:12:33.978777+0000","last_undegraded":"2024-09-12T17:12:33.978777+0000","last_fullsized":"2024-09-12T17:12:33.978777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.505466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793377+0000","last_change":"2024-09-12T17:11:08.712933+0000","last_active":"2024-09-12T17:11:43.793377+0000","last_peered":"2024-09-12T17:11:43.793377+0000","last_clean":"2024-09-12T17:11:43.793377+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:11:43.793377+0000","last_undegraded":"2024-09-12T17:11:43.793377+0000","last_fullsized":"2024-09-12T17:11:43.793377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:59.902245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956445+0000","last_change":"2024-09-12T17:11:10.735305+0000","last_active":"2024-09-12T17:14:18.956445+0000","last_peered":"2024-09-12T17:14:18.956445+0000","last_clean":"2024-09-12T17:14:18.956445+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:14:18.956445+0000","last_undegraded":"2024-09-12T17:14:18.956445+0000","last_fullsized":"2024-09-12T17:14:18.956445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:41.801702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799591+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:11:43.799591+0000","last_peered":"2024-09-12T17:11:43.799591+0000","last_clean":"2024-09-12T17:11:43.799591+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:11:43.799591+0000","last_undegraded":"2024-09-12T17:11:43.799591+0000","last_fullsized":"2024-09-12T17:11:43.799591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:20.273638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.684614+0000","last_change":"2024-09-12T17:11:06.701808+0000","last_active":"2024-09-12T17:12:33.684614+0000","last_peered":"2024-09-12T17:12:33.684614+0000","last_clean":"2024-09-12T17:12:33.684614+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:12:33.684614+0000","last_undegraded":"2024-09-12T17:12:33.684614+0000","last_fullsized":"2024-09-12T17:12:33.684614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:46.068569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799665+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:11:43.799665+0000","last_peered":"2024-09-12T17:11:43.799665+0000","last_clean":"2024-09-12T17:11:43.799665+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.799665+0000","last_undegraded":"2024-09-12T17:11:43.799665+0000","last_fullsized":"2024-09-12T17:11:43.799665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791477+0000","last_change":"2024-09-12T17:11:04.674550+0000","last_active":"2024-09-12T17:11:43.791477+0000","last_peered":"2024-09-12T17:11:43.791477+0000","last_clean":"2024-09-12T17:11:43.791477+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:11:43.791477+0000","last_undegraded":"2024-09-12T17:11:43.791477+0000","last_fullsized":"2024-09-12T17:11:43.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800092+0000","last_change":"2024-09-12T17:11:08.711996+0000","last_active":"2024-09-12T17:11:43.800092+0000","last_peered":"2024-09-12T17:11:43.800092+0000","last_clean":"2024-09-12T17:11:43.800092+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:11:43.800092+0000","last_undegraded":"2024-09-12T17:11:43.800092+0000","last_fullsized":"2024-09-12T17:11:43.800092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:39.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.753060+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.753060+0000","last_peered":"2024-09-12T17:14:18.753060+0000","last_clean":"2024-09-12T17:14:18.753060+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.753060+0000","last_undegraded":"2024-09-12T17:14:18.753060+0000","last_fullsized":"2024-09-12T17:14:18.753060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:23.846254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818300+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:11:43.818300+0000","last_peered":"2024-09-12T17:11:43.818300+0000","last_clean":"2024-09-12T17:11:43.818300+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:11:43.818300+0000","last_undegraded":"2024-09-12T17:11:43.818300+0000","last_fullsized":"2024-09-12T17:11:43.818300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:33.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.354515+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:18.354515+0000","last_peered":"2024-09-12T17:13:18.354515+0000","last_clean":"2024-09-12T17:13:18.354515+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:18.354515+0000","last_undegraded":"2024-09-12T17:13:18.354515+0000","last_fullsized":"2024-09-12T17:13:18.354515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:16.583308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789879+0000","last_change":"2024-09-12T17:11:06.705536+0000","last_active":"2024-09-12T17:14:19.789879+0000","last_peered":"2024-09-12T17:14:19.789879+0000","last_clean":"2024-09-12T17:14:19.789879+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:14:19.789879+0000","last_undegraded":"2024-09-12T17:14:19.789879+0000","last_fullsized":"2024-09-12T17:14:19.789879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:27.457528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:12.755500+0000","last_change":"2024-09-12T17:11:04.674617+0000","last_active":"2024-09-12T17:13:12.755500+0000","last_peered":"2024-09-12T17:13:12.755500+0000","last_clean":"2024-09-12T17:13:12.755500+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:13:12.755500+0000","last_undegraded":"2024-09-12T17:13:12.755500+0000","last_fullsized":"2024-09-12T17:13:12.755500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:54.666558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799080+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:11:43.799080+0000","last_peered":"2024-09-12T17:11:43.799080+0000","last_clean":"2024-09-12T17:11:43.799080+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:11:43.799080+0000","last_undegraded":"2024-09-12T17:11:43.799080+0000","last_fullsized":"2024-09-12T17:11:43.799080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758361+0000","last_change":"2024-09-12T17:11:08.714792+0000","last_active":"2024-09-12T17:13:13.758361+0000","last_peered":"2024-09-12T17:13:13.758361+0000","last_clean":"2024-09-12T17:13:13.758361+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:13:13.758361+0000","last_undegraded":"2024-09-12T17:13:13.758361+0000","last_fullsized":"2024-09-12T17:13:13.758361+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:27.037237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'61","reported_seq":121,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.802368+0000","last_change":"2024-09-12T17:11:10.745089+0000","last_active":"2024-09-12T17:13:16.802368+0000","last_peered":"2024-09-12T17:13:16.802368+0000","last_clean":"2024-09-12T17:13:16.802368+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:13:16.802368+0000","last_undegraded":"2024-09-12T17:13:16.802368+0000","last_fullsized":"2024-09-12T17:13:16.802368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.460174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791955+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:11:43.791955+0000","last_peered":"2024-09-12T17:11:43.791955+0000","last_clean":"2024-09-12T17:11:43.791955+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:11:43.791955+0000","last_undegraded":"2024-09-12T17:11:43.791955+0000","last_fullsized":"2024-09-12T17:11:43.791955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.574053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807673+0000","last_change":"2024-09-12T17:11:06.705517+0000","last_active":"2024-09-12T17:11:43.807673+0000","last_peered":"2024-09-12T17:11:43.807673+0000","last_clean":"2024-09-12T17:11:43.807673+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:11:43.807673+0000","last_undegraded":"2024-09-12T17:11:43.807673+0000","last_fullsized":"2024-09-12T17:11:43.807673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:59.554886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799985+0000","last_change":"2024-09-12T17:11:04.676312+0000","last_active":"2024-09-12T17:11:43.799985+0000","last_peered":"2024-09-12T17:11:43.799985+0000","last_clean":"2024-09-12T17:11:43.799985+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:11:43.799985+0000","last_undegraded":"2024-09-12T17:11:43.799985+0000","last_fullsized":"2024-09-12T17:11:43.799985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:42.964413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809982+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:11:43.809982+0000","last_peered":"2024-09-12T17:11:43.809982+0000","last_clean":"2024-09-12T17:11:43.809982+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.809982+0000","last_undegraded":"2024-09-12T17:11:43.809982+0000","last_fullsized":"2024-09-12T17:11:43.809982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797949+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:11:43.797949+0000","last_peered":"2024-09-12T17:11:43.797949+0000","last_clean":"2024-09-12T17:11:43.797949+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:11:43.797949+0000","last_undegraded":"2024-09-12T17:11:43.797949+0000","last_fullsized":"2024-09-12T17:11:43.797949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:09.523951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802889+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:11:43.802889+0000","last_peered":"2024-09-12T17:11:43.802889+0000","last_clean":"2024-09-12T17:11:43.802889+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:11:43.802889+0000","last_undegraded":"2024-09-12T17:11:43.802889+0000","last_fullsized":"2024-09-12T17:11:43.802889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:43.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955798+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:18.955798+0000","last_peered":"2024-09-12T17:14:18.955798+0000","last_clean":"2024-09-12T17:14:18.955798+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:18.955798+0000","last_undegraded":"2024-09-12T17:14:18.955798+0000","last_fullsized":"2024-09-12T17:14:18.955798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:29.442661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.700276+0000","last_change":"2024-09-12T17:11:06.689832+0000","last_active":"2024-09-12T17:14:19.700276+0000","last_peered":"2024-09-12T17:14:19.700276+0000","last_clean":"2024-09-12T17:14:19.700276+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:14:19.700276+0000","last_undegraded":"2024-09-12T17:14:19.700276+0000","last_fullsized":"2024-09-12T17:14:19.700276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:21.208607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819353+0000","last_change":"2024-09-12T17:11:04.694780+0000","last_active":"2024-09-12T17:11:43.819353+0000","last_peered":"2024-09-12T17:11:43.819353+0000","last_clean":"2024-09-12T17:11:43.819353+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:11:43.819353+0000","last_undegraded":"2024-09-12T17:11:43.819353+0000","last_fullsized":"2024-09-12T17:11:43.819353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.499606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802798+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:11:43.802798+0000","last_peered":"2024-09-12T17:11:43.802798+0000","last_clean":"2024-09-12T17:11:43.802798+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:11:43.802798+0000","last_undegraded":"2024-09-12T17:11:43.802798+0000","last_fullsized":"2024-09-12T17:11:43.802798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801258+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:11:43.801258+0000","last_peered":"2024-09-12T17:11:43.801258+0000","last_clean":"2024-09-12T17:11:43.801258+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:11:43.801258+0000","last_undegraded":"2024-09-12T17:11:43.801258+0000","last_fullsized":"2024-09-12T17:11:43.801258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:25.268216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:34.005760+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:12:34.005760+0000","last_peered":"2024-09-12T17:12:34.005760+0000","last_clean":"2024-09-12T17:12:34.005760+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:12:34.005760+0000","last_undegraded":"2024-09-12T17:12:34.005760+0000","last_fullsized":"2024-09-12T17:12:34.005760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:11.052561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":400,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.021940+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:20.021940+0000","last_peered":"2024-09-12T17:14:20.021940+0000","last_clean":"2024-09-12T17:14:20.021940+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:20.021940+0000","last_undegraded":"2024-09-12T17:14:20.021940+0000","last_fullsized":"2024-09-12T17:14:20.021940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.857216+0000","last_change":"2024-09-12T17:11:06.691701+0000","last_active":"2024-09-12T17:14:19.857216+0000","last_peered":"2024-09-12T17:14:19.857216+0000","last_clean":"2024-09-12T17:14:19.857216+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:14:19.857216+0000","last_undegraded":"2024-09-12T17:14:19.857216+0000","last_fullsized":"2024-09-12T17:14:19.857216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:40.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.678202+0000","last_change":"2024-09-12T17:11:04.669503+0000","last_active":"2024-09-12T17:14:19.678202+0000","last_peered":"2024-09-12T17:14:19.678202+0000","last_clean":"2024-09-12T17:14:19.678202+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:19.678202+0000","last_undegraded":"2024-09-12T17:14:19.678202+0000","last_fullsized":"2024-09-12T17:14:19.678202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:08.595800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.817481+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:11:43.817481+0000","last_peered":"2024-09-12T17:11:43.817481+0000","last_clean":"2024-09-12T17:11:43.817481+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:11:43.817481+0000","last_undegraded":"2024-09-12T17:11:43.817481+0000","last_fullsized":"2024-09-12T17:11:43.817481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801939+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:11:43.801939+0000","last_peered":"2024-09-12T17:11:43.801939+0000","last_clean":"2024-09-12T17:11:43.801939+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:11:43.801939+0000","last_undegraded":"2024-09-12T17:11:43.801939+0000","last_fullsized":"2024-09-12T17:11:43.801939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'84","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.781712+0000","last_change":"2024-09-12T17:11:10.745211+0000","last_active":"2024-09-12T17:13:16.781712+0000","last_peered":"2024-09-12T17:13:16.781712+0000","last_clean":"2024-09-12T17:13:16.781712+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:13:16.781712+0000","last_undegraded":"2024-09-12T17:13:16.781712+0000","last_fullsized":"2024-09-12T17:13:16.781712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:31.455841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799656+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:11:43.799656+0000","last_peered":"2024-09-12T17:11:43.799656+0000","last_clean":"2024-09-12T17:11:43.799656+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:11:43.799656+0000","last_undegraded":"2024-09-12T17:11:43.799656+0000","last_fullsized":"2024-09-12T17:11:43.799656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:05.933362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.399063+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:11:50.399063+0000","last_peered":"2024-09-12T17:11:50.399063+0000","last_clean":"2024-09-12T17:11:50.399063+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:11:50.399063+0000","last_undegraded":"2024-09-12T17:11:50.399063+0000","last_fullsized":"2024-09-12T17:11:50.399063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:09.467743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699249+0000","last_change":"2024-09-12T17:11:06.700916+0000","last_active":"2024-09-12T17:14:19.699249+0000","last_peered":"2024-09-12T17:14:19.699249+0000","last_clean":"2024-09-12T17:14:19.699249+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:14:19.699249+0000","last_undegraded":"2024-09-12T17:14:19.699249+0000","last_fullsized":"2024-09-12T17:14:19.699249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:56.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795133+0000","last_change":"2024-09-12T17:11:04.704630+0000","last_active":"2024-09-12T17:13:24.795133+0000","last_peered":"2024-09-12T17:13:24.795133+0000","last_clean":"2024-09-12T17:13:24.795133+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:13:24.795133+0000","last_undegraded":"2024-09-12T17:13:24.795133+0000","last_fullsized":"2024-09-12T17:13:24.795133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:49.225315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225988+0000","last_change":"2024-09-12T17:11:08.715453+0000","last_active":"2024-09-12T17:13:18.225988+0000","last_peered":"2024-09-12T17:13:18.225988+0000","last_clean":"2024-09-12T17:13:18.225988+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:13:18.225988+0000","last_undegraded":"2024-09-12T17:13:18.225988+0000","last_fullsized":"2024-09-12T17:13:18.225988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:50.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.789489+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:13:16.789489+0000","last_peered":"2024-09-12T17:13:16.789489+0000","last_clean":"2024-09-12T17:13:16.789489+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:13:16.789489+0000","last_undegraded":"2024-09-12T17:13:16.789489+0000","last_fullsized":"2024-09-12T17:13:16.789489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.384651+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.384651+0000","last_peered":"2024-09-12T17:13:16.384651+0000","last_clean":"2024-09-12T17:13:16.384651+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.384651+0000","last_undegraded":"2024-09-12T17:13:16.384651+0000","last_fullsized":"2024-09-12T17:13:16.384651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:59.671012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807517+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:11:43.807517+0000","last_peered":"2024-09-12T17:11:43.807517+0000","last_clean":"2024-09-12T17:11:43.807517+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:11:43.807517+0000","last_undegraded":"2024-09-12T17:11:43.807517+0000","last_fullsized":"2024-09-12T17:11:43.807517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:32.760064+0000","last_change":"2024-09-12T17:11:04.674643+0000","last_active":"2024-09-12T17:13:32.760064+0000","last_peered":"2024-09-12T17:13:32.760064+0000","last_clean":"2024-09-12T17:13:32.760064+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:13:32.760064+0000","last_undegraded":"2024-09-12T17:13:32.760064+0000","last_fullsized":"2024-09-12T17:13:32.760064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.872048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.668281+0000","last_change":"2024-09-12T17:11:06.691887+0000","last_active":"2024-09-12T17:13:14.668281+0000","last_peered":"2024-09-12T17:13:14.668281+0000","last_clean":"2024-09-12T17:13:14.668281+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:13:14.668281+0000","last_undegraded":"2024-09-12T17:13:14.668281+0000","last_fullsized":"2024-09-12T17:13:14.668281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794222+0000","last_change":"2024-09-12T17:11:04.688216+0000","last_active":"2024-09-12T17:11:43.794222+0000","last_peered":"2024-09-12T17:11:43.794222+0000","last_clean":"2024-09-12T17:11:43.794222+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:11:43.794222+0000","last_undegraded":"2024-09-12T17:11:43.794222+0000","last_fullsized":"2024-09-12T17:11:43.794222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790045+0000","last_change":"2024-09-12T17:11:08.715785+0000","last_active":"2024-09-12T17:11:43.790045+0000","last_peered":"2024-09-12T17:11:43.790045+0000","last_clean":"2024-09-12T17:11:43.790045+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:11:43.790045+0000","last_undegraded":"2024-09-12T17:11:43.790045+0000","last_fullsized":"2024-09-12T17:11:43.790045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:51.935358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'40","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.846470+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:18.846470+0000","last_peered":"2024-09-12T17:14:18.846470+0000","last_clean":"2024-09-12T17:14:18.846470+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:18.846470+0000","last_undegraded":"2024-09-12T17:14:18.846470+0000","last_fullsized":"2024-09-12T17:14:18.846470+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789528+0000","last_change":"2024-09-12T17:11:06.689927+0000","last_active":"2024-09-12T17:14:19.789528+0000","last_peered":"2024-09-12T17:14:19.789528+0000","last_clean":"2024-09-12T17:14:19.789528+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:14:19.789528+0000","last_undegraded":"2024-09-12T17:14:19.789528+0000","last_fullsized":"2024-09-12T17:14:19.789528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820672+0000","last_change":"2024-09-12T17:11:04.693759+0000","last_active":"2024-09-12T17:11:43.820672+0000","last_peered":"2024-09-12T17:11:43.820672+0000","last_clean":"2024-09-12T17:11:43.820672+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:11:43.820672+0000","last_undegraded":"2024-09-12T17:11:43.820672+0000","last_fullsized":"2024-09-12T17:11:43.820672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:38.114303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.770620+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:13:16.770620+0000","last_peered":"2024-09-12T17:13:16.770620+0000","last_clean":"2024-09-12T17:13:16.770620+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:13:16.770620+0000","last_undegraded":"2024-09-12T17:13:16.770620+0000","last_fullsized":"2024-09-12T17:13:16.770620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874185+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.874185+0000","last_peered":"2024-09-12T17:14:19.874185+0000","last_clean":"2024-09-12T17:14:19.874185+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.874185+0000","last_undegraded":"2024-09-12T17:14:19.874185+0000","last_fullsized":"2024-09-12T17:14:19.874185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.972646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799635+0000","last_change":"2024-09-12T17:11:04.703253+0000","last_active":"2024-09-12T17:11:43.799635+0000","last_peered":"2024-09-12T17:11:43.799635+0000","last_clean":"2024-09-12T17:11:43.799635+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:11:43.799635+0000","last_undegraded":"2024-09-12T17:11:43.799635+0000","last_fullsized":"2024-09-12T17:11:43.799635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:31.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803741+0000","last_change":"2024-09-12T17:11:08.711173+0000","last_active":"2024-09-12T17:11:43.803741+0000","last_peered":"2024-09-12T17:11:43.803741+0000","last_clean":"2024-09-12T17:11:43.803741+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:11:43.803741+0000","last_undegraded":"2024-09-12T17:11:43.803741+0000","last_fullsized":"2024-09-12T17:11:43.803741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:01.083466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'54","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.798275+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:13:16.798275+0000","last_peered":"2024-09-12T17:13:16.798275+0000","last_clean":"2024-09-12T17:13:16.798275+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:13:16.798275+0000","last_undegraded":"2024-09-12T17:13:16.798275+0000","last_fullsized":"2024-09-12T17:13:16.798275+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.787946+0000","last_change":"2024-09-12T17:11:06.709521+0000","last_active":"2024-09-12T17:14:19.787946+0000","last_peered":"2024-09-12T17:14:19.787946+0000","last_clean":"2024-09-12T17:14:19.787946+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:14:19.787946+0000","last_undegraded":"2024-09-12T17:14:19.787946+0000","last_fullsized":"2024-09-12T17:14:19.787946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:54.551330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800701+0000","last_change":"2024-09-12T17:11:04.666747+0000","last_active":"2024-09-12T17:11:43.800701+0000","last_peered":"2024-09-12T17:11:43.800701+0000","last_clean":"2024-09-12T17:11:43.800701+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:11:43.800701+0000","last_undegraded":"2024-09-12T17:11:43.800701+0000","last_fullsized":"2024-09-12T17:11:43.800701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:22.246442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814579+0000","last_change":"2024-09-12T17:11:43.809305+0000","last_active":"2024-09-12T17:11:43.814579+0000","last_peered":"2024-09-12T17:11:43.814579+0000","last_clean":"2024-09-12T17:11:43.814579+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:11:43.814579+0000","last_undegraded":"2024-09-12T17:11:43.814579+0000","last_fullsized":"2024-09-12T17:11:43.814579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:04.779608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.771611+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:13:16.771611+0000","last_peered":"2024-09-12T17:13:16.771611+0000","last_clean":"2024-09-12T17:13:16.771611+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:13:16.771611+0000","last_undegraded":"2024-09-12T17:13:16.771611+0000","last_fullsized":"2024-09-12T17:13:16.771611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.349327+0000","last_change":"2024-09-12T17:11:06.709586+0000","last_active":"2024-09-12T17:14:19.349327+0000","last_peered":"2024-09-12T17:14:19.349327+0000","last_clean":"2024-09-12T17:14:19.349327+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:14:19.349327+0000","last_undegraded":"2024-09-12T17:14:19.349327+0000","last_fullsized":"2024-09-12T17:14:19.349327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:43.877851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.253865+0000","last_change":"2024-09-12T17:11:04.671482+0000","last_active":"2024-09-12T17:11:49.253865+0000","last_peered":"2024-09-12T17:11:49.253865+0000","last_clean":"2024-09-12T17:11:49.253865+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:11:49.253865+0000","last_undegraded":"2024-09-12T17:11:49.253865+0000","last_fullsized":"2024-09-12T17:11:49.253865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:38.765410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795517+0000","last_change":"2024-09-12T17:11:08.714321+0000","last_active":"2024-09-12T17:11:43.795517+0000","last_peered":"2024-09-12T17:11:43.795517+0000","last_clean":"2024-09-12T17:11:43.795517+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:11:43.795517+0000","last_undegraded":"2024-09-12T17:11:43.795517+0000","last_fullsized":"2024-09-12T17:11:43.795517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.528516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.794826+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:13:16.794826+0000","last_peered":"2024-09-12T17:13:16.794826+0000","last_clean":"2024-09-12T17:13:16.794826+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:13:16.794826+0000","last_undegraded":"2024-09-12T17:13:16.794826+0000","last_fullsized":"2024-09-12T17:13:16.794826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:55.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802521+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:11:43.802521+0000","last_peered":"2024-09-12T17:11:43.802521+0000","last_clean":"2024-09-12T17:11:43.802521+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:11:43.802521+0000","last_undegraded":"2024-09-12T17:11:43.802521+0000","last_fullsized":"2024-09-12T17:11:43.802521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.882893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.732083+0000","last_change":"2024-09-12T17:11:06.701691+0000","last_active":"2024-09-12T17:13:18.732083+0000","last_peered":"2024-09-12T17:13:18.732083+0000","last_clean":"2024-09-12T17:13:18.732083+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:13:18.732083+0000","last_undegraded":"2024-09-12T17:13:18.732083+0000","last_fullsized":"2024-09-12T17:13:18.732083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:07.167115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803892+0000","last_change":"2024-09-12T17:11:04.699477+0000","last_active":"2024-09-12T17:11:43.803892+0000","last_peered":"2024-09-12T17:11:43.803892+0000","last_clean":"2024-09-12T17:11:43.803892+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:11:43.803892+0000","last_undegraded":"2024-09-12T17:11:43.803892+0000","last_fullsized":"2024-09-12T17:11:43.803892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:28.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.812713+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:11:43.812713+0000","last_peered":"2024-09-12T17:11:43.812713+0000","last_clean":"2024-09-12T17:11:43.812713+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:11:43.812713+0000","last_undegraded":"2024-09-12T17:11:43.812713+0000","last_fullsized":"2024-09-12T17:11:43.812713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:20.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":374,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955870+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:18.955870+0000","last_peered":"2024-09-12T17:14:18.955870+0000","last_clean":"2024-09-12T17:14:18.955870+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:18.955870+0000","last_undegraded":"2024-09-12T17:14:18.955870+0000","last_fullsized":"2024-09-12T17:14:18.955870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:05.585547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.999516+0000","last_change":"2024-09-12T17:11:06.691786+0000","last_active":"2024-09-12T17:12:33.999516+0000","last_peered":"2024-09-12T17:12:33.999516+0000","last_clean":"2024-09-12T17:12:33.999516+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:12:33.999516+0000","last_undegraded":"2024-09-12T17:12:33.999516+0000","last_fullsized":"2024-09-12T17:12:33.999516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:57.050067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.522609+0000","last_change":"2024-09-12T17:11:04.669381+0000","last_active":"2024-09-12T17:13:18.522609+0000","last_peered":"2024-09-12T17:13:18.522609+0000","last_clean":"2024-09-12T17:13:18.522609+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:13:18.522609+0000","last_undegraded":"2024-09-12T17:13:18.522609+0000","last_fullsized":"2024-09-12T17:13:18.522609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:12.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.759007+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:13:16.759007+0000","last_peered":"2024-09-12T17:13:16.759007+0000","last_clean":"2024-09-12T17:13:16.759007+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:13:16.759007+0000","last_undegraded":"2024-09-12T17:13:16.759007+0000","last_fullsized":"2024-09-12T17:13:16.759007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.685021+0000","last_change":"2024-09-12T17:11:06.693085+0000","last_active":"2024-09-12T17:12:33.685021+0000","last_peered":"2024-09-12T17:12:33.685021+0000","last_clean":"2024-09-12T17:12:33.685021+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:12:33.685021+0000","last_undegraded":"2024-09-12T17:12:33.685021+0000","last_fullsized":"2024-09-12T17:12:33.685021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.660908+0000","last_change":"2024-09-12T17:11:04.705899+0000","last_active":"2024-09-12T17:14:19.660908+0000","last_peered":"2024-09-12T17:14:19.660908+0000","last_clean":"2024-09-12T17:14:19.660908+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:14:19.660908+0000","last_undegraded":"2024-09-12T17:14:19.660908+0000","last_fullsized":"2024-09-12T17:14:19.660908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:02.576860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794217+0000","last_change":"2024-09-12T17:11:08.716093+0000","last_active":"2024-09-12T17:11:43.794217+0000","last_peered":"2024-09-12T17:11:43.794217+0000","last_clean":"2024-09-12T17:11:43.794217+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:11:43.794217+0000","last_undegraded":"2024-09-12T17:11:43.794217+0000","last_fullsized":"2024-09-12T17:11:43.794217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.912768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.760672+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:13:16.760672+0000","last_peered":"2024-09-12T17:13:16.760672+0000","last_clean":"2024-09-12T17:13:16.760672+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:13:16.760672+0000","last_undegraded":"2024-09-12T17:13:16.760672+0000","last_fullsized":"2024-09-12T17:13:16.760672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.791235+0000","last_change":"2024-09-12T17:11:43.823977+0000","last_active":"2024-09-12T17:14:19.791235+0000","last_peered":"2024-09-12T17:14:19.791235+0000","last_clean":"2024-09-12T17:14:19.791235+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:14:19.791235+0000","last_undegraded":"2024-09-12T17:14:19.791235+0000","last_fullsized":"2024-09-12T17:14:19.791235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:25.321871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802954+0000","last_change":"2024-09-12T17:11:04.697071+0000","last_active":"2024-09-12T17:11:43.802954+0000","last_peered":"2024-09-12T17:11:43.802954+0000","last_clean":"2024-09-12T17:11:43.802954+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:11:43.802954+0000","last_undegraded":"2024-09-12T17:11:43.802954+0000","last_fullsized":"2024-09-12T17:11:43.802954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:00.835341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.211792+0000","last_change":"2024-09-12T17:11:08.722764+0000","last_active":"2024-09-12T17:13:18.211792+0000","last_peered":"2024-09-12T17:13:18.211792+0000","last_clean":"2024-09-12T17:13:18.211792+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:13:18.211792+0000","last_undegraded":"2024-09-12T17:13:18.211792+0000","last_fullsized":"2024-09-12T17:13:18.211792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:27.090536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.791697+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:13:16.791697+0000","last_peered":"2024-09-12T17:13:16.791697+0000","last_clean":"2024-09-12T17:13:16.791697+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:13:16.791697+0000","last_undegraded":"2024-09-12T17:13:16.791697+0000","last_fullsized":"2024-09-12T17:13:16.791697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699419+0000","last_change":"2024-09-12T17:11:06.689179+0000","last_active":"2024-09-12T17:14:19.699419+0000","last_peered":"2024-09-12T17:14:19.699419+0000","last_clean":"2024-09-12T17:14:19.699419+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:14:19.699419+0000","last_undegraded":"2024-09-12T17:14:19.699419+0000","last_fullsized":"2024-09-12T17:14:19.699419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.719846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820794+0000","last_change":"2024-09-12T17:11:04.677503+0000","last_active":"2024-09-12T17:11:43.820794+0000","last_peered":"2024-09-12T17:11:43.820794+0000","last_clean":"2024-09-12T17:11:43.820794+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:11:43.820794+0000","last_undegraded":"2024-09-12T17:11:43.820794+0000","last_fullsized":"2024-09-12T17:11:43.820794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:52.031685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.793999+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:18.793999+0000","last_peered":"2024-09-12T17:14:18.793999+0000","last_clean":"2024-09-12T17:14:18.793999+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:18.793999+0000","last_undegraded":"2024-09-12T17:14:18.793999+0000","last_fullsized":"2024-09-12T17:14:18.793999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.821261+0000","last_change":"2024-09-12T17:11:06.707086+0000","last_active":"2024-09-12T17:11:43.821261+0000","last_peered":"2024-09-12T17:11:43.821261+0000","last_clean":"2024-09-12T17:11:43.821261+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:11:43.821261+0000","last_undegraded":"2024-09-12T17:11:43.821261+0000","last_fullsized":"2024-09-12T17:11:43.821261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:22.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.788395+0000","last_change":"2024-09-12T17:11:04.672228+0000","last_active":"2024-09-12T17:11:43.788395+0000","last_peered":"2024-09-12T17:11:43.788395+0000","last_clean":"2024-09-12T17:11:43.788395+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:11:43.788395+0000","last_undegraded":"2024-09-12T17:11:43.788395+0000","last_fullsized":"2024-09-12T17:11:43.788395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:53.980176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.730752+0000","last_change":"2024-09-12T17:11:06.700232+0000","last_active":"2024-09-12T17:13:18.730752+0000","last_peered":"2024-09-12T17:13:18.730752+0000","last_clean":"2024-09-12T17:13:18.730752+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:13:18.730752+0000","last_undegraded":"2024-09-12T17:13:18.730752+0000","last_fullsized":"2024-09-12T17:13:18.730752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:44.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.259200+0000","last_change":"2024-09-12T17:11:04.675280+0000","last_active":"2024-09-12T17:11:49.259200+0000","last_peered":"2024-09-12T17:11:49.259200+0000","last_clean":"2024-09-12T17:11:49.259200+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:11:49.259200+0000","last_undegraded":"2024-09-12T17:11:49.259200+0000","last_fullsized":"2024-09-12T17:11:49.259200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:30.778946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.367423+0000","last_change":"2024-09-12T17:11:06.695274+0000","last_active":"2024-09-12T17:14:19.367423+0000","last_peered":"2024-09-12T17:14:19.367423+0000","last_clean":"2024-09-12T17:14:19.367423+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:14:19.367423+0000","last_undegraded":"2024-09-12T17:14:19.367423+0000","last_fullsized":"2024-09-12T17:14:19.367423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.138206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800213+0000","last_change":"2024-09-12T17:11:04.703925+0000","last_active":"2024-09-12T17:11:43.800213+0000","last_peered":"2024-09-12T17:11:43.800213+0000","last_clean":"2024-09-12T17:11:43.800213+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:11:43.800213+0000","last_undegraded":"2024-09-12T17:11:43.800213+0000","last_fullsized":"2024-09-12T17:11:43.800213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759765+0000","last_change":"2024-09-12T17:11:06.703392+0000","last_active":"2024-09-12T17:13:18.759765+0000","last_peered":"2024-09-12T17:13:18.759765+0000","last_clean":"2024-09-12T17:13:18.759765+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:13:18.759765+0000","last_undegraded":"2024-09-12T17:13:18.759765+0000","last_fullsized":"2024-09-12T17:13:18.759765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799380+0000","last_change":"2024-09-12T17:11:04.684732+0000","last_active":"2024-09-12T17:11:43.799380+0000","last_peered":"2024-09-12T17:11:43.799380+0000","last_clean":"2024-09-12T17:11:43.799380+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:11:43.799380+0000","last_undegraded":"2024-09-12T17:11:43.799380+0000","last_fullsized":"2024-09-12T17:11:43.799380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:40.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799093+0000","last_change":"2024-09-12T17:11:06.702655+0000","last_active":"2024-09-12T17:11:43.799093+0000","last_peered":"2024-09-12T17:11:43.799093+0000","last_clean":"2024-09-12T17:11:43.799093+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:11:43.799093+0000","last_undegraded":"2024-09-12T17:11:43.799093+0000","last_fullsized":"2024-09-12T17:11:43.799093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799927+0000","last_change":"2024-09-12T17:11:04.680886+0000","last_active":"2024-09-12T17:11:43.799927+0000","last_peered":"2024-09-12T17:11:43.799927+0000","last_clean":"2024-09-12T17:11:43.799927+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:11:43.799927+0000","last_undegraded":"2024-09-12T17:11:43.799927+0000","last_fullsized":"2024-09-12T17:11:43.799927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:32.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.494618+0000","last_change":"2024-09-12T17:11:06.706847+0000","last_active":"2024-09-12T17:14:19.494618+0000","last_peered":"2024-09-12T17:14:19.494618+0000","last_clean":"2024-09-12T17:14:19.494618+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:14:19.494618+0000","last_undegraded":"2024-09-12T17:14:19.494618+0000","last_fullsized":"2024-09-12T17:14:19.494618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:47.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.693926+0000","last_change":"2024-09-12T17:11:04.669265+0000","last_active":"2024-09-12T17:11:50.693926+0000","last_peered":"2024-09-12T17:11:50.693926+0000","last_clean":"2024-09-12T17:11:50.693926+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:11:50.693926+0000","last_undegraded":"2024-09-12T17:11:50.693926+0000","last_fullsized":"2024-09-12T17:11:50.693926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.747887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758256+0000","last_change":"2024-09-12T17:11:06.699610+0000","last_active":"2024-09-12T17:13:13.758256+0000","last_peered":"2024-09-12T17:13:13.758256+0000","last_clean":"2024-09-12T17:13:13.758256+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:13:13.758256+0000","last_undegraded":"2024-09-12T17:13:13.758256+0000","last_fullsized":"2024-09-12T17:13:13.758256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794970+0000","last_change":"2024-09-12T17:11:04.688321+0000","last_active":"2024-09-12T17:11:43.794970+0000","last_peered":"2024-09-12T17:11:43.794970+0000","last_clean":"2024-09-12T17:11:43.794970+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:11:43.794970+0000","last_undegraded":"2024-09-12T17:11:43.794970+0000","last_fullsized":"2024-09-12T17:11:43.794970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:00.136516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788842+0000","last_change":"2024-09-12T17:11:06.697920+0000","last_active":"2024-09-12T17:14:19.788842+0000","last_peered":"2024-09-12T17:14:19.788842+0000","last_clean":"2024-09-12T17:14:19.788842+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:14:19.788842+0000","last_undegraded":"2024-09-12T17:14:19.788842+0000","last_fullsized":"2024-09-12T17:14:19.788842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:41.481908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803540+0000","last_change":"2024-09-12T17:11:04.678483+0000","last_active":"2024-09-12T17:11:43.803540+0000","last_peered":"2024-09-12T17:11:43.803540+0000","last_clean":"2024-09-12T17:11:43.803540+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:11:43.803540+0000","last_undegraded":"2024-09-12T17:11:43.803540+0000","last_fullsized":"2024-09-12T17:11:43.803540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:32.707968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669536+0000","last_change":"2024-09-12T17:11:06.703492+0000","last_active":"2024-09-12T17:13:14.669536+0000","last_peered":"2024-09-12T17:13:14.669536+0000","last_clean":"2024-09-12T17:13:14.669536+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:13:14.669536+0000","last_undegraded":"2024-09-12T17:13:14.669536+0000","last_fullsized":"2024-09-12T17:13:14.669536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:33.304445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800268+0000","last_change":"2024-09-12T17:11:04.699383+0000","last_active":"2024-09-12T17:11:43.800268+0000","last_peered":"2024-09-12T17:11:43.800268+0000","last_clean":"2024-09-12T17:11:43.800268+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:11:43.800268+0000","last_undegraded":"2024-09-12T17:11:43.800268+0000","last_fullsized":"2024-09-12T17:11:43.800268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:31.767352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797277+0000","last_change":"2024-09-12T17:11:04.684375+0000","last_active":"2024-09-12T17:11:43.797277+0000","last_peered":"2024-09-12T17:11:43.797277+0000","last_clean":"2024-09-12T17:11:43.797277+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:11:43.797277+0000","last_undegraded":"2024-09-12T17:11:43.797277+0000","last_fullsized":"2024-09-12T17:11:43.797277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:05.836478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491265+0000","last_change":"2024-09-12T17:11:06.702748+0000","last_active":"2024-09-12T17:14:19.491265+0000","last_peered":"2024-09-12T17:14:19.491265+0000","last_clean":"2024-09-12T17:14:19.491265+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:14:19.491265+0000","last_undegraded":"2024-09-12T17:14:19.491265+0000","last_fullsized":"2024-09-12T17:14:19.491265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758403+0000","last_change":"2024-09-12T17:11:04.671497+0000","last_active":"2024-09-12T17:13:19.758403+0000","last_peered":"2024-09-12T17:13:19.758403+0000","last_clean":"2024-09-12T17:13:19.758403+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:13:19.758403+0000","last_undegraded":"2024-09-12T17:13:19.758403+0000","last_fullsized":"2024-09-12T17:13:19.758403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:02.752436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'19","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719500+0000","last_change":"2024-09-12T17:11:06.697799+0000","last_active":"2024-09-12T17:14:19.719500+0000","last_peered":"2024-09-12T17:14:19.719500+0000","last_clean":"2024-09-12T17:14:19.719500+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:14:19.719500+0000","last_undegraded":"2024-09-12T17:14:19.719500+0000","last_fullsized":"2024-09-12T17:14:19.719500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:51.237525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807578+0000","last_change":"2024-09-12T17:11:04.669643+0000","last_active":"2024-09-12T17:11:43.807578+0000","last_peered":"2024-09-12T17:11:43.807578+0000","last_clean":"2024-09-12T17:11:43.807578+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:11:43.807578+0000","last_undegraded":"2024-09-12T17:11:43.807578+0000","last_fullsized":"2024-09-12T17:11:43.807578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:12.651503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856748+0000","last_change":"2024-09-12T17:11:06.706910+0000","last_active":"2024-09-12T17:14:19.856748+0000","last_peered":"2024-09-12T17:14:19.856748+0000","last_clean":"2024-09-12T17:14:19.856748+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:14:19.856748+0000","last_undegraded":"2024-09-12T17:14:19.856748+0000","last_fullsized":"2024-09-12T17:14:19.856748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:09.726713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255243+0000","last_change":"2024-09-12T17:11:04.698962+0000","last_active":"2024-09-12T17:11:49.255243+0000","last_peered":"2024-09-12T17:11:49.255243+0000","last_clean":"2024-09-12T17:11:49.255243+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:11:49.255243+0000","last_undegraded":"2024-09-12T17:11:49.255243+0000","last_fullsized":"2024-09-12T17:11:49.255243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:58.287096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856816+0000","last_change":"2024-09-12T17:11:06.698579+0000","last_active":"2024-09-12T17:14:19.856816+0000","last_peered":"2024-09-12T17:14:19.856816+0000","last_clean":"2024-09-12T17:14:19.856816+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:14:19.856816+0000","last_undegraded":"2024-09-12T17:14:19.856816+0000","last_fullsized":"2024-09-12T17:14:19.856816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.305167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.810471+0000","last_change":"2024-09-12T17:11:04.706258+0000","last_active":"2024-09-12T17:11:43.810471+0000","last_peered":"2024-09-12T17:11:43.810471+0000","last_clean":"2024-09-12T17:11:43.810471+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:11:43.810471+0000","last_undegraded":"2024-09-12T17:11:43.810471+0000","last_fullsized":"2024-09-12T17:11:43.810471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.595508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856680+0000","last_change":"2024-09-12T17:11:43.799543+0000","last_active":"2024-09-12T17:14:19.856680+0000","last_peered":"2024-09-12T17:14:19.856680+0000","last_clean":"2024-09-12T17:14:19.856680+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:14:19.856680+0000","last_undegraded":"2024-09-12T17:14:19.856680+0000","last_fullsized":"2024-09-12T17:14:19.856680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.634562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795628+0000","last_change":"2024-09-12T17:11:04.688801+0000","last_active":"2024-09-12T17:11:43.795628+0000","last_peered":"2024-09-12T17:11:43.795628+0000","last_clean":"2024-09-12T17:11:43.795628+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:11:43.795628+0000","last_undegraded":"2024-09-12T17:11:43.795628+0000","last_fullsized":"2024-09-12T17:11:43.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.317920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491662+0000","last_change":"2024-09-12T17:11:06.692150+0000","last_active":"2024-09-12T17:14:19.491662+0000","last_peered":"2024-09-12T17:14:19.491662+0000","last_clean":"2024-09-12T17:14:19.491662+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:14:19.491662+0000","last_undegraded":"2024-09-12T17:14:19.491662+0000","last_fullsized":"2024-09-12T17:14:19.491662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:03.537778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818404+0000","last_change":"2024-09-12T17:11:04.699011+0000","last_active":"2024-09-12T17:11:43.818404+0000","last_peered":"2024-09-12T17:11:43.818404+0000","last_clean":"2024-09-12T17:11:43.818404+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:11:43.818404+0000","last_undegraded":"2024-09-12T17:11:43.818404+0000","last_fullsized":"2024-09-12T17:11:43.818404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.663093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.794825+0000","last_change":"2024-09-12T17:11:04.699035+0000","last_active":"2024-09-12T17:13:24.794825+0000","last_peered":"2024-09-12T17:13:24.794825+0000","last_clean":"2024-09-12T17:13:24.794825+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:13:24.794825+0000","last_undegraded":"2024-09-12T17:13:24.794825+0000","last_fullsized":"2024-09-12T17:13:24.794825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788135+0000","last_change":"2024-09-12T17:11:06.699450+0000","last_active":"2024-09-12T17:14:19.788135+0000","last_peered":"2024-09-12T17:14:19.788135+0000","last_clean":"2024-09-12T17:14:19.788135+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:14:19.788135+0000","last_undegraded":"2024-09-12T17:14:19.788135+0000","last_fullsized":"2024-09-12T17:14:19.788135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.494877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797601+0000","last_change":"2024-09-12T17:11:04.683423+0000","last_active":"2024-09-12T17:11:43.797601+0000","last_peered":"2024-09-12T17:11:43.797601+0000","last_clean":"2024-09-12T17:11:43.797601+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:11:43.797601+0000","last_undegraded":"2024-09-12T17:11:43.797601+0000","last_fullsized":"2024-09-12T17:11:43.797601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.682059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.735133+0000","last_change":"2024-09-12T17:11:06.707075+0000","last_active":"2024-09-12T17:13:18.735133+0000","last_peered":"2024-09-12T17:13:18.735133+0000","last_clean":"2024-09-12T17:13:18.735133+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:13:18.735133+0000","last_undegraded":"2024-09-12T17:13:18.735133+0000","last_fullsized":"2024-09-12T17:13:18.735133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:46.709626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13383,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50532,"kb_used_data":11028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321308,"statfs":{"total":96636764160,"available":96585019392,"internally_reserved":0,"allocated":11292672,"data_stored":10961414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44864,"kb_used_data":9520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326976,"statfs":{"total":96636764160,"available":96590823424,"internally_reserved":0,"allocated":9748480,"data_stored":9453120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48136,"kb_used_data":8632,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323704,"statfs":{"total":96636764160,"available":96587472896,"internally_reserved":0,"allocated":8839168,"data_stored":8541155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46896,"kb_used_data":11552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94324944,"statfs":{"total":96636764160,"available":96588742656,"internally_reserved":0,"allocated":11829248,"data_stored":11550721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:14:52.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:14:52.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.911+0000 7f4f083c0640 1 Processor -- start 2024-09-12T17:14:52.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.911+0000 7f4f083c0640 1 -- start start 2024-09-12T17:14:52.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f00111890 0x7f4f00132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f00073a90 con 0x7f4f00110da0 2024-09-12T17:14:52.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4f000696e0 con 0x7f4f00111890 2024-09-12T17:14:52.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0595b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f00111890 0x7f4f00132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0615c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4f00110da0 0x7f4f00111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38144/0 (socket says 172.21.15.62:38144) 2024-09-12T17:14:52.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0615c640 1 -- 172.21.15.62:0/260535475 learned_addr learned my addr 172.21.15.62:0/260535475 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:52.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0595b640 1 -- 172.21.15.62:0/260535475 >> v1:172.21.15.62:6789/0 conn(0x7f4f00110da0 legacy=0x7f4f00111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0595b640 1 -- 172.21.15.62:0/260535475 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0006dd50 con 0x7f4f00111890 2024-09-12T17:14:52.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0515a640 1 -- 172.21.15.62:0/260535475 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287290152 0 0) 0x7f4f00073a90 con 0x7f4f00110da0 2024-09-12T17:14:52.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0595b640 1 --2- 172.21.15.62:0/260535475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00111890 0x7f4f00132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009740 tx=0x7f4ef401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591e71dd5712a48a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0515a640 1 -- 172.21.15.62:0/260535475 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef40b0070 con 0x7f4f00111890 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0515a640 1 -- 172.21.15.62:0/260535475 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef40ab530 con 0x7f4f00111890 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f0515a640 1 -- 172.21.15.62:0/260535475 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef40ab830 con 0x7f4f00111890 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- 172.21.15.62:0/260535475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00111890 msgr2=0x7f4f00132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 --2- 172.21.15.62:0/260535475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00111890 0x7f4f00132450 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009740 tx=0x7f4ef401c370 comp rx=0 tx=0).stop 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- 172.21.15.62:0/260535475 shutdown_connections 2024-09-12T17:14:52.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 --2- 172.21.15.62:0/260535475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00111890 0x7f4f00132450 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:52.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- 172.21.15.62:0/260535475 >> 172.21.15.62:0/260535475 conn(0x7f4f00070900 msgr2=0x7f4f00072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:52.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- 172.21.15.62:0/260535475 shutdown_connections 2024-09-12T17:14:52.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.915+0000 7f4f083c0640 1 -- 172.21.15.62:0/260535475 wait complete. 2024-09-12T17:14:52.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 Processor -- start 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 -- start start 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00135330 con 0x7f4f00110da0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0615c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0615c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60494/0 (socket says 172.21.15.62:60494) 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0615c640 1 -- 172.21.15.62:0/2665829872 learned_addr learned my addr 172.21.15.62:0/2665829872 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0615c640 1 -- 172.21.15.62:0/2665829872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f001140d0 con 0x7f4f00110da0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0615c640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c7f0 tx=0x7f4ef000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef0018070 con 0x7f4f00110da0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef0004d80 con 0x7f4f00110da0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0012f7b0 con 0x7f4f00110da0 2024-09-12T17:14:52.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ef000a7b0 con 0x7f4f00110da0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0012fca0 con 0x7f4f00110da0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f00111180 con 0x7f4f00110da0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4ef001b070 con 0x7f4f00110da0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 0x7f4eec03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4ef004ede0 con 0x7f4f00110da0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.919+0000 7f4f0595b640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 0x7f4eec03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.923+0000 7f4f0595b640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 0x7f4eec03d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40ad000 tx=0x7f4ef4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:52.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:52.923+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f4ef0011360 con 0x7f4f00110da0 2024-09-12T17:14:53.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.095+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f001275f0 con 0x7f4f00110da0 2024-09-12T17:14:53.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.099+0000 7f4efeffd640 1 -- 172.21.15.62:0/2665829872 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+21142 (secure 0 0 0) 0x7f4ef0010d70 con 0x7f4f00110da0 2024-09-12T17:14:53.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:14:53.105 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"fsid":"198a6104-5b15-4a13-a23d-e0904a8cd750","created":"2024-09-12T17:10:37.676189+0000","modified":"2024-09-12T17:11:43.779088+0000","last_up_change":"2024-09-12T17:10:48.732218+0000","last_in_change":"2024-09-12T17:10:38.856102+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:10:48.692031+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:10:53.581785+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":17,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:11:02.646862+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:11:05.026668+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:11:06.909401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:11:08.843287+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:11:10.759431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:11:12.897602+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fe207eab-874b-4cab-b0b9-bad98e2ff8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6801","nonce":4046570222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6803","nonce":4046570222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6807","nonce":4046570222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":4046570222},{"type":"v1","addr":"172.21.15.62:6805","nonce":4046570222}]},"public_addr":"172.21.15.62:6801/4046570222","cluster_addr":"172.21.15.62:6803/4046570222","heartbeat_back_addr":"172.21.15.62:6807/4046570222","heartbeat_front_addr":"172.21.15.62:6805/4046570222","state":["exists","up"]},{"osd":1,"uuid":"ea19089e-ce25-40ca-aff9-7c73315bb51e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6809","nonce":1040547927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6811","nonce":1040547927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6815","nonce":1040547927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":1040547927},{"type":"v1","addr":"172.21.15.193:6813","nonce":1040547927}]},"public_addr":"172.21.15.193:6809/1040547927","cluster_addr":"172.21.15.193:6811/1040547927","heartbeat_back_addr":"172.21.15.193:6815/1040547927","heartbeat_front_addr":"172.21.15.193:6813/1040547927","state":["exists","up"]},{"osd":2,"uuid":"3480faae-f8de-4e3e-a8fc-a884592e7228","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6801","nonce":1491583795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6803","nonce":1491583795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6807","nonce":1491583795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":1491583795},{"type":"v1","addr":"172.21.15.193:6805","nonce":1491583795}]},"public_addr":"172.21.15.193:6801/1491583795","cluster_addr":"172.21.15.193:6803/1491583795","heartbeat_back_addr":"172.21.15.193:6807/1491583795","heartbeat_front_addr":"172.21.15.193:6805/1491583795","state":["exists","up"]},{"osd":3,"uuid":"865097ec-4413-4906-89a8-28b5234ae853","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6817","nonce":1944991354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6819","nonce":1944991354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6823","nonce":1944991354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":1944991354},{"type":"v1","addr":"172.21.15.193:6821","nonce":1944991354}]},"public_addr":"172.21.15.193:6817/1944991354","cluster_addr":"172.21.15.193:6819/1944991354","heartbeat_back_addr":"172.21.15.193:6823/1944991354","heartbeat_front_addr":"172.21.15.193:6821/1944991354","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:44.745671+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.880365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.607464+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:10:45.844552+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.19","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.f","mappings":[{"from":0,"to":2}]},{"pgid":"5.1f","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 msgr2=0x7f4eec03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 0x7f4eec03d6c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4ef40ad000 tx=0x7f4ef4008040 comp rx=0 tx=0).stop 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 msgr2=0x7f4f001226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000c7f0 tx=0x7f4ef000ccb0 comp rx=0 tx=0).stop 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 shutdown_connections 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f4eec03b200 0x7f4eec03d6c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 --2- 172.21.15.62:0/2665829872 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f00110da0 0x7f4f001226b0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 >> 172.21.15.62:0/2665829872 conn(0x7f4f00070900 msgr2=0x7f4f00129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 shutdown_connections 2024-09-12T17:14:53.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:53.103+0000 7f4f083c0640 1 -- 172.21.15.62:0/2665829872 wait complete. 2024-09-12T17:14:54.191 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T17:14:54.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:14:54.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d8e2ad640 1 Processor -- start 2024-09-12T17:14:54.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d8e2ad640 1 -- start start 2024-09-12T17:14:54.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d8e2ad640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d88129a20 0x7f0d88129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d8e2ad640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d8812a930 con 0x7f0d8812a4f0 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d8e2ad640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0d88069170 con 0x7f0d88129a20 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d87fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d88129a20 0x7f0d88129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d877fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0d8812a4f0 0x7f0d8812cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38148/0 (socket says 172.21.15.62:38148) 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d877fe640 1 -- 172.21.15.62:0/2522059717 learned_addr learned my addr 172.21.15.62:0/2522059717 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d87fff640 1 -- 172.21.15.62:0/2522059717 >> v1:172.21.15.62:6789/0 conn(0x7f0d8812a4f0 legacy=0x7f0d8812cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.327+0000 7f0d87fff640 1 -- 172.21.15.62:0/2522059717 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d88114950 con 0x7f0d88129a20 2024-09-12T17:14:54.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d87fff640 1 --2- 172.21.15.62:0/2522059717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88129fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009740 tx=0x7f0d7801c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f3d90f4c906592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d86ffd640 1 -- 172.21.15.62:0/2522059717 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d780b0070 con 0x7f0d88129a20 2024-09-12T17:14:54.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d86ffd640 1 -- 172.21.15.62:0/2522059717 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d780ab530 con 0x7f0d88129a20 2024-09-12T17:14:54.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d86ffd640 1 -- 172.21.15.62:0/2522059717 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d780ab830 con 0x7f0d88129a20 2024-09-12T17:14:54.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/2522059717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 msgr2=0x7f0d88129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/2522059717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88129fb0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009740 tx=0x7f0d7801c200 comp rx=0 tx=0).stop 2024-09-12T17:14:54.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/2522059717 shutdown_connections 2024-09-12T17:14:54.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/2522059717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88129fb0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/2522059717 >> 172.21.15.62:0/2522059717 conn(0x7f0d88070d70 msgr2=0x7f0d88073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/2522059717 shutdown_connections 2024-09-12T17:14:54.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/2522059717 wait complete. 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 Processor -- start 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- start start 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d8e2ad640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88135ce0 con 0x7f0d88129a20 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d87fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60504/0 (socket says 172.21.15.62:60504) 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.331+0000 7f0d87fff640 1 -- 172.21.15.62:0/3341196793 learned_addr learned my addr 172.21.15.62:0/3341196793 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:54.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d87fff640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d88123cb0 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d87fff640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0d780ae040 tx=0x7f0d7801aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d780b0050 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d780b1040 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d88117c90 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d780b58b0 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d88115b60 con 0x7f0d88129a20 2024-09-12T17:14:54.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d88118320 con 0x7f0d88129a20 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f0d780be030 con 0x7f0d88129a20 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 0x7f0d7403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f0d780bc070 con 0x7f0d88129a20 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 0x7f0d74049aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d780a9ec0 con 0x7f0d74047600 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0d780ee2a0 con 0x7f0d88129a20 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d8c84a640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 0x7f0d74049aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d877fe640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 0x7f0d7403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d8c84a640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 0x7f0d74049aa0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d877fe640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 0x7f0d7403d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c005890 tx=0x7f0d7c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.335+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== osd.0 v2:172.21.15.62:6800/4046570222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d780a9ec0 con 0x7f0d74047600 2024-09-12T17:14:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 --> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d88129fb0 con 0x7f0d74047600 2024-09-12T17:14:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d84ff9640 1 -- 172.21.15.62:0/3341196793 <== osd.0 v2:172.21.15.62:6800/4046570222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d88129fb0 con 0x7f0d74047600 2024-09-12T17:14:54.356 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T17:14:54.356 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:14:54.356 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T17:14:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 msgr2=0x7f0d74049aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 0x7f0d74049aa0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 msgr2=0x7f0d7403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 0x7f0d7403d690 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c005890 tx=0x7f0d7c007ab0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 msgr2=0x7f0d88115450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0d780ae040 tx=0x7f0d7801aa40 comp rx=0 tx=0).stop 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 shutdown_connections 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:6800/4046570222,v1:172.21.15.62:6801/4046570222] conn(0x7f0d74047600 0x7f0d74049aa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f0d7403b1d0 0x7f0d7403d690 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 --2- 172.21.15.62:0/3341196793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d88129a20 0x7f0d88115450 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 >> 172.21.15.62:0/3341196793 conn(0x7f0d88070d70 msgr2=0x7f0d881323d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 shutdown_connections 2024-09-12T17:14:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.351+0000 7f0d8e2ad640 1 -- 172.21.15.62:0/3341196793 wait complete. 2024-09-12T17:14:54.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee167f5640 1 Processor -- start 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee167f5640 1 -- start start 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee167f5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee1012d2e0 0x7fee1012d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee167f5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee101122f0 con 0x7fee1012dc00 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee167f5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fee1006dcb0 con 0x7fee1012d2e0 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee0f7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fee1012dc00 0x7fee10110da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38156/0 (socket says 172.21.15.62:38156) 2024-09-12T17:14:54.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee0f7fe640 1 -- 172.21.15.62:0/148368709 learned_addr learned my addr 172.21.15.62:0/148368709 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:54.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee0ffff640 1 --2- 172.21.15.62:0/148368709 >> v2:172.21.15.62:3300/0 conn(0x7fee1012d2e0 0x7fee1012d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee0ffff640 1 -- 172.21.15.62:0/148368709 >> v1:172.21.15.62:6789/0 conn(0x7fee1012dc00 legacy=0x7fee10110da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.479+0000 7fee0ffff640 1 -- 172.21.15.62:0/148368709 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee10073ad0 con 0x7fee1012d2e0 2024-09-12T17:14:54.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0ffff640 1 --2- 172.21.15.62:0/148368709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee1012d6c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fee04009740 tx=0x7fee0401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a445feb0cd92a636 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0effd640 1 -- 172.21.15.62:0/148368709 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee040b0070 con 0x7fee1012d2e0 2024-09-12T17:14:54.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0effd640 1 -- 172.21.15.62:0/148368709 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee040ab530 con 0x7fee1012d2e0 2024-09-12T17:14:54.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0effd640 1 -- 172.21.15.62:0/148368709 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee040ab830 con 0x7fee1012d2e0 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- 172.21.15.62:0/148368709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 msgr2=0x7fee1012d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 --2- 172.21.15.62:0/148368709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee1012d6c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fee04009740 tx=0x7fee0401c370 comp rx=0 tx=0).stop 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- 172.21.15.62:0/148368709 shutdown_connections 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 --2- 172.21.15.62:0/148368709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee1012d6c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- 172.21.15.62:0/148368709 >> 172.21.15.62:0/148368709 conn(0x7fee10070940 msgr2=0x7fee10072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- 172.21.15.62:0/148368709 shutdown_connections 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- 172.21.15.62:0/148368709 wait complete. 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 Processor -- start 2024-09-12T17:14:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- start start 2024-09-12T17:14:54.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee167f5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fee10135e30 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60512/0 (socket says 172.21.15.62:60512) 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.483+0000 7fee0ffff640 1 -- 172.21.15.62:0/3508932861 learned_addr learned my addr 172.21.15.62:0/3508932861 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0ffff640 1 -- 172.21.15.62:0/3508932861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee101167e0 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0ffff640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fee040ae040 tx=0x7fee04019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee040b8020 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee040b4600 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee10117bd0 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fee040b0040 con 0x7fee1012d2e0 2024-09-12T17:14:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee101c77c0 con 0x7fee1012d2e0 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1012d6c0 con 0x7fee1012d2e0 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fee040bb020 con 0x7fee1012d2e0 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 0x7fedfc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fee040e97d0 con 0x7fee1012d2e0 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0f7fe640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 0x7fedfc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.487+0000 7fee0f7fe640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 0x7fedfc03d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fee00005890 tx=0x7fee00007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.491+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fee040c2030 con 0x7fee1012d2e0 2024-09-12T17:14:54.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.663+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fee10068e50 con 0x7fedfc03b1d0 2024-09-12T17:14:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.663+0000 7fee0cff9640 1 -- 172.21.15.62:0/3508932861 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fee10068e50 con 0x7fedfc03b1d0 2024-09-12T17:14:54.669 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T17:14:54.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 msgr2=0x7fedfc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 0x7fedfc03d690 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fee00005890 tx=0x7fee00007ab0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 msgr2=0x7fee101c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fee040ae040 tx=0x7fee04019110 comp rx=0 tx=0).stop 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 shutdown_connections 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fedfc03b1d0 0x7fedfc03d690 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 --2- 172.21.15.62:0/3508932861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee1012d2e0 0x7fee101c7280 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 >> 172.21.15.62:0/3508932861 conn(0x7fee10070940 msgr2=0x7fee10071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 shutdown_connections 2024-09-12T17:14:54.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.667+0000 7fee167f5640 1 -- 172.21.15.62:0/3508932861 wait complete. 2024-09-12T17:14:54.689 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T17:14:54.689 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:14:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a20147640 1 Processor -- start 2024-09-12T17:14:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a20147640 1 -- start start 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a20147640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a181324e0 0x7f4a181348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a20147640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18115c60 con 0x7f4a1812f6d0 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a20147640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4a18115570 con 0x7f4a181324e0 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1d6e2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a181324e0 0x7f4a181348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1d6e2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4a181324e0 0x7f4a181348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60520/0 (socket says 172.21.15.62:60520) 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1d6e2640 1 -- 172.21.15.62:0/3946506568 learned_addr learned my addr 172.21.15.62:0/3946506568 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1dee3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4a1812f6d0 0x7f4a1812fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38164/0 (socket says 172.21.15.62:38164) 2024-09-12T17:14:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1d6e2640 1 -- 172.21.15.62:0/3946506568 >> v1:172.21.15.62:6789/0 conn(0x7f4a1812f6d0 legacy=0x7f4a1812fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.811+0000 7f4a1d6e2640 1 -- 172.21.15.62:0/3946506568 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18116b40 con 0x7f4a181324e0 2024-09-12T17:14:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1d6e2640 1 --2- 172.21.15.62:0/3946506568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a181324e0 0x7f4a181348d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4a140097f0 tx=0x7f4a1401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd99c8377fec1ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1cee1640 1 -- 172.21.15.62:0/3946506568 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a140ab580 con 0x7f4a181324e0 2024-09-12T17:14:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1cee1640 1 -- 172.21.15.62:0/3946506568 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a140b0070 con 0x7f4a181324e0 2024-09-12T17:14:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1cee1640 1 -- 172.21.15.62:0/3946506568 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a140ab870 con 0x7f4a181324e0 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- 172.21.15.62:0/3946506568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a181324e0 msgr2=0x7f4a181348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 --2- 172.21.15.62:0/3946506568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a181324e0 0x7f4a181348d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4a140097f0 tx=0x7f4a1401c430 comp rx=0 tx=0).stop 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- 172.21.15.62:0/3946506568 shutdown_connections 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 --2- 172.21.15.62:0/3946506568 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a181324e0 0x7f4a181348d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- 172.21.15.62:0/3946506568 >> 172.21.15.62:0/3946506568 conn(0x7f4a1806fc50 msgr2=0x7f4a18072070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- 172.21.15.62:0/3946506568 shutdown_connections 2024-09-12T17:14:54.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- 172.21.15.62:0/3946506568 wait complete. 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 Processor -- start 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- start start 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a20147640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4a181379c0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1dee3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1dee3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60530/0 (socket says 172.21.15.62:60530) 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1dee3640 1 -- 172.21.15.62:0/3273570346 learned_addr learned my addr 172.21.15.62:0/3273570346 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1dee3640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a181298c0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a1dee3640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c480 tx=0x7f4a0800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.815+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a08007410 con 0x7f4a1812f6d0 2024-09-12T17:14:54.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a080075b0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a181179e0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a08004920 con 0x7f4a1812f6d0 2024-09-12T17:14:54.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a18125320 con 0x7f4a1812f6d0 2024-09-12T17:14:54.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a1812fab0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f4a0801a020 con 0x7f4a1812f6d0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 0x7f49fc03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f4a0804ef20 con 0x7f4a1812f6d0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 0x7f49fc0499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a08013e50 con 0x7f49fc047550 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4a080515d0 con 0x7f4a1812f6d0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a1d6e2640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 0x7f49fc03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a1e6e4640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 0x7f49fc0499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a1d6e2640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 0x7f49fc03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a140af000 tx=0x7f4a140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.819+0000 7f4a1e6e4640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 0x7f49fc0499f0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.823+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== osd.1 v2:172.21.15.193:6808/1040547927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a08013e50 con 0x7f49fc047550 2024-09-12T17:14:54.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 --> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4a181184f0 con 0x7f49fc047550 2024-09-12T17:14:54.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a0e7fc640 1 -- 172.21.15.62:0/3273570346 <== osd.1 v2:172.21.15.193:6808/1040547927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4a181184f0 con 0x7f49fc047550 2024-09-12T17:14:54.842 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T17:14:54.842 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:14:54.842 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 msgr2=0x7f49fc0499f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 0x7f49fc0499f0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 msgr2=0x7f49fc03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 0x7f49fc03d690 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a140af000 tx=0x7f4a140a7000 comp rx=0 tx=0).stop 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 msgr2=0x7f4a18124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c480 tx=0x7f4a0800c940 comp rx=0 tx=0).stop 2024-09-12T17:14:54.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 shutdown_connections 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6808/1040547927,v1:172.21.15.193:6809/1040547927] conn(0x7f49fc047550 0x7f49fc0499f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f49fc03b1d0 0x7f49fc03d690 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 --2- 172.21.15.62:0/3273570346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1812f6d0 0x7f4a18124de0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 >> 172.21.15.62:0/3273570346 conn(0x7f4a1806fc50 msgr2=0x7f4a1812a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 shutdown_connections 2024-09-12T17:14:54.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.835+0000 7f4a20147640 1 -- 172.21.15.62:0/3273570346 wait complete. 2024-09-12T17:14:54.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T17:14:54.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f27802af640 1 Processor -- start 2024-09-12T17:14:54.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f27802af640 1 -- start start 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f27802af640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f277812d2e0 0x7f277812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f27802af640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27781122f0 con 0x7f277812dc00 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f27802af640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f277806dcb0 con 0x7f277812d2e0 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f277e04b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f277812d2e0 0x7f277812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f277d84a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f277812dc00 0x7f2778110da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38178/0 (socket says 172.21.15.62:38178) 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f277d84a640 1 -- 172.21.15.62:0/3966440164 learned_addr learned my addr 172.21.15.62:0/3966440164 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f277e04b640 1 -- 172.21.15.62:0/3966440164 >> v1:172.21.15.62:6789/0 conn(0x7f277812dc00 legacy=0x7f2778110da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.967+0000 7f277e04b640 1 -- 172.21.15.62:0/3966440164 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2778073ad0 con 0x7f277812d2e0 2024-09-12T17:14:54.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277e04b640 1 --2- 172.21.15.62:0/3966440164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f277812d6c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2770009d90 tx=0x7f277001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0275204ea8e0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277d049640 1 -- 172.21.15.62:0/3966440164 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700a6560 con 0x7f277812d2e0 2024-09-12T17:14:54.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277d049640 1 -- 172.21.15.62:0/3966440164 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27700a6700 con 0x7f277812d2e0 2024-09-12T17:14:54.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277d049640 1 -- 172.21.15.62:0/3966440164 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700a6a00 con 0x7f277812d2e0 2024-09-12T17:14:54.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- 172.21.15.62:0/3966440164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 msgr2=0x7f277812d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:54.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 --2- 172.21.15.62:0/3966440164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f277812d6c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f2770009d90 tx=0x7f277001c8c0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- 172.21.15.62:0/3966440164 shutdown_connections 2024-09-12T17:14:54.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 --2- 172.21.15.62:0/3966440164 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f277812d6c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:54.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- 172.21.15.62:0/3966440164 >> 172.21.15.62:0/3966440164 conn(0x7f2778070940 msgr2=0x7f2778072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:54.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- 172.21.15.62:0/3966440164 shutdown_connections 2024-09-12T17:14:54.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- 172.21.15.62:0/3966440164 wait complete. 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 Processor -- start 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- start start 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f27802af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2778135e30 con 0x7f277812d2e0 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277e04b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277e04b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60552/0 (socket says 172.21.15.62:60552) 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.971+0000 7f277e04b640 1 -- 172.21.15.62:0/2874080434 learned_addr learned my addr 172.21.15.62:0/2874080434 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f277e04b640 1 -- 172.21.15.62:0/2874080434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2778127640 con 0x7f277812d2e0 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f277e04b640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f277001a4f0 tx=0x7f2770019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700a7750 con 0x7f277812d2e0 2024-09-12T17:14:54.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27700c0070 con 0x7f277812d2e0 2024-09-12T17:14:54.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f27700a7a20 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2778116060 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2778115960 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f27700a7bc0 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2778132960 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 0x7f276403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f27700eadf0 con 0x7f277812d2e0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f277d84a640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 0x7f276403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:54.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.975+0000 7f277d84a640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 0x7f276403d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f276c005890 tx=0x7f276c007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:54.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:54.979+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f27700ac030 con 0x7f277812d2e0 2024-09-12T17:14:55.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.151+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f277812d6c0 con 0x7f276403b1d0 2024-09-12T17:14:55.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.151+0000 7f2776ffd640 1 -- 172.21.15.62:0/2874080434 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f277812d6c0 con 0x7f276403b1d0 2024-09-12T17:14:55.158 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T17:14:55.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 msgr2=0x7f276403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 0x7f276403d690 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f276c005890 tx=0x7f276c007ab0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 msgr2=0x7f2778122d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f277001a4f0 tx=0x7f2770019660 comp rx=0 tx=0).stop 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 shutdown_connections 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f276403b1d0 0x7f276403d690 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 --2- 172.21.15.62:0/2874080434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f277812d2e0 0x7f2778122d60 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 >> 172.21.15.62:0/2874080434 conn(0x7f2778070940 msgr2=0x7f2778071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 shutdown_connections 2024-09-12T17:14:55.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.155+0000 7f27802af640 1 -- 172.21.15.62:0/2874080434 wait complete. 2024-09-12T17:14:55.177 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T17:14:55.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:14:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30ad68b640 1 Processor -- start 2024-09-12T17:14:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30ad68b640 1 -- start start 2024-09-12T17:14:55.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30ad68b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30a8129a20 0x7f30a8129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30ad68b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a812a930 con 0x7f30a812a4f0 2024-09-12T17:14:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30ad68b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f30a8069170 con 0x7f30a8129a20 2024-09-12T17:14:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a6ffd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30a8129a20 0x7f30a8129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a67fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f30a812a4f0 0x7f30a812cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38192/0 (socket says 172.21.15.62:38192) 2024-09-12T17:14:55.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a67fc640 1 -- 172.21.15.62:0/199544460 learned_addr learned my addr 172.21.15.62:0/199544460 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a5ffb640 1 -- 172.21.15.62:0/199544460 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354956097 0 0) 0x7f309c001120 con 0x7f30a812a4f0 2024-09-12T17:14:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a5ffb640 1 -- 172.21.15.62:0/199544460 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3090003530 con 0x7f30a812a4f0 2024-09-12T17:14:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a6ffd640 1 -- 172.21.15.62:0/199544460 >> v1:172.21.15.62:6789/0 conn(0x7f30a812a4f0 legacy=0x7f30a812cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.299+0000 7f30a6ffd640 1 -- 172.21.15.62:0/199544460 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8114950 con 0x7f30a8129a20 2024-09-12T17:14:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a6ffd640 1 --2- 172.21.15.62:0/199544460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8129fb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009d90 tx=0x7f30a001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2498c472c209fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a5ffb640 1 -- 172.21.15.62:0/199544460 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a00b2070 con 0x7f30a8129a20 2024-09-12T17:14:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a5ffb640 1 -- 172.21.15.62:0/199544460 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a00a5660 con 0x7f30a8129a20 2024-09-12T17:14:55.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a5ffb640 1 -- 172.21.15.62:0/199544460 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a00a5960 con 0x7f30a8129a20 2024-09-12T17:14:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- 172.21.15.62:0/199544460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 msgr2=0x7f30a8129fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 --2- 172.21.15.62:0/199544460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8129fb0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009d90 tx=0x7f30a001c8c0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- 172.21.15.62:0/199544460 shutdown_connections 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 --2- 172.21.15.62:0/199544460 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8129fb0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- 172.21.15.62:0/199544460 >> 172.21.15.62:0/199544460 conn(0x7f30a8070d70 msgr2=0x7f30a8073190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- 172.21.15.62:0/199544460 shutdown_connections 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- 172.21.15.62:0/199544460 wait complete. 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 Processor -- start 2024-09-12T17:14:55.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- start start 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30ad68b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8135ce0 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60582/0 (socket says 172.21.15.62:60582) 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.303+0000 7f30a6ffd640 1 -- 172.21.15.62:0/2603839628 learned_addr learned my addr 172.21.15.62:0/2603839628 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a6ffd640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8127710 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a6ffd640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b0040 tx=0x7f30a0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a00bd070 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a00b8650 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a81157b0 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30a00b2040 con 0x7f30a8129a20 2024-09-12T17:14:55.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a8123160 con 0x7f30a8129a20 2024-09-12T17:14:55.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30a8129fb0 con 0x7f30a8129a20 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f30a00c0070 con 0x7f30a8129a20 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 0x7f309403d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f30a00ea4d0 con 0x7f30a8129a20 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 0x7f30940499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30a00a5660 con 0x7f3094047550 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f30a00f1050 con 0x7f30a8129a20 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a67fc640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 0x7f309403d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a77fe640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 0x7f30940499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a77fe640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 0x7f30940499f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.307+0000 7f30a67fc640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 0x7f309403d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f309c005890 tx=0x7f309c001280 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.311+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== osd.2 v2:172.21.15.193:6800/1491583795 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30a00a5660 con 0x7f3094047550 2024-09-12T17:14:55.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 --> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f30a8115e70 con 0x7f3094047550 2024-09-12T17:14:55.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f308f7fe640 1 -- 172.21.15.62:0/2603839628 <== osd.2 v2:172.21.15.193:6800/1491583795 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f30a8115e70 con 0x7f3094047550 2024-09-12T17:14:55.330 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T17:14:55.330 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:14:55.330 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T17:14:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 msgr2=0x7f30940499f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 0x7f30940499f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 msgr2=0x7f309403d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 0x7f309403d690 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f309c005890 tx=0x7f309c001280 comp rx=0 tx=0).stop 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 msgr2=0x7f30a8122c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.323+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b0040 tx=0x7f30a0019660 comp rx=0 tx=0).stop 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 shutdown_connections 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6800/1491583795,v1:172.21.15.193:6801/1491583795] conn(0x7f3094047550 0x7f30940499f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f309403b1d0 0x7f309403d690 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 --2- 172.21.15.62:0/2603839628 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a8129a20 0x7f30a8122c20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 >> 172.21.15.62:0/2603839628 conn(0x7f30a8070d70 msgr2=0x7f30a8127ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 shutdown_connections 2024-09-12T17:14:55.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.327+0000 7f30ad68b640 1 -- 172.21.15.62:0/2603839628 wait complete. 2024-09-12T17:14:55.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T17:14:55.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56f61d640 1 Processor -- start 2024-09-12T17:14:55.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56f61d640 1 -- start start 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56f61d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc56812d2e0 0x7fc56812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56f61d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5681122f0 con 0x7fc56812dc00 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56f61d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc56806dcb0 con 0x7fc56812d2e0 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56d3b9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc56812d2e0 0x7fc56812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56cbb8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc56812dc00 0x7fc568110da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38198/0 (socket says 172.21.15.62:38198) 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56cbb8640 1 -- 172.21.15.62:0/3382869969 learned_addr learned my addr 172.21.15.62:0/3382869969 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56d3b9640 1 -- 172.21.15.62:0/3382869969 >> v1:172.21.15.62:6789/0 conn(0x7fc56812dc00 legacy=0x7fc568110da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc56d3b9640 1 -- 172.21.15.62:0/3382869969 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc568073ad0 con 0x7fc56812d2e0 2024-09-12T17:14:55.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.459+0000 7fc55ffff640 1 -- 172.21.15.62:0/3382869969 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437930448 0 0) 0x7fc5681122f0 con 0x7fc56812dc00 2024-09-12T17:14:55.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 --2- 172.21.15.62:0/3382869969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc56812d6c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc564009740 tx=0x7fc56401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f45e67b0f279cff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55ffff640 1 -- 172.21.15.62:0/3382869969 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5640b0070 con 0x7fc56812d2e0 2024-09-12T17:14:55.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55ffff640 1 -- 172.21.15.62:0/3382869969 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5640ab530 con 0x7fc56812d2e0 2024-09-12T17:14:55.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55ffff640 1 -- 172.21.15.62:0/3382869969 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5640ab830 con 0x7fc56812d2e0 2024-09-12T17:14:55.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/3382869969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 msgr2=0x7fc56812d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 --2- 172.21.15.62:0/3382869969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc56812d6c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fc564009740 tx=0x7fc56401c370 comp rx=0 tx=0).stop 2024-09-12T17:14:55.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/3382869969 shutdown_connections 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 --2- 172.21.15.62:0/3382869969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc56812d6c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/3382869969 >> 172.21.15.62:0/3382869969 conn(0x7fc568070940 msgr2=0x7fc568072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/3382869969 shutdown_connections 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/3382869969 wait complete. 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 Processor -- start 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- start start 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc568135e30 con 0x7fc56812d2e0 2024-09-12T17:14:55.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60602/0 (socket says 172.21.15.62:60602) 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 -- 172.21.15.62:0/770810100 learned_addr learned my addr 172.21.15.62:0/770810100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 -- 172.21.15.62:0/770810100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc568127640 con 0x7fc56812d2e0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56d3b9640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc564019fa0 tx=0x7fc56401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5640b0050 con 0x7fc56812d2e0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5640b1040 con 0x7fc56812d2e0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5640042a0 con 0x7fc56812d2e0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc568132da0 con 0x7fc56812d2e0 2024-09-12T17:14:55.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.463+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681159a0 con 0x7fc56812d2e0 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc56812d6c0 con 0x7fc56812d2e0 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fc5640be060 con 0x7fc56812d2e0 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc55dffb640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 0x7fc54c03d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fc5640e96a0 con 0x7fc56812d2e0 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc56cbb8640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 0x7fc54c03d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.467+0000 7fc56cbb8640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 0x7fc54c03d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc558007fd0 tx=0x7fc5580078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.471+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fc568127640 con 0x7fc56812d2e0 2024-09-12T17:14:55.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.643+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc568132680 con 0x7fc54c03b200 2024-09-12T17:14:55.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.643+0000 7fc55dffb640 1 -- 172.21.15.62:0/770810100 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc568132680 con 0x7fc54c03b200 2024-09-12T17:14:55.651 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 msgr2=0x7fc54c03d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 0x7fc54c03d6c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc558007fd0 tx=0x7fc5580078e0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 msgr2=0x7fc5681c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fc564019fa0 tx=0x7fc56401abb0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 shutdown_connections 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fc54c03b200 0x7fc54c03d6c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 --2- 172.21.15.62:0/770810100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc56812d2e0 0x7fc5681c5260 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 >> 172.21.15.62:0/770810100 conn(0x7fc568070940 msgr2=0x7fc56812a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 shutdown_connections 2024-09-12T17:14:55.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.647+0000 7fc56f61d640 1 -- 172.21.15.62:0/770810100 wait complete. 2024-09-12T17:14:55.669 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T17:14:55.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f545db56640 1 Processor -- start 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f545db56640 1 -- start start 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f545db56640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f545812c170 0x7f545812c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f545db56640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5458116be0 con 0x7f545812ca90 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f545db56640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f545812bdb0 con 0x7f545812c170 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f54577fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f545812c170 0x7f545812c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f5456ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f545812ca90 0x7f545812f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38212/0 (socket says 172.21.15.62:38212) 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f5456ffd640 1 -- 172.21.15.62:0/2460389202 learned_addr learned my addr 172.21.15.62:0/2460389202 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f54577fe640 1 -- 172.21.15.62:0/2460389202 >> v1:172.21.15.62:6789/0 conn(0x7f545812ca90 legacy=0x7f545812f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.815+0000 7f54577fe640 1 -- 172.21.15.62:0/2460389202 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54581166f0 con 0x7f545812c170 2024-09-12T17:14:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54577fe640 1 --2- 172.21.15.62:0/2460389202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f545812c550 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5440009770 tx=0x7f544001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df34746a5f1c0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54567fc640 1 -- 172.21.15.62:0/2460389202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54400b0070 con 0x7f545812c170 2024-09-12T17:14:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54567fc640 1 -- 172.21.15.62:0/2460389202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54400ab530 con 0x7f545812c170 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54567fc640 1 -- 172.21.15.62:0/2460389202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54400ab830 con 0x7f545812c170 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- 172.21.15.62:0/2460389202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 msgr2=0x7f545812c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 --2- 172.21.15.62:0/2460389202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f545812c550 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f5440009770 tx=0x7f544001c370 comp rx=0 tx=0).stop 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- 172.21.15.62:0/2460389202 shutdown_connections 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 --2- 172.21.15.62:0/2460389202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f545812c550 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- 172.21.15.62:0/2460389202 >> 172.21.15.62:0/2460389202 conn(0x7f5458071e50 msgr2=0x7f5458072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- 172.21.15.62:0/2460389202 shutdown_connections 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- 172.21.15.62:0/2460389202 wait complete. 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 Processor -- start 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- start start 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f545db56640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5458137a60 con 0x7f545812c170 2024-09-12T17:14:55.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54577fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54577fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60616/0 (socket says 172.21.15.62:60616) 2024-09-12T17:14:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54577fe640 1 -- 172.21.15.62:0/362406676 learned_addr learned my addr 172.21.15.62:0/362406676 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.819+0000 7f54577fe640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5458129a80 con 0x7f545812c170 2024-09-12T17:14:55.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f54577fe640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f54400ae040 tx=0x7f544001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54400b0050 con 0x7f545812c170 2024-09-12T17:14:55.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54400b1040 con 0x7f545812c170 2024-09-12T17:14:55.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54400b5780 con 0x7f545812c170 2024-09-12T17:14:55.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5458118880 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5458133ca0 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f545812c550 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f54400be030 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 0x7f543803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f54400bc070 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 0x7f5438049a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54400a9ec0 con 0x7f54380475e0 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f54400f0050 con 0x7f545812c170 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f5456ffd640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 0x7f543803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f5457fff640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 0x7f5438049a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f5456ffd640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 0x7f543803d6c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5448005890 tx=0x7f5448007ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.823+0000 7f5457fff640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 0x7f5438049a80 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.827+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== osd.3 v2:172.21.15.193:6816/1944991354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54400a9ec0 con 0x7f54380475e0 2024-09-12T17:14:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 --> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5458117bf0 con 0x7f54380475e0 2024-09-12T17:14:55.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f544ffff640 1 -- 172.21.15.62:0/362406676 <== osd.3 v2:172.21.15.193:6816/1944991354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5458117bf0 con 0x7f54380475e0 2024-09-12T17:14:55.850 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T17:14:55.850 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:14:55.850 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 msgr2=0x7f5438049a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 0x7f5438049a80 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 msgr2=0x7f543803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 0x7f543803d6c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5448005890 tx=0x7f5448007ab0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 msgr2=0x7f5458133760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f54400ae040 tx=0x7f544001abb0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 shutdown_connections 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f543803b200 0x7f543803d6c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.193:6816/1944991354,v1:172.21.15.193:6817/1944991354] conn(0x7f54380475e0 0x7f5438049a80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 --2- 172.21.15.62:0/362406676 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f545812c170 0x7f5458133760 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 >> 172.21.15.62:0/362406676 conn(0x7f5458071e50 msgr2=0x7f545809aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 shutdown_connections 2024-09-12T17:14:55.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.839+0000 7f545db56640 1 -- 172.21.15.62:0/362406676 wait complete. 2024-09-12T17:14:55.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T17:14:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e3af2640 1 Processor -- start 2024-09-12T17:14:55.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e3af2640 1 -- start start 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e3af2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20dc09ec60 0x7f20dc1322c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e3af2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20dc0a0860 con 0x7f20dc09fd70 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e3af2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f20dc09deb0 con 0x7f20dc09ec60 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e108d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f20dc09ec60 0x7f20dc1322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e188e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f20dc09fd70 0x7f20dc0a0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38214/0 (socket says 172.21.15.62:38214) 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e188e640 1 -- 172.21.15.62:0/1928768046 learned_addr learned my addr 172.21.15.62:0/1928768046 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:55.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e108d640 1 -- 172.21.15.62:0/1928768046 >> v1:172.21.15.62:6789/0 conn(0x7f20dc09fd70 legacy=0x7f20dc0a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.967+0000 7f20e108d640 1 -- 172.21.15.62:0/1928768046 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc09e2d0 con 0x7f20dc09ec60 2024-09-12T17:14:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e108d640 1 --2- 172.21.15.62:0/1928768046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc1322c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009770 tx=0x7f20cc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5498a71491a126cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e088c640 1 -- 172.21.15.62:0/1928768046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20cc0b1070 con 0x7f20dc09ec60 2024-09-12T17:14:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e088c640 1 -- 172.21.15.62:0/1928768046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc0ac570 con 0x7f20dc09ec60 2024-09-12T17:14:55.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e088c640 1 -- 172.21.15.62:0/1928768046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20cc0ac870 con 0x7f20dc09ec60 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- 172.21.15.62:0/1928768046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 msgr2=0x7f20dc1322c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1928768046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc1322c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009770 tx=0x7f20cc01c400 comp rx=0 tx=0).stop 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- 172.21.15.62:0/1928768046 shutdown_connections 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1928768046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc1322c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- 172.21.15.62:0/1928768046 >> 172.21.15.62:0/1928768046 conn(0x7f20dc071e50 msgr2=0x7f20dc072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- 172.21.15.62:0/1928768046 shutdown_connections 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- 172.21.15.62:0/1928768046 wait complete. 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 Processor -- start 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- start start 2024-09-12T17:14:55.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e3af2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc1353b0 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e188e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e188e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60636/0 (socket says 172.21.15.62:60636) 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e188e640 1 -- 172.21.15.62:0/1176987296 learned_addr learned my addr 172.21.15.62:0/1176987296 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.971+0000 7f20e188e640 1 -- 172.21.15.62:0/1176987296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc1277d0 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e188e640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f20d800cbd0 tx=0x7f20d800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d8017070 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d800abc0 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc1182c0 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20d8012400 con 0x7f20dc09ec60 2024-09-12T17:14:55.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc119b60 con 0x7f20dc09ec60 2024-09-12T17:14:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc1275b0 con 0x7f20dc09ec60 2024-09-12T17:14:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f20d801a070 con 0x7f20dc09ec60 2024-09-12T17:14:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 0x7f20c003d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:55.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f20d804f4c0 con 0x7f20dc09ec60 2024-09-12T17:14:55.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e108d640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 0x7f20c003d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:55.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.975+0000 7f20e108d640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 0x7f20c003d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0ae000 tx=0x7f20cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:55.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:55.979+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f20d80078c0 con 0x7f20dc09ec60 2024-09-12T17:14:56.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.147+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f20dc11a010 con 0x7f20c003b1d0 2024-09-12T17:14:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20d27fc640 1 -- 172.21.15.62:0/1176987296 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f20dc11a010 con 0x7f20c003b1d0 2024-09-12T17:14:56.156 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T17:14:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 msgr2=0x7f20c003d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 0x7f20c003d690 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20cc0ae000 tx=0x7f20cc008040 comp rx=0 tx=0).stop 2024-09-12T17:14:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 msgr2=0x7f20dc116d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f20d800cbd0 tx=0x7f20d800a430 comp rx=0 tx=0).stop 2024-09-12T17:14:56.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 shutdown_connections 2024-09-12T17:14:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f20c003b1d0 0x7f20c003d690 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 --2- 172.21.15.62:0/1176987296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f20dc09ec60 0x7f20dc116d70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 >> 172.21.15.62:0/1176987296 conn(0x7f20dc071e50 msgr2=0x7f20dc12ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 shutdown_connections 2024-09-12T17:14:56.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.155+0000 7f20e3af2640 1 -- 172.21.15.62:0/1176987296 wait complete. 2024-09-12T17:14:56.175 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:14:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.295+0000 7fd9ac88f640 1 Processor -- start 2024-09-12T17:14:56.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.295+0000 7fd9ac88f640 1 -- start start 2024-09-12T17:14:56.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.295+0000 7fd9ac88f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9a8110da0 0x7fd9a8111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:56.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.295+0000 7fd9ac88f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9a8073a90 con 0x7fd9a81116c0 2024-09-12T17:14:56.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.295+0000 7fd9ac88f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd9a80696e0 con 0x7fd9a8110da0 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9a8110da0 0x7fd9a8111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a5d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd9a81116c0 0x7fd9a81231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38228/0 (socket says 172.21.15.62:38228) 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a5d9b640 1 -- 172.21.15.62:0/662740709 learned_addr learned my addr 172.21.15.62:0/662740709 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a659c640 1 -- 172.21.15.62:0/662740709 >> v1:172.21.15.62:6789/0 conn(0x7fd9a81116c0 legacy=0x7fd9a81231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a659c640 1 -- 172.21.15.62:0/662740709 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a806dd50 con 0x7fd9a8110da0 2024-09-12T17:14:56.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a559a640 1 -- 172.21.15.62:0/662740709 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829296434 0 0) 0x7fd9a8073a90 con 0x7fd9a81116c0 2024-09-12T17:14:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a659c640 1 --2- 172.21.15.62:0/662740709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a8111180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd998009740 tx=0x7fd99801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28a0d03c0949a14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a559a640 1 -- 172.21.15.62:0/662740709 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9980b0070 con 0x7fd9a8110da0 2024-09-12T17:14:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a559a640 1 -- 172.21.15.62:0/662740709 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9980ab530 con 0x7fd9a8110da0 2024-09-12T17:14:56.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9a559a640 1 -- 172.21.15.62:0/662740709 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9980ab830 con 0x7fd9a8110da0 2024-09-12T17:14:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 -- 172.21.15.62:0/662740709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 msgr2=0x7fd9a8111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/662740709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a8111180 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd998009740 tx=0x7fd99801c370 comp rx=0 tx=0).stop 2024-09-12T17:14:56.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 -- 172.21.15.62:0/662740709 shutdown_connections 2024-09-12T17:14:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/662740709 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a8111180 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 -- 172.21.15.62:0/662740709 >> 172.21.15.62:0/662740709 conn(0x7fd9a8070900 msgr2=0x7fd9a8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 -- 172.21.15.62:0/662740709 shutdown_connections 2024-09-12T17:14:56.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.299+0000 7fd9ac88f640 1 -- 172.21.15.62:0/662740709 wait complete. 2024-09-12T17:14:56.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 Processor -- start 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 -- start start 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a8135470 con 0x7fd9a8110da0 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60644/0 (socket says 172.21.15.62:60644) 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a659c640 1 -- 172.21.15.62:0/810106529 learned_addr learned my addr 172.21.15.62:0/810106529 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a659c640 1 -- 172.21.15.62:0/810106529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a81155f0 con 0x7fd9a8110da0 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a659c640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd9980ae040 tx=0x7fd998019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:56.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9980b8020 con 0x7fd9a8110da0 2024-09-12T17:14:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9980b4600 con 0x7fd9a8110da0 2024-09-12T17:14:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a8132a00 con 0x7fd9a8110da0 2024-09-12T17:14:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9980b0040 con 0x7fd9a8110da0 2024-09-12T17:14:56.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a8130c00 con 0x7fd9a8110da0 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fd9980bb020 con 0x7fd9a8110da0 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a8131d70 con 0x7fd9a8110da0 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 0x7fd98803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fd9980e9700 con 0x7fd9a8110da0 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.303+0000 7fd9a5d9b640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 0x7fd98803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:14:56.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.307+0000 7fd9a5d9b640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 0x7fd98803d690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd99c007fd0 tx=0x7fd99c0078e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:14:56.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.307+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fd9980c2030 con 0x7fd9a8110da0 2024-09-12T17:14:56.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.471+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9a8132e00 con 0x7fd98803b1d0 2024-09-12T17:14:56.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.499+0000 7fd996ffd640 1 -- 172.21.15.62:0/810106529 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665772 (secure 0 0 0) 0x7fd99c0070d0 con 0x7fd98803b1d0 2024-09-12T17:14:56.506 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:14:56.516 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 msgr2=0x7fd98803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 0x7fd98803d690 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd99c007fd0 tx=0x7fd99c0078e0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 msgr2=0x7fd9a81306c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd9980ae040 tx=0x7fd998019110 comp rx=0 tx=0).stop 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 shutdown_connections 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fd98803b1d0 0x7fd98803d690 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 --2- 172.21.15.62:0/810106529 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9a8110da0 0x7fd9a81306c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 >> 172.21.15.62:0/810106529 conn(0x7fd9a8070900 msgr2=0x7fd9a812ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:14:56.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 shutdown_connections 2024-09-12T17:14:56.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:14:56.507+0000 7fd9ac88f640 1 -- 172.21.15.62:0/810106529 wait complete. 2024-09-12T17:14:56.531 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-12T17:14:54.778944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18022498,"num_objects":227,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":5022,"num_read_kb":4613,"num_write":2082,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4495,"ondisk_log_size":4495,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":171680,"kb_used_data":21976,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377315680,"statfs":{"total":386547056640,"available":386371256320,"internally_reserved":0,"allocated":22503424,"data_stored":21305040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390317,"num_objects":-2,"num_object_clones":0,"num_object_copies":-6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":90,"num_read_kb":99,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006223"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795920+0000","last_change":"2024-09-12T17:11:04.687200+0000","last_active":"2024-09-12T17:11:43.795920+0000","last_peered":"2024-09-12T17:11:43.795920+0000","last_clean":"2024-09-12T17:11:43.795920+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:11:43.795920+0000","last_undegraded":"2024-09-12T17:11:43.795920+0000","last_fullsized":"2024-09-12T17:11:43.795920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:17.379528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'11","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.875621+0000","last_change":"2024-09-12T17:11:06.702423+0000","last_active":"2024-09-12T17:14:19.875621+0000","last_peered":"2024-09-12T17:14:19.875621+0000","last_clean":"2024-09-12T17:14:19.875621+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:14:19.875621+0000","last_undegraded":"2024-09-12T17:14:19.875621+0000","last_fullsized":"2024-09-12T17:14:19.875621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:45.099418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803085+0000","last_change":"2024-09-12T17:11:04.679163+0000","last_active":"2024-09-12T17:11:43.803085+0000","last_peered":"2024-09-12T17:11:43.803085+0000","last_clean":"2024-09-12T17:11:43.803085+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:11:43.803085+0000","last_undegraded":"2024-09-12T17:11:43.803085+0000","last_fullsized":"2024-09-12T17:11:43.803085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:05.288043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255203+0000","last_change":"2024-09-12T17:11:04.706028+0000","last_active":"2024-09-12T17:11:49.255203+0000","last_peered":"2024-09-12T17:11:49.255203+0000","last_clean":"2024-09-12T17:11:49.255203+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:11:49.255203+0000","last_undegraded":"2024-09-12T17:11:49.255203+0000","last_fullsized":"2024-09-12T17:11:49.255203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:14.130896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794976+0000","last_change":"2024-09-12T17:11:04.672236+0000","last_active":"2024-09-12T17:11:43.794976+0000","last_peered":"2024-09-12T17:11:43.794976+0000","last_clean":"2024-09-12T17:11:43.794976+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:11:43.794976+0000","last_undegraded":"2024-09-12T17:11:43.794976+0000","last_fullsized":"2024-09-12T17:11:43.794976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:53.845369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:47.737476+0000","last_change":"2024-09-12T17:11:43.812377+0000","last_active":"2024-09-12T17:11:47.737476+0000","last_peered":"2024-09-12T17:11:47.737476+0000","last_clean":"2024-09-12T17:11:47.737476+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:11:47.737476+0000","last_undegraded":"2024-09-12T17:11:47.737476+0000","last_fullsized":"2024-09-12T17:11:47.737476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:08.964697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.665616+0000","last_change":"2024-09-12T17:11:04.699008+0000","last_active":"2024-09-12T17:13:18.665616+0000","last_peered":"2024-09-12T17:13:18.665616+0000","last_clean":"2024-09-12T17:13:18.665616+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:13:18.665616+0000","last_undegraded":"2024-09-12T17:13:18.665616+0000","last_fullsized":"2024-09-12T17:13:18.665616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:36.274188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.345961+0000","last_change":"2024-09-12T17:11:06.698107+0000","last_active":"2024-09-12T17:14:19.345961+0000","last_peered":"2024-09-12T17:14:19.345961+0000","last_clean":"2024-09-12T17:14:19.345961+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:14:19.345961+0000","last_undegraded":"2024-09-12T17:14:19.345961+0000","last_fullsized":"2024-09-12T17:14:19.345961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:26:40.502410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.652066+0000","last_change":"2024-09-12T17:11:04.670384+0000","last_active":"2024-09-12T17:13:14.652066+0000","last_peered":"2024-09-12T17:13:14.652066+0000","last_clean":"2024-09-12T17:13:14.652066+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:13:14.652066+0000","last_undegraded":"2024-09-12T17:13:14.652066+0000","last_fullsized":"2024-09-12T17:13:14.652066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:45.776683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789877+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.789877+0000","last_peered":"2024-09-12T17:14:19.789877+0000","last_clean":"2024-09-12T17:14:19.789877+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.789877+0000","last_undegraded":"2024-09-12T17:14:19.789877+0000","last_fullsized":"2024-09-12T17:14:19.789877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:24.771164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.951750+0000","last_change":"2024-09-12T17:11:04.695318+0000","last_active":"2024-09-12T17:11:49.951750+0000","last_peered":"2024-09-12T17:11:49.951750+0000","last_clean":"2024-09-12T17:11:49.951750+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:11:49.951750+0000","last_undegraded":"2024-09-12T17:11:49.951750+0000","last_fullsized":"2024-09-12T17:11:49.951750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.828581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492276+0000","last_change":"2024-09-12T17:11:06.694679+0000","last_active":"2024-09-12T17:14:19.492276+0000","last_peered":"2024-09-12T17:14:19.492276+0000","last_clean":"2024-09-12T17:14:19.492276+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:14:19.492276+0000","last_undegraded":"2024-09-12T17:14:19.492276+0000","last_fullsized":"2024-09-12T17:14:19.492276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.652480+0000","last_change":"2024-09-12T17:11:04.675982+0000","last_active":"2024-09-12T17:14:19.652480+0000","last_peered":"2024-09-12T17:14:19.652480+0000","last_clean":"2024-09-12T17:14:19.652480+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:14:19.652480+0000","last_undegraded":"2024-09-12T17:14:19.652480+0000","last_fullsized":"2024-09-12T17:14:19.652480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:46.947849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.714086+0000","last_change":"2024-09-12T17:11:06.700269+0000","last_active":"2024-09-12T17:13:18.714086+0000","last_peered":"2024-09-12T17:13:18.714086+0000","last_clean":"2024-09-12T17:13:18.714086+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:13:18.714086+0000","last_undegraded":"2024-09-12T17:13:18.714086+0000","last_fullsized":"2024-09-12T17:13:18.714086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.761569+0000","last_change":"2024-09-12T17:11:04.678371+0000","last_active":"2024-09-12T17:13:29.761569+0000","last_peered":"2024-09-12T17:13:29.761569+0000","last_clean":"2024-09-12T17:13:29.761569+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:13:29.761569+0000","last_undegraded":"2024-09-12T17:13:29.761569+0000","last_fullsized":"2024-09-12T17:13:29.761569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:06.727515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491645+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:14:19.491645+0000","last_peered":"2024-09-12T17:14:19.491645+0000","last_clean":"2024-09-12T17:14:19.491645+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:14:19.491645+0000","last_undegraded":"2024-09-12T17:14:19.491645+0000","last_fullsized":"2024-09-12T17:14:19.491645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:06.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.261458+0000","last_change":"2024-09-12T17:11:04.700050+0000","last_active":"2024-09-12T17:14:19.261458+0000","last_peered":"2024-09-12T17:14:19.261458+0000","last_clean":"2024-09-12T17:14:19.261458+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:14:19.261458+0000","last_undegraded":"2024-09-12T17:14:19.261458+0000","last_fullsized":"2024-09-12T17:14:19.261458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:44.289638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699394+0000","last_change":"2024-09-12T17:11:06.702528+0000","last_active":"2024-09-12T17:14:19.699394+0000","last_peered":"2024-09-12T17:14:19.699394+0000","last_clean":"2024-09-12T17:14:19.699394+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:14:19.699394+0000","last_undegraded":"2024-09-12T17:14:19.699394+0000","last_fullsized":"2024-09-12T17:14:19.699394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:53.004454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.669138+0000","last_change":"2024-09-12T17:11:04.695415+0000","last_active":"2024-09-12T17:14:19.669138+0000","last_peered":"2024-09-12T17:14:19.669138+0000","last_clean":"2024-09-12T17:14:19.669138+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:14:19.669138+0000","last_undegraded":"2024-09-12T17:14:19.669138+0000","last_fullsized":"2024-09-12T17:14:19.669138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:47.276206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699210+0000","last_change":"2024-09-12T17:11:06.702654+0000","last_active":"2024-09-12T17:14:19.699210+0000","last_peered":"2024-09-12T17:14:19.699210+0000","last_clean":"2024-09-12T17:14:19.699210+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.699210+0000","last_undegraded":"2024-09-12T17:14:19.699210+0000","last_fullsized":"2024-09-12T17:14:19.699210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.299767+0000","last_change":"2024-09-12T17:11:04.669648+0000","last_active":"2024-09-12T17:14:19.299767+0000","last_peered":"2024-09-12T17:14:19.299767+0000","last_clean":"2024-09-12T17:14:19.299767+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:14:19.299767+0000","last_undegraded":"2024-09-12T17:14:19.299767+0000","last_fullsized":"2024-09-12T17:14:19.299767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:21.150176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699219+0000","last_change":"2024-09-12T17:11:06.700166+0000","last_active":"2024-09-12T17:14:19.699219+0000","last_peered":"2024-09-12T17:14:19.699219+0000","last_clean":"2024-09-12T17:14:19.699219+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:14:19.699219+0000","last_undegraded":"2024-09-12T17:14:19.699219+0000","last_fullsized":"2024-09-12T17:14:19.699219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.254780+0000","last_change":"2024-09-12T17:11:04.684719+0000","last_active":"2024-09-12T17:11:49.254780+0000","last_peered":"2024-09-12T17:11:49.254780+0000","last_clean":"2024-09-12T17:11:49.254780+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:11:49.254780+0000","last_undegraded":"2024-09-12T17:11:49.254780+0000","last_fullsized":"2024-09-12T17:11:49.254780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:35.602622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.351380+0000","last_change":"2024-09-12T17:11:06.702307+0000","last_active":"2024-09-12T17:14:19.351380+0000","last_peered":"2024-09-12T17:14:19.351380+0000","last_clean":"2024-09-12T17:14:19.351380+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.351380+0000","last_undegraded":"2024-09-12T17:14:19.351380+0000","last_fullsized":"2024-09-12T17:14:19.351380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:15.153934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801460+0000","last_change":"2024-09-12T17:11:04.693521+0000","last_active":"2024-09-12T17:11:43.801460+0000","last_peered":"2024-09-12T17:11:43.801460+0000","last_clean":"2024-09-12T17:11:43.801460+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:11:43.801460+0000","last_undegraded":"2024-09-12T17:11:43.801460+0000","last_fullsized":"2024-09-12T17:11:43.801460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.412209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491966+0000","last_change":"2024-09-12T17:11:06.695461+0000","last_active":"2024-09-12T17:14:19.491966+0000","last_peered":"2024-09-12T17:14:19.491966+0000","last_clean":"2024-09-12T17:14:19.491966+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:14:19.491966+0000","last_undegraded":"2024-09-12T17:14:19.491966+0000","last_fullsized":"2024-09-12T17:14:19.491966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:05.772132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803636+0000","last_change":"2024-09-12T17:11:04.703079+0000","last_active":"2024-09-12T17:11:43.803636+0000","last_peered":"2024-09-12T17:11:43.803636+0000","last_clean":"2024-09-12T17:11:43.803636+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:11:43.803636+0000","last_undegraded":"2024-09-12T17:11:43.803636+0000","last_fullsized":"2024-09-12T17:11:43.803636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:07.714503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.782694+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:13:16.782694+0000","last_peered":"2024-09-12T17:13:16.782694+0000","last_clean":"2024-09-12T17:13:16.782694+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:13:16.782694+0000","last_undegraded":"2024-09-12T17:13:16.782694+0000","last_fullsized":"2024-09-12T17:13:16.782694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.990500+0000","last_change":"2024-09-12T17:11:06.695753+0000","last_active":"2024-09-12T17:11:49.990500+0000","last_peered":"2024-09-12T17:11:49.990500+0000","last_clean":"2024-09-12T17:11:49.990500+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:11:49.990500+0000","last_undegraded":"2024-09-12T17:11:49.990500+0000","last_fullsized":"2024-09-12T17:11:49.990500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:25.077773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789387+0000","last_change":"2024-09-12T17:11:04.664341+0000","last_active":"2024-09-12T17:11:43.789387+0000","last_peered":"2024-09-12T17:11:43.789387+0000","last_clean":"2024-09-12T17:11:43.789387+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:11:43.789387+0000","last_undegraded":"2024-09-12T17:11:43.789387+0000","last_fullsized":"2024-09-12T17:11:43.789387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.127793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798199+0000","last_change":"2024-09-12T17:11:08.714597+0000","last_active":"2024-09-12T17:11:43.798199+0000","last_peered":"2024-09-12T17:11:43.798199+0000","last_clean":"2024-09-12T17:11:43.798199+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:11:43.798199+0000","last_undegraded":"2024-09-12T17:11:43.798199+0000","last_fullsized":"2024-09-12T17:11:43.798199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:35.426981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788656+0000","last_change":"2024-09-12T17:11:06.695233+0000","last_active":"2024-09-12T17:14:19.788656+0000","last_peered":"2024-09-12T17:14:19.788656+0000","last_clean":"2024-09-12T17:14:19.788656+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:14:19.788656+0000","last_undegraded":"2024-09-12T17:14:19.788656+0000","last_fullsized":"2024-09-12T17:14:19.788656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:07.207850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798159+0000","last_change":"2024-09-12T17:11:04.699166+0000","last_active":"2024-09-12T17:11:43.798159+0000","last_peered":"2024-09-12T17:11:43.798159+0000","last_clean":"2024-09-12T17:11:43.798159+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:11:43.798159+0000","last_undegraded":"2024-09-12T17:11:43.798159+0000","last_fullsized":"2024-09-12T17:11:43.798159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:45.706422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803868+0000","last_change":"2024-09-12T17:11:08.703714+0000","last_active":"2024-09-12T17:11:43.803868+0000","last_peered":"2024-09-12T17:11:43.803868+0000","last_clean":"2024-09-12T17:11:43.803868+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:11:43.803868+0000","last_undegraded":"2024-09-12T17:11:43.803868+0000","last_fullsized":"2024-09-12T17:11:43.803868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:58.130892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":383,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956001+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:18.956001+0000","last_peered":"2024-09-12T17:14:18.956001+0000","last_clean":"2024-09-12T17:14:18.956001+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:18.956001+0000","last_undegraded":"2024-09-12T17:14:18.956001+0000","last_fullsized":"2024-09-12T17:14:18.956001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856648+0000","last_change":"2024-09-12T17:11:06.709890+0000","last_active":"2024-09-12T17:14:19.856648+0000","last_peered":"2024-09-12T17:14:19.856648+0000","last_clean":"2024-09-12T17:14:19.856648+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:14:19.856648+0000","last_undegraded":"2024-09-12T17:14:19.856648+0000","last_fullsized":"2024-09-12T17:14:19.856648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:54.843124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759626+0000","last_change":"2024-09-12T17:11:04.665928+0000","last_active":"2024-09-12T17:13:24.759626+0000","last_peered":"2024-09-12T17:13:24.759626+0000","last_clean":"2024-09-12T17:13:24.759626+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:13:24.759626+0000","last_undegraded":"2024-09-12T17:13:24.759626+0000","last_fullsized":"2024-09-12T17:13:24.759626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:39.275039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.076109+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:14:51.076109+0000","last_peered":"2024-09-12T17:14:51.076109+0000","last_clean":"2024-09-12T17:14:51.076109+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.076109+0000","last_undegraded":"2024-09-12T17:14:51.076109+0000","last_fullsized":"2024-09-12T17:14:51.076109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.869172+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:50.869172+0000","last_peered":"2024-09-12T17:14:50.869172+0000","last_clean":"2024-09-12T17:14:50.869172+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:50.869172+0000","last_undegraded":"2024-09-12T17:14:50.869172+0000","last_fullsized":"2024-09-12T17:14:50.869172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856733+0000","last_change":"2024-09-12T17:11:06.689516+0000","last_active":"2024-09-12T17:14:19.856733+0000","last_peered":"2024-09-12T17:14:19.856733+0000","last_clean":"2024-09-12T17:14:19.856733+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:14:19.856733+0000","last_undegraded":"2024-09-12T17:14:19.856733+0000","last_fullsized":"2024-09-12T17:14:19.856733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:22.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.707062+0000","last_change":"2024-09-12T17:11:04.670479+0000","last_active":"2024-09-12T17:11:50.707062+0000","last_peered":"2024-09-12T17:11:50.707062+0000","last_clean":"2024-09-12T17:11:50.707062+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:11:50.707062+0000","last_undegraded":"2024-09-12T17:11:50.707062+0000","last_fullsized":"2024-09-12T17:11:50.707062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:13.055726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801252+0000","last_change":"2024-09-12T17:11:08.711989+0000","last_active":"2024-09-12T17:11:43.801252+0000","last_peered":"2024-09-12T17:11:43.801252+0000","last_clean":"2024-09-12T17:11:43.801252+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:11:43.801252+0000","last_undegraded":"2024-09-12T17:11:43.801252+0000","last_fullsized":"2024-09-12T17:11:43.801252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:37.301429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.151553+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:14:51.151553+0000","last_peered":"2024-09-12T17:14:51.151553+0000","last_clean":"2024-09-12T17:14:51.151553+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:14:51.151553+0000","last_undegraded":"2024-09-12T17:14:51.151553+0000","last_fullsized":"2024-09-12T17:14:51.151553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:45.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.700337+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:12:33.700337+0000","last_peered":"2024-09-12T17:12:33.700337+0000","last_clean":"2024-09-12T17:12:33.700337+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:12:33.700337+0000","last_undegraded":"2024-09-12T17:12:33.700337+0000","last_fullsized":"2024-09-12T17:12:33.700337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:14.320323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'7","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758366+0000","last_change":"2024-09-12T17:11:06.691496+0000","last_active":"2024-09-12T17:13:19.758366+0000","last_peered":"2024-09-12T17:13:19.758366+0000","last_clean":"2024-09-12T17:13:19.758366+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:13:19.758366+0000","last_undegraded":"2024-09-12T17:13:19.758366+0000","last_fullsized":"2024-09-12T17:13:19.758366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:04.589070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.844389+0000","last_change":"2024-09-12T17:11:04.674290+0000","last_active":"2024-09-12T17:14:19.844389+0000","last_peered":"2024-09-12T17:14:19.844389+0000","last_clean":"2024-09-12T17:14:19.844389+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:19.844389+0000","last_undegraded":"2024-09-12T17:14:19.844389+0000","last_fullsized":"2024-09-12T17:14:19.844389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:49.305270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797606+0000","last_change":"2024-09-12T17:11:08.703591+0000","last_active":"2024-09-12T17:11:43.797606+0000","last_peered":"2024-09-12T17:11:43.797606+0000","last_clean":"2024-09-12T17:11:43.797606+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:11:43.797606+0000","last_undegraded":"2024-09-12T17:11:43.797606+0000","last_fullsized":"2024-09-12T17:11:43.797606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:30.362634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'30","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.761879+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:13:16.761879+0000","last_peered":"2024-09-12T17:13:16.761879+0000","last_clean":"2024-09-12T17:13:16.761879+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:13:16.761879+0000","last_undegraded":"2024-09-12T17:13:16.761879+0000","last_fullsized":"2024-09-12T17:13:16.761879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797367+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:11:43.797367+0000","last_peered":"2024-09-12T17:11:43.797367+0000","last_clean":"2024-09-12T17:11:43.797367+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:11:43.797367+0000","last_undegraded":"2024-09-12T17:11:43.797367+0000","last_fullsized":"2024-09-12T17:11:43.797367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.311032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:27.988084+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:12:27.988084+0000","last_peered":"2024-09-12T17:12:27.988084+0000","last_clean":"2024-09-12T17:12:27.988084+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:12:27.988084+0000","last_undegraded":"2024-09-12T17:12:27.988084+0000","last_fullsized":"2024-09-12T17:12:27.988084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:12.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699464+0000","last_change":"2024-09-12T17:11:06.696422+0000","last_active":"2024-09-12T17:14:19.699464+0000","last_peered":"2024-09-12T17:14:19.699464+0000","last_clean":"2024-09-12T17:14:19.699464+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:14:19.699464+0000","last_undegraded":"2024-09-12T17:14:19.699464+0000","last_fullsized":"2024-09-12T17:14:19.699464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:01.613538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.666958+0000","last_change":"2024-09-12T17:11:04.702087+0000","last_active":"2024-09-12T17:12:33.666958+0000","last_peered":"2024-09-12T17:12:33.666958+0000","last_clean":"2024-09-12T17:12:33.666958+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:12:33.666958+0000","last_undegraded":"2024-09-12T17:12:33.666958+0000","last_fullsized":"2024-09-12T17:12:33.666958+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:25.445318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802068+0000","last_change":"2024-09-12T17:11:08.703554+0000","last_active":"2024-09-12T17:11:43.802068+0000","last_peered":"2024-09-12T17:11:43.802068+0000","last_clean":"2024-09-12T17:11:43.802068+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:11:43.802068+0000","last_undegraded":"2024-09-12T17:11:43.802068+0000","last_fullsized":"2024-09-12T17:11:43.802068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:43.928545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.790598+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:13:16.790598+0000","last_peered":"2024-09-12T17:13:16.790598+0000","last_clean":"2024-09-12T17:13:16.790598+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:13:16.790598+0000","last_undegraded":"2024-09-12T17:13:16.790598+0000","last_fullsized":"2024-09-12T17:13:16.790598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:15.747423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.872194+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:50.872194+0000","last_peered":"2024-09-12T17:14:50.872194+0000","last_clean":"2024-09-12T17:14:50.872194+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:50.872194+0000","last_undegraded":"2024-09-12T17:14:50.872194+0000","last_fullsized":"2024-09-12T17:14:50.872194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:58.989870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802324+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:11:43.802324+0000","last_peered":"2024-09-12T17:11:43.802324+0000","last_clean":"2024-09-12T17:11:43.802324+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:11:43.802324+0000","last_undegraded":"2024-09-12T17:11:43.802324+0000","last_fullsized":"2024-09-12T17:11:43.802324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:27.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874529+0000","last_change":"2024-09-12T17:11:06.692668+0000","last_active":"2024-09-12T17:14:19.874529+0000","last_peered":"2024-09-12T17:14:19.874529+0000","last_clean":"2024-09-12T17:14:19.874529+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:14:19.874529+0000","last_undegraded":"2024-09-12T17:14:19.874529+0000","last_fullsized":"2024-09-12T17:14:19.874529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804443+0000","last_change":"2024-09-12T17:11:04.705352+0000","last_active":"2024-09-12T17:11:43.804443+0000","last_peered":"2024-09-12T17:11:43.804443+0000","last_clean":"2024-09-12T17:11:43.804443+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:11:43.804443+0000","last_undegraded":"2024-09-12T17:11:43.804443+0000","last_fullsized":"2024-09-12T17:11:43.804443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:32.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798335+0000","last_change":"2024-09-12T17:11:08.718239+0000","last_active":"2024-09-12T17:11:43.798335+0000","last_peered":"2024-09-12T17:11:43.798335+0000","last_clean":"2024-09-12T17:11:43.798335+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:11:43.798335+0000","last_undegraded":"2024-09-12T17:11:43.798335+0000","last_fullsized":"2024-09-12T17:11:43.798335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:05.261510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'55","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.792763+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:13:16.792763+0000","last_peered":"2024-09-12T17:13:16.792763+0000","last_clean":"2024-09-12T17:13:16.792763+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:13:16.792763+0000","last_undegraded":"2024-09-12T17:13:16.792763+0000","last_fullsized":"2024-09-12T17:13:16.792763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:08.295074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797078+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:11:43.797078+0000","last_peered":"2024-09-12T17:11:43.797078+0000","last_clean":"2024-09-12T17:11:43.797078+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:11:43.797078+0000","last_undegraded":"2024-09-12T17:11:43.797078+0000","last_fullsized":"2024-09-12T17:11:43.797078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:12.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.020204+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.020204+0000","last_peered":"2024-09-12T17:14:20.020204+0000","last_clean":"2024-09-12T17:14:20.020204+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.020204+0000","last_undegraded":"2024-09-12T17:14:20.020204+0000","last_fullsized":"2024-09-12T17:14:20.020204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:39.726074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.347636+0000","last_change":"2024-09-12T17:11:06.707317+0000","last_active":"2024-09-12T17:14:19.347636+0000","last_peered":"2024-09-12T17:14:19.347636+0000","last_clean":"2024-09-12T17:14:19.347636+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:14:19.347636+0000","last_undegraded":"2024-09-12T17:14:19.347636+0000","last_fullsized":"2024-09-12T17:14:19.347636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:08.491395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798991+0000","last_change":"2024-09-12T17:11:04.681916+0000","last_active":"2024-09-12T17:11:43.798991+0000","last_peered":"2024-09-12T17:11:43.798991+0000","last_clean":"2024-09-12T17:11:43.798991+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:11:43.798991+0000","last_undegraded":"2024-09-12T17:11:43.798991+0000","last_fullsized":"2024-09-12T17:11:43.798991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:47.532391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793223+0000","last_change":"2024-09-12T17:11:08.714019+0000","last_active":"2024-09-12T17:11:43.793223+0000","last_peered":"2024-09-12T17:11:43.793223+0000","last_clean":"2024-09-12T17:11:43.793223+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:11:43.793223+0000","last_undegraded":"2024-09-12T17:11:43.793223+0000","last_fullsized":"2024-09-12T17:11:43.793223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:48.242476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'33","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.760164+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:13:24.760164+0000","last_peered":"2024-09-12T17:13:24.760164+0000","last_clean":"2024-09-12T17:13:24.760164+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:13:24.760164+0000","last_undegraded":"2024-09-12T17:13:24.760164+0000","last_fullsized":"2024-09-12T17:13:24.760164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.382092+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:13:16.382092+0000","last_peered":"2024-09-12T17:13:16.382092+0000","last_clean":"2024-09-12T17:13:16.382092+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:13:16.382092+0000","last_undegraded":"2024-09-12T17:13:16.382092+0000","last_fullsized":"2024-09-12T17:13:16.382092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:53.758943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856766+0000","last_change":"2024-09-12T17:11:06.709152+0000","last_active":"2024-09-12T17:14:19.856766+0000","last_peered":"2024-09-12T17:14:19.856766+0000","last_clean":"2024-09-12T17:14:19.856766+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:14:19.856766+0000","last_undegraded":"2024-09-12T17:14:19.856766+0000","last_fullsized":"2024-09-12T17:14:19.856766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.578776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802317+0000","last_change":"2024-09-12T17:11:04.693394+0000","last_active":"2024-09-12T17:11:43.802317+0000","last_peered":"2024-09-12T17:11:43.802317+0000","last_clean":"2024-09-12T17:11:43.802317+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:11:43.802317+0000","last_undegraded":"2024-09-12T17:11:43.802317+0000","last_fullsized":"2024-09-12T17:11:43.802317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:25.577954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798665+0000","last_change":"2024-09-12T17:11:08.717768+0000","last_active":"2024-09-12T17:11:43.798665+0000","last_peered":"2024-09-12T17:11:43.798665+0000","last_clean":"2024-09-12T17:11:43.798665+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:11:43.798665+0000","last_undegraded":"2024-09-12T17:11:43.798665+0000","last_fullsized":"2024-09-12T17:11:43.798665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:07.209528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'41","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.989960+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:14:50.989960+0000","last_peered":"2024-09-12T17:14:50.989960+0000","last_clean":"2024-09-12T17:14:50.989960+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:14:50.989960+0000","last_undegraded":"2024-09-12T17:14:50.989960+0000","last_fullsized":"2024-09-12T17:14:50.989960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861779+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:50.861779+0000","last_peered":"2024-09-12T17:14:50.861779+0000","last_clean":"2024-09-12T17:14:50.861779+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:50.861779+0000","last_undegraded":"2024-09-12T17:14:50.861779+0000","last_fullsized":"2024-09-12T17:14:50.861779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759536+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:13:18.759536+0000","last_peered":"2024-09-12T17:13:18.759536+0000","last_clean":"2024-09-12T17:13:18.759536+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:13:18.759536+0000","last_undegraded":"2024-09-12T17:13:18.759536+0000","last_fullsized":"2024-09-12T17:13:18.759536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.396693+0000","last_change":"2024-09-12T17:11:06.700331+0000","last_active":"2024-09-12T17:11:50.396693+0000","last_peered":"2024-09-12T17:11:50.396693+0000","last_clean":"2024-09-12T17:11:50.396693+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:11:50.396693+0000","last_undegraded":"2024-09-12T17:11:50.396693+0000","last_fullsized":"2024-09-12T17:11:50.396693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255080+0000","last_change":"2024-09-12T17:11:04.703034+0000","last_active":"2024-09-12T17:11:49.255080+0000","last_peered":"2024-09-12T17:11:49.255080+0000","last_clean":"2024-09-12T17:11:49.255080+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:11:49.255080+0000","last_undegraded":"2024-09-12T17:11:49.255080+0000","last_fullsized":"2024-09-12T17:11:49.255080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:43.087208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":426,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225726+0000","last_change":"2024-09-12T17:11:43.830390+0000","last_active":"2024-09-12T17:13:18.225726+0000","last_peered":"2024-09-12T17:13:18.225726+0000","last_clean":"2024-09-12T17:13:18.225726+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:13:18.225726+0000","last_undegraded":"2024-09-12T17:13:18.225726+0000","last_fullsized":"2024-09-12T17:13:18.225726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.971718+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:19.971718+0000","last_peered":"2024-09-12T17:14:19.971718+0000","last_clean":"2024-09-12T17:14:19.971718+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:19.971718+0000","last_undegraded":"2024-09-12T17:14:19.971718+0000","last_fullsized":"2024-09-12T17:14:19.971718+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.965720+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:19.965720+0000","last_peered":"2024-09-12T17:14:19.965720+0000","last_clean":"2024-09-12T17:14:19.965720+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:19.965720+0000","last_undegraded":"2024-09-12T17:14:19.965720+0000","last_fullsized":"2024-09-12T17:14:19.965720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492433+0000","last_change":"2024-09-12T17:11:06.707589+0000","last_active":"2024-09-12T17:14:19.492433+0000","last_peered":"2024-09-12T17:14:19.492433+0000","last_clean":"2024-09-12T17:14:19.492433+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:14:19.492433+0000","last_undegraded":"2024-09-12T17:14:19.492433+0000","last_fullsized":"2024-09-12T17:14:19.492433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:48.926839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255268+0000","last_change":"2024-09-12T17:11:04.703521+0000","last_active":"2024-09-12T17:11:49.255268+0000","last_peered":"2024-09-12T17:11:49.255268+0000","last_clean":"2024-09-12T17:11:49.255268+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:11:49.255268+0000","last_undegraded":"2024-09-12T17:11:49.255268+0000","last_fullsized":"2024-09-12T17:11:49.255268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:58.014451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'39","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.784611+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:13:16.784611+0000","last_peered":"2024-09-12T17:13:16.784611+0000","last_clean":"2024-09-12T17:13:16.784611+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:13:16.784611+0000","last_undegraded":"2024-09-12T17:13:16.784611+0000","last_fullsized":"2024-09-12T17:13:16.784611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.928411+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:19.928411+0000","last_peered":"2024-09-12T17:14:19.928411+0000","last_clean":"2024-09-12T17:14:19.928411+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:19.928411+0000","last_undegraded":"2024-09-12T17:14:19.928411+0000","last_fullsized":"2024-09-12T17:14:19.928411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669049+0000","last_change":"2024-09-12T17:11:06.709109+0000","last_active":"2024-09-12T17:13:14.669049+0000","last_peered":"2024-09-12T17:13:14.669049+0000","last_clean":"2024-09-12T17:13:14.669049+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:13:14.669049+0000","last_undegraded":"2024-09-12T17:13:14.669049+0000","last_fullsized":"2024-09-12T17:13:14.669049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:51.560480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'72","reported_seq":147,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:49.751999+0000","last_change":"2024-09-12T17:10:50.638761+0000","last_active":"2024-09-12T17:12:49.751999+0000","last_peered":"2024-09-12T17:12:49.751999+0000","last_clean":"2024-09-12T17:12:49.751999+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:12:49.751999+0000","last_undegraded":"2024-09-12T17:12:49.751999+0000","last_fullsized":"2024-09-12T17:12:49.751999+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:48.732218+0000","last_clean_scrub_stamp":"2024-09-12T17:10:48.732218+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:25:24.655017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"15'1","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804184+0000","last_change":"2024-09-12T17:10:56.779569+0000","last_active":"2024-09-12T17:11:43.804184+0000","last_peered":"2024-09-12T17:11:43.804184+0000","last_clean":"2024-09-12T17:11:43.804184+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:11:43.804184+0000","last_undegraded":"2024-09-12T17:11:43.804184+0000","last_fullsized":"2024-09-12T17:11:43.804184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:33.752187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800617+0000","last_change":"2024-09-12T17:11:04.703751+0000","last_active":"2024-09-12T17:11:43.800617+0000","last_peered":"2024-09-12T17:11:43.800617+0000","last_clean":"2024-09-12T17:11:43.800617+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:11:43.800617+0000","last_undegraded":"2024-09-12T17:11:43.800617+0000","last_fullsized":"2024-09-12T17:11:43.800617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:39.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818268+0000","last_change":"2024-09-12T17:11:43.816300+0000","last_active":"2024-09-12T17:11:43.818268+0000","last_peered":"2024-09-12T17:11:43.818268+0000","last_clean":"2024-09-12T17:11:43.818268+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:11:43.818268+0000","last_undegraded":"2024-09-12T17:11:43.818268+0000","last_fullsized":"2024-09-12T17:11:43.818268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:37.695610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'76","reported_seq":146,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.800681+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:13:16.800681+0000","last_peered":"2024-09-12T17:13:16.800681+0000","last_clean":"2024-09-12T17:13:16.800681+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:13:16.800681+0000","last_undegraded":"2024-09-12T17:13:16.800681+0000","last_fullsized":"2024-09-12T17:13:16.800681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:40.493734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802475+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:11:43.802475+0000","last_peered":"2024-09-12T17:11:43.802475+0000","last_clean":"2024-09-12T17:11:43.802475+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:11:43.802475+0000","last_undegraded":"2024-09-12T17:11:43.802475+0000","last_fullsized":"2024-09-12T17:11:43.802475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:25.075965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.804563+0000","last_change":"2024-09-12T17:11:06.693422+0000","last_active":"2024-09-12T17:14:19.804563+0000","last_peered":"2024-09-12T17:14:19.804563+0000","last_clean":"2024-09-12T17:14:19.804563+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:14:19.804563+0000","last_undegraded":"2024-09-12T17:14:19.804563+0000","last_fullsized":"2024-09-12T17:14:19.804563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.467976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799232+0000","last_change":"2024-09-12T17:10:56.778249+0000","last_active":"2024-09-12T17:11:43.799232+0000","last_peered":"2024-09-12T17:11:43.799232+0000","last_clean":"2024-09-12T17:11:43.799232+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:11:43.799232+0000","last_undegraded":"2024-09-12T17:11:43.799232+0000","last_fullsized":"2024-09-12T17:11:43.799232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:16.664853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796953+0000","last_change":"2024-09-12T17:11:04.677283+0000","last_active":"2024-09-12T17:11:43.796953+0000","last_peered":"2024-09-12T17:11:43.796953+0000","last_clean":"2024-09-12T17:11:43.796953+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:11:43.796953+0000","last_undegraded":"2024-09-12T17:11:43.796953+0000","last_fullsized":"2024-09-12T17:11:43.796953+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:28.246536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819515+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:11:43.819515+0000","last_peered":"2024-09-12T17:11:43.819515+0000","last_clean":"2024-09-12T17:11:43.819515+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:11:43.819515+0000","last_undegraded":"2024-09-12T17:11:43.819515+0000","last_fullsized":"2024-09-12T17:11:43.819515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.790398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'275","reported_seq":480,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.723137+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:19.723137+0000","last_peered":"2024-09-12T17:14:19.723137+0000","last_clean":"2024-09-12T17:14:19.723137+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:19.723137+0000","last_undegraded":"2024-09-12T17:14:19.723137+0000","last_fullsized":"2024-09-12T17:14:19.723137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:01.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805519+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:11:43.805519+0000","last_peered":"2024-09-12T17:11:43.805519+0000","last_clean":"2024-09-12T17:11:43.805519+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:11:43.805519+0000","last_undegraded":"2024-09-12T17:11:43.805519+0000","last_fullsized":"2024-09-12T17:11:43.805519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:45.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.692612+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:12:33.692612+0000","last_peered":"2024-09-12T17:12:33.692612+0000","last_clean":"2024-09-12T17:12:33.692612+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:12:33.692612+0000","last_undegraded":"2024-09-12T17:12:33.692612+0000","last_fullsized":"2024-09-12T17:12:33.692612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.700288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'25","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.876594+0000","last_change":"2024-09-12T17:11:06.700482+0000","last_active":"2024-09-12T17:14:19.876594+0000","last_peered":"2024-09-12T17:14:19.876594+0000","last_clean":"2024-09-12T17:14:19.876594+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:14:19.876594+0000","last_undegraded":"2024-09-12T17:14:19.876594+0000","last_fullsized":"2024-09-12T17:14:19.876594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:53.954037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791793+0000","last_change":"2024-09-12T17:10:57.775122+0000","last_active":"2024-09-12T17:11:43.791793+0000","last_peered":"2024-09-12T17:11:43.791793+0000","last_clean":"2024-09-12T17:11:43.791793+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:11:43.791793+0000","last_undegraded":"2024-09-12T17:11:43.791793+0000","last_fullsized":"2024-09-12T17:11:43.791793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:01.294051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.978777+0000","last_change":"2024-09-12T17:11:04.677831+0000","last_active":"2024-09-12T17:12:33.978777+0000","last_peered":"2024-09-12T17:12:33.978777+0000","last_clean":"2024-09-12T17:12:33.978777+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:12:33.978777+0000","last_undegraded":"2024-09-12T17:12:33.978777+0000","last_fullsized":"2024-09-12T17:12:33.978777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:27.505466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793377+0000","last_change":"2024-09-12T17:11:08.712933+0000","last_active":"2024-09-12T17:11:43.793377+0000","last_peered":"2024-09-12T17:11:43.793377+0000","last_clean":"2024-09-12T17:11:43.793377+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:11:43.793377+0000","last_undegraded":"2024-09-12T17:11:43.793377+0000","last_fullsized":"2024-09-12T17:11:43.793377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:59.902245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956445+0000","last_change":"2024-09-12T17:11:10.735305+0000","last_active":"2024-09-12T17:14:18.956445+0000","last_peered":"2024-09-12T17:14:18.956445+0000","last_clean":"2024-09-12T17:14:18.956445+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:14:18.956445+0000","last_undegraded":"2024-09-12T17:14:18.956445+0000","last_fullsized":"2024-09-12T17:14:18.956445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:41.801702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799591+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:11:43.799591+0000","last_peered":"2024-09-12T17:11:43.799591+0000","last_clean":"2024-09-12T17:11:43.799591+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:11:43.799591+0000","last_undegraded":"2024-09-12T17:11:43.799591+0000","last_fullsized":"2024-09-12T17:11:43.799591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:20.273638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.684614+0000","last_change":"2024-09-12T17:11:06.701808+0000","last_active":"2024-09-12T17:12:33.684614+0000","last_peered":"2024-09-12T17:12:33.684614+0000","last_clean":"2024-09-12T17:12:33.684614+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:12:33.684614+0000","last_undegraded":"2024-09-12T17:12:33.684614+0000","last_fullsized":"2024-09-12T17:12:33.684614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:46.068569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"17'2","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799665+0000","last_change":"2024-09-12T17:10:56.779428+0000","last_active":"2024-09-12T17:11:43.799665+0000","last_peered":"2024-09-12T17:11:43.799665+0000","last_clean":"2024-09-12T17:11:43.799665+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.799665+0000","last_undegraded":"2024-09-12T17:11:43.799665+0000","last_fullsized":"2024-09-12T17:11:43.799665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:04.010826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791477+0000","last_change":"2024-09-12T17:11:04.674550+0000","last_active":"2024-09-12T17:11:43.791477+0000","last_peered":"2024-09-12T17:11:43.791477+0000","last_clean":"2024-09-12T17:11:43.791477+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:11:43.791477+0000","last_undegraded":"2024-09-12T17:11:43.791477+0000","last_fullsized":"2024-09-12T17:11:43.791477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:36.163666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800092+0000","last_change":"2024-09-12T17:11:08.711996+0000","last_active":"2024-09-12T17:11:43.800092+0000","last_peered":"2024-09-12T17:11:43.800092+0000","last_clean":"2024-09-12T17:11:43.800092+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:11:43.800092+0000","last_undegraded":"2024-09-12T17:11:43.800092+0000","last_fullsized":"2024-09-12T17:11:43.800092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:39.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.753060+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.753060+0000","last_peered":"2024-09-12T17:14:18.753060+0000","last_clean":"2024-09-12T17:14:18.753060+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.753060+0000","last_undegraded":"2024-09-12T17:14:18.753060+0000","last_fullsized":"2024-09-12T17:14:18.753060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:23.846254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818300+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:11:43.818300+0000","last_peered":"2024-09-12T17:11:43.818300+0000","last_clean":"2024-09-12T17:11:43.818300+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:11:43.818300+0000","last_undegraded":"2024-09-12T17:11:43.818300+0000","last_fullsized":"2024-09-12T17:11:43.818300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:33.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.354515+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:18.354515+0000","last_peered":"2024-09-12T17:13:18.354515+0000","last_clean":"2024-09-12T17:13:18.354515+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:18.354515+0000","last_undegraded":"2024-09-12T17:13:18.354515+0000","last_fullsized":"2024-09-12T17:13:18.354515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:16.583308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789879+0000","last_change":"2024-09-12T17:11:06.705536+0000","last_active":"2024-09-12T17:14:19.789879+0000","last_peered":"2024-09-12T17:14:19.789879+0000","last_clean":"2024-09-12T17:14:19.789879+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:14:19.789879+0000","last_undegraded":"2024-09-12T17:14:19.789879+0000","last_fullsized":"2024-09-12T17:14:19.789879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:27.457528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.206757+0000","last_change":"2024-09-12T17:11:04.674617+0000","last_active":"2024-09-12T17:14:19.206757+0000","last_peered":"2024-09-12T17:14:19.206757+0000","last_clean":"2024-09-12T17:14:19.206757+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:19.206757+0000","last_undegraded":"2024-09-12T17:14:19.206757+0000","last_fullsized":"2024-09-12T17:14:19.206757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:54.666558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799080+0000","last_change":"2024-09-12T17:10:56.783685+0000","last_active":"2024-09-12T17:11:43.799080+0000","last_peered":"2024-09-12T17:11:43.799080+0000","last_clean":"2024-09-12T17:11:43.799080+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:11:43.799080+0000","last_undegraded":"2024-09-12T17:11:43.799080+0000","last_fullsized":"2024-09-12T17:11:43.799080+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:38:04.535202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.064927+0000","last_change":"2024-09-12T17:11:08.714792+0000","last_active":"2024-09-12T17:14:20.064927+0000","last_peered":"2024-09-12T17:14:20.064927+0000","last_clean":"2024-09-12T17:14:20.064927+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:14:20.064927+0000","last_undegraded":"2024-09-12T17:14:20.064927+0000","last_fullsized":"2024-09-12T17:14:20.064927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:27.037237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.084647+0000","last_change":"2024-09-12T17:11:10.745089+0000","last_active":"2024-09-12T17:14:51.084647+0000","last_peered":"2024-09-12T17:14:51.084647+0000","last_clean":"2024-09-12T17:14:51.084647+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:14:51.084647+0000","last_undegraded":"2024-09-12T17:14:51.084647+0000","last_fullsized":"2024-09-12T17:14:51.084647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.460174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791955+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:11:43.791955+0000","last_peered":"2024-09-12T17:11:43.791955+0000","last_clean":"2024-09-12T17:11:43.791955+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:11:43.791955+0000","last_undegraded":"2024-09-12T17:11:43.791955+0000","last_fullsized":"2024-09-12T17:11:43.791955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.574053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807673+0000","last_change":"2024-09-12T17:11:06.705517+0000","last_active":"2024-09-12T17:11:43.807673+0000","last_peered":"2024-09-12T17:11:43.807673+0000","last_clean":"2024-09-12T17:11:43.807673+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:11:43.807673+0000","last_undegraded":"2024-09-12T17:11:43.807673+0000","last_fullsized":"2024-09-12T17:11:43.807673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:59.554886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799985+0000","last_change":"2024-09-12T17:11:04.676312+0000","last_active":"2024-09-12T17:11:43.799985+0000","last_peered":"2024-09-12T17:11:43.799985+0000","last_clean":"2024-09-12T17:11:43.799985+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:11:43.799985+0000","last_undegraded":"2024-09-12T17:11:43.799985+0000","last_fullsized":"2024-09-12T17:11:43.799985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:42.964413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809982+0000","last_change":"2024-09-12T17:10:56.780349+0000","last_active":"2024-09-12T17:11:43.809982+0000","last_peered":"2024-09-12T17:11:43.809982+0000","last_clean":"2024-09-12T17:11:43.809982+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:11:43.809982+0000","last_undegraded":"2024-09-12T17:11:43.809982+0000","last_fullsized":"2024-09-12T17:11:43.809982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:56.568735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797949+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:11:43.797949+0000","last_peered":"2024-09-12T17:11:43.797949+0000","last_clean":"2024-09-12T17:11:43.797949+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:11:43.797949+0000","last_undegraded":"2024-09-12T17:11:43.797949+0000","last_fullsized":"2024-09-12T17:11:43.797949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:09.523951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802889+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:11:43.802889+0000","last_peered":"2024-09-12T17:11:43.802889+0000","last_clean":"2024-09-12T17:11:43.802889+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:11:43.802889+0000","last_undegraded":"2024-09-12T17:11:43.802889+0000","last_fullsized":"2024-09-12T17:11:43.802889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:43.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.955798+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:18.955798+0000","last_peered":"2024-09-12T17:14:18.955798+0000","last_clean":"2024-09-12T17:14:18.955798+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:18.955798+0000","last_undegraded":"2024-09-12T17:14:18.955798+0000","last_fullsized":"2024-09-12T17:14:18.955798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:29.442661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.700276+0000","last_change":"2024-09-12T17:11:06.689832+0000","last_active":"2024-09-12T17:14:19.700276+0000","last_peered":"2024-09-12T17:14:19.700276+0000","last_clean":"2024-09-12T17:14:19.700276+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:14:19.700276+0000","last_undegraded":"2024-09-12T17:14:19.700276+0000","last_fullsized":"2024-09-12T17:14:19.700276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:07:21.208607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819353+0000","last_change":"2024-09-12T17:11:04.694780+0000","last_active":"2024-09-12T17:11:43.819353+0000","last_peered":"2024-09-12T17:11:43.819353+0000","last_clean":"2024-09-12T17:11:43.819353+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:11:43.819353+0000","last_undegraded":"2024-09-12T17:11:43.819353+0000","last_fullsized":"2024-09-12T17:11:43.819353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:35.499606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802798+0000","last_change":"2024-09-12T17:10:56.783181+0000","last_active":"2024-09-12T17:11:43.802798+0000","last_peered":"2024-09-12T17:11:43.802798+0000","last_clean":"2024-09-12T17:11:43.802798+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:11:43.802798+0000","last_undegraded":"2024-09-12T17:11:43.802798+0000","last_fullsized":"2024-09-12T17:11:43.802798+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:01.975613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801258+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:11:43.801258+0000","last_peered":"2024-09-12T17:11:43.801258+0000","last_clean":"2024-09-12T17:11:43.801258+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:11:43.801258+0000","last_undegraded":"2024-09-12T17:11:43.801258+0000","last_fullsized":"2024-09-12T17:11:43.801258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:25.268216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:34.005760+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:12:34.005760+0000","last_peered":"2024-09-12T17:12:34.005760+0000","last_clean":"2024-09-12T17:12:34.005760+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:12:34.005760+0000","last_undegraded":"2024-09-12T17:12:34.005760+0000","last_fullsized":"2024-09-12T17:12:34.005760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:11.052561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.867481+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:50.867481+0000","last_peered":"2024-09-12T17:14:50.867481+0000","last_clean":"2024-09-12T17:14:50.867481+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:50.867481+0000","last_undegraded":"2024-09-12T17:14:50.867481+0000","last_fullsized":"2024-09-12T17:14:50.867481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.857216+0000","last_change":"2024-09-12T17:11:06.691701+0000","last_active":"2024-09-12T17:14:19.857216+0000","last_peered":"2024-09-12T17:14:19.857216+0000","last_clean":"2024-09-12T17:14:19.857216+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:14:19.857216+0000","last_undegraded":"2024-09-12T17:14:19.857216+0000","last_fullsized":"2024-09-12T17:14:19.857216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:40.825850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.678202+0000","last_change":"2024-09-12T17:11:04.669503+0000","last_active":"2024-09-12T17:14:19.678202+0000","last_peered":"2024-09-12T17:14:19.678202+0000","last_clean":"2024-09-12T17:14:19.678202+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:19.678202+0000","last_undegraded":"2024-09-12T17:14:19.678202+0000","last_fullsized":"2024-09-12T17:14:19.678202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:08.595800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.817481+0000","last_change":"2024-09-12T17:10:56.780184+0000","last_active":"2024-09-12T17:11:43.817481+0000","last_peered":"2024-09-12T17:11:43.817481+0000","last_clean":"2024-09-12T17:11:43.817481+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:11:43.817481+0000","last_undegraded":"2024-09-12T17:11:43.817481+0000","last_fullsized":"2024-09-12T17:11:43.817481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:10:53.745978+0000","last_clean_scrub_stamp":"2024-09-12T17:10:53.745978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:38.954000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801939+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:11:43.801939+0000","last_peered":"2024-09-12T17:11:43.801939+0000","last_clean":"2024-09-12T17:11:43.801939+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:11:43.801939+0000","last_undegraded":"2024-09-12T17:11:43.801939+0000","last_fullsized":"2024-09-12T17:11:43.801939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'93","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.110748+0000","last_change":"2024-09-12T17:11:10.745211+0000","last_active":"2024-09-12T17:14:51.110748+0000","last_peered":"2024-09-12T17:14:51.110748+0000","last_clean":"2024-09-12T17:14:51.110748+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:14:51.110748+0000","last_undegraded":"2024-09-12T17:14:51.110748+0000","last_fullsized":"2024-09-12T17:14:51.110748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:31.455841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799656+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:11:43.799656+0000","last_peered":"2024-09-12T17:11:43.799656+0000","last_clean":"2024-09-12T17:11:43.799656+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:11:43.799656+0000","last_undegraded":"2024-09-12T17:11:43.799656+0000","last_fullsized":"2024-09-12T17:11:43.799656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:05.933362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.399063+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:11:50.399063+0000","last_peered":"2024-09-12T17:11:50.399063+0000","last_clean":"2024-09-12T17:11:50.399063+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:11:50.399063+0000","last_undegraded":"2024-09-12T17:11:50.399063+0000","last_fullsized":"2024-09-12T17:11:50.399063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:09.467743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699249+0000","last_change":"2024-09-12T17:11:06.700916+0000","last_active":"2024-09-12T17:14:19.699249+0000","last_peered":"2024-09-12T17:14:19.699249+0000","last_clean":"2024-09-12T17:14:19.699249+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:14:19.699249+0000","last_undegraded":"2024-09-12T17:14:19.699249+0000","last_fullsized":"2024-09-12T17:14:19.699249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:56.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795133+0000","last_change":"2024-09-12T17:11:04.704630+0000","last_active":"2024-09-12T17:13:24.795133+0000","last_peered":"2024-09-12T17:13:24.795133+0000","last_clean":"2024-09-12T17:13:24.795133+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:13:24.795133+0000","last_undegraded":"2024-09-12T17:13:24.795133+0000","last_fullsized":"2024-09-12T17:13:24.795133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:49.225315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":21,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.225988+0000","last_change":"2024-09-12T17:11:08.715453+0000","last_active":"2024-09-12T17:13:18.225988+0000","last_peered":"2024-09-12T17:13:18.225988+0000","last_clean":"2024-09-12T17:13:18.225988+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:13:18.225988+0000","last_undegraded":"2024-09-12T17:13:18.225988+0000","last_fullsized":"2024-09-12T17:13:18.225988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:50.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'32","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.789489+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:13:16.789489+0000","last_peered":"2024-09-12T17:13:16.789489+0000","last_clean":"2024-09-12T17:13:16.789489+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:13:16.789489+0000","last_undegraded":"2024-09-12T17:13:16.789489+0000","last_fullsized":"2024-09-12T17:13:16.789489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.384651+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.384651+0000","last_peered":"2024-09-12T17:13:16.384651+0000","last_clean":"2024-09-12T17:13:16.384651+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.384651+0000","last_undegraded":"2024-09-12T17:13:16.384651+0000","last_fullsized":"2024-09-12T17:13:16.384651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:59.671012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807517+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:11:43.807517+0000","last_peered":"2024-09-12T17:11:43.807517+0000","last_clean":"2024-09-12T17:11:43.807517+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:11:43.807517+0000","last_undegraded":"2024-09-12T17:11:43.807517+0000","last_fullsized":"2024-09-12T17:11:43.807517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.191609+0000","last_change":"2024-09-12T17:11:04.674643+0000","last_active":"2024-09-12T17:14:19.191609+0000","last_peered":"2024-09-12T17:14:19.191609+0000","last_clean":"2024-09-12T17:14:19.191609+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:14:19.191609+0000","last_undegraded":"2024-09-12T17:14:19.191609+0000","last_fullsized":"2024-09-12T17:14:19.191609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:16.872048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.668281+0000","last_change":"2024-09-12T17:11:06.691887+0000","last_active":"2024-09-12T17:13:14.668281+0000","last_peered":"2024-09-12T17:13:14.668281+0000","last_clean":"2024-09-12T17:13:14.668281+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:13:14.668281+0000","last_undegraded":"2024-09-12T17:13:14.668281+0000","last_fullsized":"2024-09-12T17:13:14.668281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794222+0000","last_change":"2024-09-12T17:11:04.688216+0000","last_active":"2024-09-12T17:11:43.794222+0000","last_peered":"2024-09-12T17:11:43.794222+0000","last_clean":"2024-09-12T17:11:43.794222+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:11:43.794222+0000","last_undegraded":"2024-09-12T17:11:43.794222+0000","last_fullsized":"2024-09-12T17:11:43.794222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:38:38.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790045+0000","last_change":"2024-09-12T17:11:08.715785+0000","last_active":"2024-09-12T17:11:43.790045+0000","last_peered":"2024-09-12T17:11:43.790045+0000","last_clean":"2024-09-12T17:11:43.790045+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:11:43.790045+0000","last_undegraded":"2024-09-12T17:11:43.790045+0000","last_fullsized":"2024-09-12T17:11:43.790045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:51.935358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.069455+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:51.069455+0000","last_peered":"2024-09-12T17:14:51.069455+0000","last_clean":"2024-09-12T17:14:51.069455+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:51.069455+0000","last_undegraded":"2024-09-12T17:14:51.069455+0000","last_fullsized":"2024-09-12T17:14:51.069455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789528+0000","last_change":"2024-09-12T17:11:06.689927+0000","last_active":"2024-09-12T17:14:19.789528+0000","last_peered":"2024-09-12T17:14:19.789528+0000","last_clean":"2024-09-12T17:14:19.789528+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:14:19.789528+0000","last_undegraded":"2024-09-12T17:14:19.789528+0000","last_fullsized":"2024-09-12T17:14:19.789528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820672+0000","last_change":"2024-09-12T17:11:04.693759+0000","last_active":"2024-09-12T17:11:43.820672+0000","last_peered":"2024-09-12T17:11:43.820672+0000","last_clean":"2024-09-12T17:11:43.820672+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:11:43.820672+0000","last_undegraded":"2024-09-12T17:11:43.820672+0000","last_fullsized":"2024-09-12T17:11:43.820672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:38.114303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.049859+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:14:51.049859+0000","last_peered":"2024-09-12T17:14:51.049859+0000","last_clean":"2024-09-12T17:14:51.049859+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:14:51.049859+0000","last_undegraded":"2024-09-12T17:14:51.049859+0000","last_fullsized":"2024-09-12T17:14:51.049859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874185+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.874185+0000","last_peered":"2024-09-12T17:14:19.874185+0000","last_clean":"2024-09-12T17:14:19.874185+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.874185+0000","last_undegraded":"2024-09-12T17:14:19.874185+0000","last_fullsized":"2024-09-12T17:14:19.874185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.972646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799635+0000","last_change":"2024-09-12T17:11:04.703253+0000","last_active":"2024-09-12T17:11:43.799635+0000","last_peered":"2024-09-12T17:11:43.799635+0000","last_clean":"2024-09-12T17:11:43.799635+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:11:43.799635+0000","last_undegraded":"2024-09-12T17:11:43.799635+0000","last_fullsized":"2024-09-12T17:11:43.799635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:31:31.965663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803741+0000","last_change":"2024-09-12T17:11:08.711173+0000","last_active":"2024-09-12T17:11:43.803741+0000","last_peered":"2024-09-12T17:11:43.803741+0000","last_clean":"2024-09-12T17:11:43.803741+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:11:43.803741+0000","last_undegraded":"2024-09-12T17:11:43.803741+0000","last_fullsized":"2024-09-12T17:11:43.803741+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:01.083466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.043008+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:14:51.043008+0000","last_peered":"2024-09-12T17:14:51.043008+0000","last_clean":"2024-09-12T17:14:51.043008+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:14:51.043008+0000","last_undegraded":"2024-09-12T17:14:51.043008+0000","last_fullsized":"2024-09-12T17:14:51.043008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.787946+0000","last_change":"2024-09-12T17:11:06.709521+0000","last_active":"2024-09-12T17:14:19.787946+0000","last_peered":"2024-09-12T17:14:19.787946+0000","last_clean":"2024-09-12T17:14:19.787946+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:14:19.787946+0000","last_undegraded":"2024-09-12T17:14:19.787946+0000","last_fullsized":"2024-09-12T17:14:19.787946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:54.551330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800701+0000","last_change":"2024-09-12T17:11:04.666747+0000","last_active":"2024-09-12T17:11:43.800701+0000","last_peered":"2024-09-12T17:11:43.800701+0000","last_clean":"2024-09-12T17:11:43.800701+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:11:43.800701+0000","last_undegraded":"2024-09-12T17:11:43.800701+0000","last_fullsized":"2024-09-12T17:11:43.800701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:22.246442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814579+0000","last_change":"2024-09-12T17:11:43.809305+0000","last_active":"2024-09-12T17:11:43.814579+0000","last_peered":"2024-09-12T17:11:43.814579+0000","last_clean":"2024-09-12T17:11:43.814579+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:11:43.814579+0000","last_undegraded":"2024-09-12T17:11:43.814579+0000","last_fullsized":"2024-09-12T17:11:43.814579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:04.779608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.771611+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:13:16.771611+0000","last_peered":"2024-09-12T17:13:16.771611+0000","last_clean":"2024-09-12T17:13:16.771611+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:13:16.771611+0000","last_undegraded":"2024-09-12T17:13:16.771611+0000","last_fullsized":"2024-09-12T17:13:16.771611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.349327+0000","last_change":"2024-09-12T17:11:06.709586+0000","last_active":"2024-09-12T17:14:19.349327+0000","last_peered":"2024-09-12T17:14:19.349327+0000","last_clean":"2024-09-12T17:14:19.349327+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:14:19.349327+0000","last_undegraded":"2024-09-12T17:14:19.349327+0000","last_fullsized":"2024-09-12T17:14:19.349327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:43.877851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.253865+0000","last_change":"2024-09-12T17:11:04.671482+0000","last_active":"2024-09-12T17:11:49.253865+0000","last_peered":"2024-09-12T17:11:49.253865+0000","last_clean":"2024-09-12T17:11:49.253865+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:11:49.253865+0000","last_undegraded":"2024-09-12T17:11:49.253865+0000","last_fullsized":"2024-09-12T17:11:49.253865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:38.765410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795517+0000","last_change":"2024-09-12T17:11:08.714321+0000","last_active":"2024-09-12T17:11:43.795517+0000","last_peered":"2024-09-12T17:11:43.795517+0000","last_clean":"2024-09-12T17:11:43.795517+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:11:43.795517+0000","last_undegraded":"2024-09-12T17:11:43.795517+0000","last_fullsized":"2024-09-12T17:11:43.795517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.528516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.191110+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:14:51.191110+0000","last_peered":"2024-09-12T17:14:51.191110+0000","last_clean":"2024-09-12T17:14:51.191110+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:14:51.191110+0000","last_undegraded":"2024-09-12T17:14:51.191110+0000","last_fullsized":"2024-09-12T17:14:51.191110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:55.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802521+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:11:43.802521+0000","last_peered":"2024-09-12T17:11:43.802521+0000","last_clean":"2024-09-12T17:11:43.802521+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:11:43.802521+0000","last_undegraded":"2024-09-12T17:11:43.802521+0000","last_fullsized":"2024-09-12T17:11:43.802521+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:31.882893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.732083+0000","last_change":"2024-09-12T17:11:06.701691+0000","last_active":"2024-09-12T17:13:18.732083+0000","last_peered":"2024-09-12T17:13:18.732083+0000","last_clean":"2024-09-12T17:13:18.732083+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:13:18.732083+0000","last_undegraded":"2024-09-12T17:13:18.732083+0000","last_fullsized":"2024-09-12T17:13:18.732083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:07.167115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803892+0000","last_change":"2024-09-12T17:11:04.699477+0000","last_active":"2024-09-12T17:11:43.803892+0000","last_peered":"2024-09-12T17:11:43.803892+0000","last_clean":"2024-09-12T17:11:43.803892+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:11:43.803892+0000","last_undegraded":"2024-09-12T17:11:43.803892+0000","last_fullsized":"2024-09-12T17:11:43.803892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:28.526303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.812713+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:11:43.812713+0000","last_peered":"2024-09-12T17:11:43.812713+0000","last_clean":"2024-09-12T17:11:43.812713+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:11:43.812713+0000","last_undegraded":"2024-09-12T17:11:43.812713+0000","last_fullsized":"2024-09-12T17:11:43.812713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:20.380652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.855453+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:50.855453+0000","last_peered":"2024-09-12T17:14:50.855453+0000","last_clean":"2024-09-12T17:14:50.855453+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:50.855453+0000","last_undegraded":"2024-09-12T17:14:50.855453+0000","last_fullsized":"2024-09-12T17:14:50.855453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:05.585547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.999516+0000","last_change":"2024-09-12T17:11:06.691786+0000","last_active":"2024-09-12T17:12:33.999516+0000","last_peered":"2024-09-12T17:12:33.999516+0000","last_clean":"2024-09-12T17:12:33.999516+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:12:33.999516+0000","last_undegraded":"2024-09-12T17:12:33.999516+0000","last_fullsized":"2024-09-12T17:12:33.999516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:57.050067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.522609+0000","last_change":"2024-09-12T17:11:04.669381+0000","last_active":"2024-09-12T17:13:18.522609+0000","last_peered":"2024-09-12T17:13:18.522609+0000","last_clean":"2024-09-12T17:13:18.522609+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:13:18.522609+0000","last_undegraded":"2024-09-12T17:13:18.522609+0000","last_fullsized":"2024-09-12T17:13:18.522609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:12.979892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'36","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.759007+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:13:16.759007+0000","last_peered":"2024-09-12T17:13:16.759007+0000","last_clean":"2024-09-12T17:13:16.759007+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:13:16.759007+0000","last_undegraded":"2024-09-12T17:13:16.759007+0000","last_fullsized":"2024-09-12T17:13:16.759007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.685021+0000","last_change":"2024-09-12T17:11:06.693085+0000","last_active":"2024-09-12T17:12:33.685021+0000","last_peered":"2024-09-12T17:12:33.685021+0000","last_clean":"2024-09-12T17:12:33.685021+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:12:33.685021+0000","last_undegraded":"2024-09-12T17:12:33.685021+0000","last_fullsized":"2024-09-12T17:12:33.685021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.660908+0000","last_change":"2024-09-12T17:11:04.705899+0000","last_active":"2024-09-12T17:14:19.660908+0000","last_peered":"2024-09-12T17:14:19.660908+0000","last_clean":"2024-09-12T17:14:19.660908+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:14:19.660908+0000","last_undegraded":"2024-09-12T17:14:19.660908+0000","last_fullsized":"2024-09-12T17:14:19.660908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:02.576860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794217+0000","last_change":"2024-09-12T17:11:08.716093+0000","last_active":"2024-09-12T17:11:43.794217+0000","last_peered":"2024-09-12T17:11:43.794217+0000","last_clean":"2024-09-12T17:11:43.794217+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:11:43.794217+0000","last_undegraded":"2024-09-12T17:11:43.794217+0000","last_fullsized":"2024-09-12T17:11:43.794217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.912768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.004291+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:14:51.004291+0000","last_peered":"2024-09-12T17:14:51.004291+0000","last_clean":"2024-09-12T17:14:51.004291+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.004291+0000","last_undegraded":"2024-09-12T17:14:51.004291+0000","last_fullsized":"2024-09-12T17:14:51.004291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.791235+0000","last_change":"2024-09-12T17:11:43.823977+0000","last_active":"2024-09-12T17:14:19.791235+0000","last_peered":"2024-09-12T17:14:19.791235+0000","last_clean":"2024-09-12T17:14:19.791235+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:14:19.791235+0000","last_undegraded":"2024-09-12T17:14:19.791235+0000","last_fullsized":"2024-09-12T17:14:19.791235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:25.321871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802954+0000","last_change":"2024-09-12T17:11:04.697071+0000","last_active":"2024-09-12T17:11:43.802954+0000","last_peered":"2024-09-12T17:11:43.802954+0000","last_clean":"2024-09-12T17:11:43.802954+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:11:43.802954+0000","last_undegraded":"2024-09-12T17:11:43.802954+0000","last_fullsized":"2024-09-12T17:11:43.802954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:10:00.835341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":227,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.211792+0000","last_change":"2024-09-12T17:11:08.722764+0000","last_active":"2024-09-12T17:13:18.211792+0000","last_peered":"2024-09-12T17:13:18.211792+0000","last_clean":"2024-09-12T17:13:18.211792+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:13:18.211792+0000","last_undegraded":"2024-09-12T17:13:18.211792+0000","last_fullsized":"2024-09-12T17:13:18.211792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:27.090536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'26","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.791697+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:13:16.791697+0000","last_peered":"2024-09-12T17:13:16.791697+0000","last_clean":"2024-09-12T17:13:16.791697+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:13:16.791697+0000","last_undegraded":"2024-09-12T17:13:16.791697+0000","last_fullsized":"2024-09-12T17:13:16.791697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699419+0000","last_change":"2024-09-12T17:11:06.689179+0000","last_active":"2024-09-12T17:14:19.699419+0000","last_peered":"2024-09-12T17:14:19.699419+0000","last_clean":"2024-09-12T17:14:19.699419+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:14:19.699419+0000","last_undegraded":"2024-09-12T17:14:19.699419+0000","last_fullsized":"2024-09-12T17:14:19.699419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.719846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820794+0000","last_change":"2024-09-12T17:11:04.677503+0000","last_active":"2024-09-12T17:11:43.820794+0000","last_peered":"2024-09-12T17:11:43.820794+0000","last_clean":"2024-09-12T17:11:43.820794+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:11:43.820794+0000","last_undegraded":"2024-09-12T17:11:43.820794+0000","last_fullsized":"2024-09-12T17:11:43.820794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:52.031685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'33","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.793999+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:18.793999+0000","last_peered":"2024-09-12T17:14:18.793999+0000","last_clean":"2024-09-12T17:14:18.793999+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:18.793999+0000","last_undegraded":"2024-09-12T17:14:18.793999+0000","last_fullsized":"2024-09-12T17:14:18.793999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.821261+0000","last_change":"2024-09-12T17:11:06.707086+0000","last_active":"2024-09-12T17:11:43.821261+0000","last_peered":"2024-09-12T17:11:43.821261+0000","last_clean":"2024-09-12T17:11:43.821261+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:11:43.821261+0000","last_undegraded":"2024-09-12T17:11:43.821261+0000","last_fullsized":"2024-09-12T17:11:43.821261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:22.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.788395+0000","last_change":"2024-09-12T17:11:04.672228+0000","last_active":"2024-09-12T17:11:43.788395+0000","last_peered":"2024-09-12T17:11:43.788395+0000","last_clean":"2024-09-12T17:11:43.788395+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:11:43.788395+0000","last_undegraded":"2024-09-12T17:11:43.788395+0000","last_fullsized":"2024-09-12T17:11:43.788395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:53.980176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.730752+0000","last_change":"2024-09-12T17:11:06.700232+0000","last_active":"2024-09-12T17:13:18.730752+0000","last_peered":"2024-09-12T17:13:18.730752+0000","last_clean":"2024-09-12T17:13:18.730752+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:13:18.730752+0000","last_undegraded":"2024-09-12T17:13:18.730752+0000","last_fullsized":"2024-09-12T17:13:18.730752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:44.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.259200+0000","last_change":"2024-09-12T17:11:04.675280+0000","last_active":"2024-09-12T17:11:49.259200+0000","last_peered":"2024-09-12T17:11:49.259200+0000","last_clean":"2024-09-12T17:11:49.259200+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:11:49.259200+0000","last_undegraded":"2024-09-12T17:11:49.259200+0000","last_fullsized":"2024-09-12T17:11:49.259200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:30.778946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.367423+0000","last_change":"2024-09-12T17:11:06.695274+0000","last_active":"2024-09-12T17:14:19.367423+0000","last_peered":"2024-09-12T17:14:19.367423+0000","last_clean":"2024-09-12T17:14:19.367423+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:14:19.367423+0000","last_undegraded":"2024-09-12T17:14:19.367423+0000","last_fullsized":"2024-09-12T17:14:19.367423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.138206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800213+0000","last_change":"2024-09-12T17:11:04.703925+0000","last_active":"2024-09-12T17:11:43.800213+0000","last_peered":"2024-09-12T17:11:43.800213+0000","last_clean":"2024-09-12T17:11:43.800213+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:11:43.800213+0000","last_undegraded":"2024-09-12T17:11:43.800213+0000","last_fullsized":"2024-09-12T17:11:43.800213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:04.292915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759765+0000","last_change":"2024-09-12T17:11:06.703392+0000","last_active":"2024-09-12T17:13:18.759765+0000","last_peered":"2024-09-12T17:13:18.759765+0000","last_clean":"2024-09-12T17:13:18.759765+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:13:18.759765+0000","last_undegraded":"2024-09-12T17:13:18.759765+0000","last_fullsized":"2024-09-12T17:13:18.759765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799380+0000","last_change":"2024-09-12T17:11:04.684732+0000","last_active":"2024-09-12T17:11:43.799380+0000","last_peered":"2024-09-12T17:11:43.799380+0000","last_clean":"2024-09-12T17:11:43.799380+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:11:43.799380+0000","last_undegraded":"2024-09-12T17:11:43.799380+0000","last_fullsized":"2024-09-12T17:11:43.799380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:40.417731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799093+0000","last_change":"2024-09-12T17:11:06.702655+0000","last_active":"2024-09-12T17:11:43.799093+0000","last_peered":"2024-09-12T17:11:43.799093+0000","last_clean":"2024-09-12T17:11:43.799093+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:11:43.799093+0000","last_undegraded":"2024-09-12T17:11:43.799093+0000","last_fullsized":"2024-09-12T17:11:43.799093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799927+0000","last_change":"2024-09-12T17:11:04.680886+0000","last_active":"2024-09-12T17:11:43.799927+0000","last_peered":"2024-09-12T17:11:43.799927+0000","last_clean":"2024-09-12T17:11:43.799927+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:11:43.799927+0000","last_undegraded":"2024-09-12T17:11:43.799927+0000","last_fullsized":"2024-09-12T17:11:43.799927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:32.824204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.494618+0000","last_change":"2024-09-12T17:11:06.706847+0000","last_active":"2024-09-12T17:14:19.494618+0000","last_peered":"2024-09-12T17:14:19.494618+0000","last_clean":"2024-09-12T17:14:19.494618+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:14:19.494618+0000","last_undegraded":"2024-09-12T17:14:19.494618+0000","last_fullsized":"2024-09-12T17:14:19.494618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:47.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.693926+0000","last_change":"2024-09-12T17:11:04.669265+0000","last_active":"2024-09-12T17:11:50.693926+0000","last_peered":"2024-09-12T17:11:50.693926+0000","last_clean":"2024-09-12T17:11:50.693926+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:11:50.693926+0000","last_undegraded":"2024-09-12T17:11:50.693926+0000","last_fullsized":"2024-09-12T17:11:50.693926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:01:34.747887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758256+0000","last_change":"2024-09-12T17:11:06.699610+0000","last_active":"2024-09-12T17:13:13.758256+0000","last_peered":"2024-09-12T17:13:13.758256+0000","last_clean":"2024-09-12T17:13:13.758256+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:13:13.758256+0000","last_undegraded":"2024-09-12T17:13:13.758256+0000","last_fullsized":"2024-09-12T17:13:13.758256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794970+0000","last_change":"2024-09-12T17:11:04.688321+0000","last_active":"2024-09-12T17:11:43.794970+0000","last_peered":"2024-09-12T17:11:43.794970+0000","last_clean":"2024-09-12T17:11:43.794970+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:11:43.794970+0000","last_undegraded":"2024-09-12T17:11:43.794970+0000","last_fullsized":"2024-09-12T17:11:43.794970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:00.136516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788842+0000","last_change":"2024-09-12T17:11:06.697920+0000","last_active":"2024-09-12T17:14:19.788842+0000","last_peered":"2024-09-12T17:14:19.788842+0000","last_clean":"2024-09-12T17:14:19.788842+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:14:19.788842+0000","last_undegraded":"2024-09-12T17:14:19.788842+0000","last_fullsized":"2024-09-12T17:14:19.788842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:41.481908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803540+0000","last_change":"2024-09-12T17:11:04.678483+0000","last_active":"2024-09-12T17:11:43.803540+0000","last_peered":"2024-09-12T17:11:43.803540+0000","last_clean":"2024-09-12T17:11:43.803540+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:11:43.803540+0000","last_undegraded":"2024-09-12T17:11:43.803540+0000","last_fullsized":"2024-09-12T17:11:43.803540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:32.707968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669536+0000","last_change":"2024-09-12T17:11:06.703492+0000","last_active":"2024-09-12T17:13:14.669536+0000","last_peered":"2024-09-12T17:13:14.669536+0000","last_clean":"2024-09-12T17:13:14.669536+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:13:14.669536+0000","last_undegraded":"2024-09-12T17:13:14.669536+0000","last_fullsized":"2024-09-12T17:13:14.669536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:33.304445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800268+0000","last_change":"2024-09-12T17:11:04.699383+0000","last_active":"2024-09-12T17:11:43.800268+0000","last_peered":"2024-09-12T17:11:43.800268+0000","last_clean":"2024-09-12T17:11:43.800268+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:11:43.800268+0000","last_undegraded":"2024-09-12T17:11:43.800268+0000","last_fullsized":"2024-09-12T17:11:43.800268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:31.767352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797277+0000","last_change":"2024-09-12T17:11:04.684375+0000","last_active":"2024-09-12T17:11:43.797277+0000","last_peered":"2024-09-12T17:11:43.797277+0000","last_clean":"2024-09-12T17:11:43.797277+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:11:43.797277+0000","last_undegraded":"2024-09-12T17:11:43.797277+0000","last_fullsized":"2024-09-12T17:11:43.797277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:05.836478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491265+0000","last_change":"2024-09-12T17:11:06.702748+0000","last_active":"2024-09-12T17:14:19.491265+0000","last_peered":"2024-09-12T17:14:19.491265+0000","last_clean":"2024-09-12T17:14:19.491265+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:14:19.491265+0000","last_undegraded":"2024-09-12T17:14:19.491265+0000","last_fullsized":"2024-09-12T17:14:19.491265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'3","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758403+0000","last_change":"2024-09-12T17:11:04.671497+0000","last_active":"2024-09-12T17:13:19.758403+0000","last_peered":"2024-09-12T17:13:19.758403+0000","last_clean":"2024-09-12T17:13:19.758403+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:13:19.758403+0000","last_undegraded":"2024-09-12T17:13:19.758403+0000","last_fullsized":"2024-09-12T17:13:19.758403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:02.752436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'19","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719500+0000","last_change":"2024-09-12T17:11:06.697799+0000","last_active":"2024-09-12T17:14:19.719500+0000","last_peered":"2024-09-12T17:14:19.719500+0000","last_clean":"2024-09-12T17:14:19.719500+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:14:19.719500+0000","last_undegraded":"2024-09-12T17:14:19.719500+0000","last_fullsized":"2024-09-12T17:14:19.719500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:51.237525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807578+0000","last_change":"2024-09-12T17:11:04.669643+0000","last_active":"2024-09-12T17:11:43.807578+0000","last_peered":"2024-09-12T17:11:43.807578+0000","last_clean":"2024-09-12T17:11:43.807578+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:11:43.807578+0000","last_undegraded":"2024-09-12T17:11:43.807578+0000","last_fullsized":"2024-09-12T17:11:43.807578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:12.651503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856748+0000","last_change":"2024-09-12T17:11:06.706910+0000","last_active":"2024-09-12T17:14:19.856748+0000","last_peered":"2024-09-12T17:14:19.856748+0000","last_clean":"2024-09-12T17:14:19.856748+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:14:19.856748+0000","last_undegraded":"2024-09-12T17:14:19.856748+0000","last_fullsized":"2024-09-12T17:14:19.856748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:09.726713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255243+0000","last_change":"2024-09-12T17:11:04.698962+0000","last_active":"2024-09-12T17:11:49.255243+0000","last_peered":"2024-09-12T17:11:49.255243+0000","last_clean":"2024-09-12T17:11:49.255243+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:11:49.255243+0000","last_undegraded":"2024-09-12T17:11:49.255243+0000","last_fullsized":"2024-09-12T17:11:49.255243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:58.287096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856816+0000","last_change":"2024-09-12T17:11:06.698579+0000","last_active":"2024-09-12T17:14:19.856816+0000","last_peered":"2024-09-12T17:14:19.856816+0000","last_clean":"2024-09-12T17:14:19.856816+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:14:19.856816+0000","last_undegraded":"2024-09-12T17:14:19.856816+0000","last_fullsized":"2024-09-12T17:14:19.856816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.305167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.810471+0000","last_change":"2024-09-12T17:11:04.706258+0000","last_active":"2024-09-12T17:11:43.810471+0000","last_peered":"2024-09-12T17:11:43.810471+0000","last_clean":"2024-09-12T17:11:43.810471+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:11:43.810471+0000","last_undegraded":"2024-09-12T17:11:43.810471+0000","last_fullsized":"2024-09-12T17:11:43.810471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.595508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856680+0000","last_change":"2024-09-12T17:11:43.799543+0000","last_active":"2024-09-12T17:14:19.856680+0000","last_peered":"2024-09-12T17:14:19.856680+0000","last_clean":"2024-09-12T17:14:19.856680+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:14:19.856680+0000","last_undegraded":"2024-09-12T17:14:19.856680+0000","last_fullsized":"2024-09-12T17:14:19.856680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.634562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795628+0000","last_change":"2024-09-12T17:11:04.688801+0000","last_active":"2024-09-12T17:11:43.795628+0000","last_peered":"2024-09-12T17:11:43.795628+0000","last_clean":"2024-09-12T17:11:43.795628+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:11:43.795628+0000","last_undegraded":"2024-09-12T17:11:43.795628+0000","last_fullsized":"2024-09-12T17:11:43.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:12.317920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491662+0000","last_change":"2024-09-12T17:11:06.692150+0000","last_active":"2024-09-12T17:14:19.491662+0000","last_peered":"2024-09-12T17:14:19.491662+0000","last_clean":"2024-09-12T17:14:19.491662+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:14:19.491662+0000","last_undegraded":"2024-09-12T17:14:19.491662+0000","last_fullsized":"2024-09-12T17:14:19.491662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:03.537778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818404+0000","last_change":"2024-09-12T17:11:04.699011+0000","last_active":"2024-09-12T17:11:43.818404+0000","last_peered":"2024-09-12T17:11:43.818404+0000","last_clean":"2024-09-12T17:11:43.818404+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:11:43.818404+0000","last_undegraded":"2024-09-12T17:11:43.818404+0000","last_fullsized":"2024-09-12T17:11:43.818404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.663093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.794825+0000","last_change":"2024-09-12T17:11:04.699035+0000","last_active":"2024-09-12T17:13:24.794825+0000","last_peered":"2024-09-12T17:13:24.794825+0000","last_clean":"2024-09-12T17:13:24.794825+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:13:24.794825+0000","last_undegraded":"2024-09-12T17:13:24.794825+0000","last_fullsized":"2024-09-12T17:13:24.794825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788135+0000","last_change":"2024-09-12T17:11:06.699450+0000","last_active":"2024-09-12T17:14:19.788135+0000","last_peered":"2024-09-12T17:14:19.788135+0000","last_clean":"2024-09-12T17:14:19.788135+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:14:19.788135+0000","last_undegraded":"2024-09-12T17:14:19.788135+0000","last_fullsized":"2024-09-12T17:14:19.788135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.494877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797601+0000","last_change":"2024-09-12T17:11:04.683423+0000","last_active":"2024-09-12T17:11:43.797601+0000","last_peered":"2024-09-12T17:11:43.797601+0000","last_clean":"2024-09-12T17:11:43.797601+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:11:43.797601+0000","last_undegraded":"2024-09-12T17:11:43.797601+0000","last_fullsized":"2024-09-12T17:11:43.797601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:21.682059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.735133+0000","last_change":"2024-09-12T17:11:06.707075+0000","last_active":"2024-09-12T17:13:18.735133+0000","last_peered":"2024-09-12T17:13:18.735133+0000","last_clean":"2024-09-12T17:13:18.735133+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:13:18.735133+0000","last_undegraded":"2024-09-12T17:13:18.735133+0000","last_fullsized":"2024-09-12T17:13:18.735133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:46.709626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2271,"ondisk_log_size":2271,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1489,"num_read_kb":1286,"num_write":561,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1318,"ondisk_log_size":1318,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":962,"num_read_kb":962,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17417088,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":140,"num_read_kb":87,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19521536,"data_stored":19521536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640309,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50532,"kb_used_data":11028,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321308,"statfs":{"total":96636764160,"available":96585019392,"internally_reserved":0,"allocated":11292672,"data_stored":10961414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44864,"kb_used_data":9520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326976,"statfs":{"total":96636764160,"available":96590823424,"internally_reserved":0,"allocated":9748480,"data_stored":9453120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39944,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331896,"statfs":{"total":96636764160,"available":96595861504,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705717,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36340,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335500,"statfs":{"total":96636764160,"available":96599552000,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:14:56.542 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.542 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.543 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.544 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.545 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.546 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.547 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.548 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.549 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.550 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.551 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.552 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.553 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:10:48.732218+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.554 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.555 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.555 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.555 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.555 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.556 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.557 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.558 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.559 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.560 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:10:53.745978+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=10, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.561 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.562 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.563 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.564 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.565 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.566 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.567 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.568 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.569 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.570 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.571 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.572 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.573 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.573 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.573 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.573 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:14:56.573 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:15:16.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:15:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.702+0000 7ff3bfee4640 1 Processor -- start 2024-09-12T17:15:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bfee4640 1 -- start start 2024-09-12T17:15:16.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bfee4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3b8111890 0x7ff3b8132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bfee4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3b8073a90 con 0x7ff3b8110da0 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bfee4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff3b80696e0 con 0x7ff3b8111890 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bd47f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff3b8111890 0x7ff3b8132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bdc80640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff3b8110da0 0x7ff3b8111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49244/0 (socket says 172.21.15.62:49244) 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bdc80640 1 -- 172.21.15.62:0/2103361136 learned_addr learned my addr 172.21.15.62:0/2103361136 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bd47f640 1 -- 172.21.15.62:0/2103361136 >> v1:172.21.15.62:6789/0 conn(0x7ff3b8110da0 legacy=0x7ff3b8111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bd47f640 1 -- 172.21.15.62:0/2103361136 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b806dd50 con 0x7ff3b8111890 2024-09-12T17:15:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bcc7e640 1 -- 172.21.15.62:0/2103361136 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426873589 0 0) 0x7ff3b8073a90 con 0x7ff3b8110da0 2024-09-12T17:15:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bd47f640 1 --2- 172.21.15.62:0/2103361136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8111890 0x7ff3b8132450 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009d90 tx=0x7ff3b001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfb7d7abbea5217 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bcc7e640 1 -- 172.21.15.62:0/2103361136 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b00b2070 con 0x7ff3b8111890 2024-09-12T17:15:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bcc7e640 1 -- 172.21.15.62:0/2103361136 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b00a5740 con 0x7ff3b8111890 2024-09-12T17:15:16.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.706+0000 7ff3bcc7e640 1 -- 172.21.15.62:0/2103361136 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3b00a5a40 con 0x7ff3b8111890 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2103361136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8111890 msgr2=0x7ff3b8132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2103361136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8111890 0x7ff3b8132450 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009d90 tx=0x7ff3b001c8c0 comp rx=0 tx=0).stop 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2103361136 shutdown_connections 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2103361136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8111890 0x7ff3b8132450 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2103361136 >> 172.21.15.62:0/2103361136 conn(0x7ff3b8070900 msgr2=0x7ff3b8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2103361136 shutdown_connections 2024-09-12T17:15:16.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2103361136 wait complete. 2024-09-12T17:15:16.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 Processor -- start 2024-09-12T17:15:16.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- start start 2024-09-12T17:15:16.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b8135330 con 0x7ff3b8110da0 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bdc80640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bdc80640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52904/0 (socket says 172.21.15.62:52904) 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bdc80640 1 -- 172.21.15.62:0/2799755786 learned_addr learned my addr 172.21.15.62:0/2799755786 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bdc80640 1 -- 172.21.15.62:0/2799755786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b8127610 con 0x7ff3b8110da0 2024-09-12T17:15:16.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bdc80640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c410 tx=0x7ff3a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a80074d0 con 0x7ff3b8110da0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3a80047f0 con 0x7ff3b8110da0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b8131860 con 0x7ff3b8110da0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a8004b10 con 0x7ff3b8110da0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b8122140 con 0x7ff3b8110da0 2024-09-12T17:15:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b8111180 con 0x7ff3b8110da0 2024-09-12T17:15:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7ff3a8011070 con 0x7ff3b8110da0 2024-09-12T17:15:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 0x7ff39803d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.710+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7ff3a804f3b0 con 0x7ff3b8110da0 2024-09-12T17:15:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.714+0000 7ff3bd47f640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 0x7ff39803d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:16.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.714+0000 7ff3bd47f640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 0x7ff39803d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00af000 tx=0x7ff3b00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:16.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.718+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7ff3a8012dd0 con 0x7ff3b8110da0 2024-09-12T17:15:16.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.886+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3b8130bf0 con 0x7ff39803b1d0 2024-09-12T17:15:16.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.918+0000 7ff3b67fc640 1 -- 172.21.15.62:0/2799755786 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665303 (secure 0 0 0) 0x7ff3b8130bf0 con 0x7ff39803b1d0 2024-09-12T17:15:16.928 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:15:16.934 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 msgr2=0x7ff39803d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 0x7ff39803d690 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00af000 tx=0x7ff3b00a7070 comp rx=0 tx=0).stop 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 msgr2=0x7ff3b8121c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff3a800c410 tx=0x7ff3a800c8d0 comp rx=0 tx=0).stop 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 shutdown_connections 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7ff39803b1d0 0x7ff39803d690 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 --2- 172.21.15.62:0/2799755786 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff3b8110da0 0x7ff3b8121c00 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 >> 172.21.15.62:0/2799755786 conn(0x7ff3b8070900 msgr2=0x7ff3b8129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 shutdown_connections 2024-09-12T17:15:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:16.922+0000 7ff3bfee4640 1 -- 172.21.15.62:0/2799755786 wait complete. 2024-09-12T17:15:16.947 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-12T17:15:16.791647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5148,"num_read_kb":4734,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4570,"ondisk_log_size":4570,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156768,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330592,"statfs":{"total":386547056640,"available":386386526208,"internally_reserved":0,"allocated":2981888,"data_stored":1783504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006934"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.201061+0000","last_change":"2024-09-12T17:15:10.201061+0000","last_active":"2024-09-12T17:15:10.201061+0000","last_peered":"2024-09-12T17:15:10.201061+0000","last_clean":"2024-09-12T17:15:10.201061+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:15:10.201061+0000","last_undegraded":"2024-09-12T17:15:10.201061+0000","last_fullsized":"2024-09-12T17:15:10.201061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.200874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:33.595229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'11","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.875621+0000","last_change":"2024-09-12T17:11:06.702423+0000","last_active":"2024-09-12T17:14:19.875621+0000","last_peered":"2024-09-12T17:14:19.875621+0000","last_clean":"2024-09-12T17:14:19.875621+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:14:19.875621+0000","last_undegraded":"2024-09-12T17:14:19.875621+0000","last_fullsized":"2024-09-12T17:14:19.875621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:45.099418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.622651+0000","last_change":"2024-09-12T17:15:10.622455+0000","last_active":"2024-09-12T17:15:10.622651+0000","last_peered":"2024-09-12T17:15:10.622651+0000","last_clean":"2024-09-12T17:15:10.622651+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:15:10.622651+0000","last_undegraded":"2024-09-12T17:15:10.622651+0000","last_fullsized":"2024-09-12T17:15:10.622651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.622272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:24.192408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.791197+0000","last_change":"2024-09-12T17:11:04.706028+0000","last_active":"2024-09-12T17:13:09.791197+0000","last_peered":"2024-09-12T17:13:09.791197+0000","last_clean":"2024-09-12T17:13:09.791197+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:13:09.791197+0000","last_undegraded":"2024-09-12T17:13:09.791197+0000","last_fullsized":"2024-09-12T17:13:09.791197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.169692+0000","last_change":"2024-09-12T17:15:09.169692+0000","last_active":"2024-09-12T17:15:09.169692+0000","last_peered":"2024-09-12T17:15:09.169692+0000","last_clean":"2024-09-12T17:15:09.169692+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:15:09.169692+0000","last_undegraded":"2024-09-12T17:15:09.169692+0000","last_fullsized":"2024-09-12T17:15:09.169692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.169513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:40.605000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:47.737476+0000","last_change":"2024-09-12T17:11:43.812377+0000","last_active":"2024-09-12T17:11:47.737476+0000","last_peered":"2024-09-12T17:11:47.737476+0000","last_clean":"2024-09-12T17:11:47.737476+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:11:47.737476+0000","last_undegraded":"2024-09-12T17:11:47.737476+0000","last_fullsized":"2024-09-12T17:11:47.737476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:08.964697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.665616+0000","last_change":"2024-09-12T17:11:04.699008+0000","last_active":"2024-09-12T17:13:18.665616+0000","last_peered":"2024-09-12T17:13:18.665616+0000","last_clean":"2024-09-12T17:13:18.665616+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:13:18.665616+0000","last_undegraded":"2024-09-12T17:13:18.665616+0000","last_fullsized":"2024-09-12T17:13:18.665616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:36.274188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.370063+0000","last_change":"2024-09-12T17:11:06.698107+0000","last_active":"2024-09-12T17:14:19.370063+0000","last_peered":"2024-09-12T17:14:19.370063+0000","last_clean":"2024-09-12T17:14:19.370063+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:14:19.370063+0000","last_undegraded":"2024-09-12T17:14:19.370063+0000","last_fullsized":"2024-09-12T17:14:19.370063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.164616+0000","last_change":"2024-09-12T17:15:07.164616+0000","last_active":"2024-09-12T17:15:07.164616+0000","last_peered":"2024-09-12T17:15:07.164616+0000","last_clean":"2024-09-12T17:15:07.164616+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:15:07.164616+0000","last_undegraded":"2024-09-12T17:15:07.164616+0000","last_fullsized":"2024-09-12T17:15:07.164616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.164431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:00.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789877+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.789877+0000","last_peered":"2024-09-12T17:14:19.789877+0000","last_clean":"2024-09-12T17:14:19.789877+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.789877+0000","last_undegraded":"2024-09-12T17:14:19.789877+0000","last_fullsized":"2024-09-12T17:14:19.789877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:24.771164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.951750+0000","last_change":"2024-09-12T17:11:04.695318+0000","last_active":"2024-09-12T17:11:49.951750+0000","last_peered":"2024-09-12T17:11:49.951750+0000","last_clean":"2024-09-12T17:11:49.951750+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:11:49.951750+0000","last_undegraded":"2024-09-12T17:11:49.951750+0000","last_fullsized":"2024-09-12T17:11:49.951750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:11.828581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.492276+0000","last_change":"2024-09-12T17:11:06.694679+0000","last_active":"2024-09-12T17:14:19.492276+0000","last_peered":"2024-09-12T17:14:19.492276+0000","last_clean":"2024-09-12T17:14:19.492276+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:14:19.492276+0000","last_undegraded":"2024-09-12T17:14:19.492276+0000","last_fullsized":"2024-09-12T17:14:19.492276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.599330+0000","last_change":"2024-09-12T17:15:09.599330+0000","last_active":"2024-09-12T17:15:09.599330+0000","last_peered":"2024-09-12T17:15:09.599330+0000","last_clean":"2024-09-12T17:15:09.599330+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:15:09.599330+0000","last_undegraded":"2024-09-12T17:15:09.599330+0000","last_fullsized":"2024-09-12T17:15:09.599330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.599149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:05.569735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.714086+0000","last_change":"2024-09-12T17:11:06.700269+0000","last_active":"2024-09-12T17:13:18.714086+0000","last_peered":"2024-09-12T17:13:18.714086+0000","last_clean":"2024-09-12T17:13:18.714086+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:13:18.714086+0000","last_undegraded":"2024-09-12T17:13:18.714086+0000","last_fullsized":"2024-09-12T17:13:18.714086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.870146+0000","last_change":"2024-09-12T17:15:08.870146+0000","last_active":"2024-09-12T17:15:08.870146+0000","last_peered":"2024-09-12T17:15:08.870146+0000","last_clean":"2024-09-12T17:15:08.870146+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:15:08.870146+0000","last_undegraded":"2024-09-12T17:15:08.870146+0000","last_fullsized":"2024-09-12T17:15:08.870146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.869833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:16.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491645+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:14:19.491645+0000","last_peered":"2024-09-12T17:14:19.491645+0000","last_clean":"2024-09-12T17:14:19.491645+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:14:19.491645+0000","last_undegraded":"2024-09-12T17:14:19.491645+0000","last_fullsized":"2024-09-12T17:14:19.491645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:06.542992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.197517+0000","last_change":"2024-09-12T17:15:08.197517+0000","last_active":"2024-09-12T17:15:08.197517+0000","last_peered":"2024-09-12T17:15:08.197517+0000","last_clean":"2024-09-12T17:15:08.197517+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:15:08.197517+0000","last_undegraded":"2024-09-12T17:15:08.197517+0000","last_fullsized":"2024-09-12T17:15:08.197517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.197226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.048616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699394+0000","last_change":"2024-09-12T17:11:06.702528+0000","last_active":"2024-09-12T17:14:19.699394+0000","last_peered":"2024-09-12T17:14:19.699394+0000","last_clean":"2024-09-12T17:14:19.699394+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:14:19.699394+0000","last_undegraded":"2024-09-12T17:14:19.699394+0000","last_fullsized":"2024-09-12T17:14:19.699394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:53.004454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.892541+0000","last_change":"2024-09-12T17:15:07.892541+0000","last_active":"2024-09-12T17:15:07.892541+0000","last_peered":"2024-09-12T17:15:07.892541+0000","last_clean":"2024-09-12T17:15:07.892541+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:15:07.892541+0000","last_undegraded":"2024-09-12T17:15:07.892541+0000","last_fullsized":"2024-09-12T17:15:07.892541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.892360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:31.964096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699210+0000","last_change":"2024-09-12T17:11:06.702654+0000","last_active":"2024-09-12T17:14:19.699210+0000","last_peered":"2024-09-12T17:14:19.699210+0000","last_clean":"2024-09-12T17:14:19.699210+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.699210+0000","last_undegraded":"2024-09-12T17:14:19.699210+0000","last_fullsized":"2024-09-12T17:14:19.699210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.918374+0000","last_change":"2024-09-12T17:15:06.918374+0000","last_active":"2024-09-12T17:15:06.918374+0000","last_peered":"2024-09-12T17:15:06.918374+0000","last_clean":"2024-09-12T17:15:06.918374+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:15:06.918374+0000","last_undegraded":"2024-09-12T17:15:06.918374+0000","last_fullsized":"2024-09-12T17:15:06.918374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.918133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:39.266087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699219+0000","last_change":"2024-09-12T17:11:06.700166+0000","last_active":"2024-09-12T17:14:19.699219+0000","last_peered":"2024-09-12T17:14:19.699219+0000","last_clean":"2024-09-12T17:14:19.699219+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:14:19.699219+0000","last_undegraded":"2024-09-12T17:14:19.699219+0000","last_fullsized":"2024-09-12T17:14:19.699219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.559195+0000","last_change":"2024-09-12T17:15:08.559195+0000","last_active":"2024-09-12T17:15:08.559195+0000","last_peered":"2024-09-12T17:15:08.559195+0000","last_clean":"2024-09-12T17:15:08.559195+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:15:08.559195+0000","last_undegraded":"2024-09-12T17:15:08.559195+0000","last_fullsized":"2024-09-12T17:15:08.559195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.558975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.680852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.351380+0000","last_change":"2024-09-12T17:11:06.702307+0000","last_active":"2024-09-12T17:14:19.351380+0000","last_peered":"2024-09-12T17:14:19.351380+0000","last_clean":"2024-09-12T17:14:19.351380+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:14:19.351380+0000","last_undegraded":"2024-09-12T17:14:19.351380+0000","last_fullsized":"2024-09-12T17:14:19.351380+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:15.153934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801460+0000","last_change":"2024-09-12T17:11:04.693521+0000","last_active":"2024-09-12T17:11:43.801460+0000","last_peered":"2024-09-12T17:11:43.801460+0000","last_clean":"2024-09-12T17:11:43.801460+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:11:43.801460+0000","last_undegraded":"2024-09-12T17:11:43.801460+0000","last_fullsized":"2024-09-12T17:11:43.801460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:34.412209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491966+0000","last_change":"2024-09-12T17:11:06.695461+0000","last_active":"2024-09-12T17:14:19.491966+0000","last_peered":"2024-09-12T17:14:19.491966+0000","last_clean":"2024-09-12T17:14:19.491966+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:14:19.491966+0000","last_undegraded":"2024-09-12T17:14:19.491966+0000","last_fullsized":"2024-09-12T17:14:19.491966+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:05.772132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.263324+0000","last_change":"2024-09-12T17:15:08.263324+0000","last_active":"2024-09-12T17:15:08.263324+0000","last_peered":"2024-09-12T17:15:08.263324+0000","last_clean":"2024-09-12T17:15:08.263324+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:15:08.263324+0000","last_undegraded":"2024-09-12T17:15:08.263324+0000","last_fullsized":"2024-09-12T17:15:08.263324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.263141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:50.866547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.119433+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:14:51.119433+0000","last_peered":"2024-09-12T17:14:51.119433+0000","last_clean":"2024-09-12T17:14:51.119433+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:14:51.119433+0000","last_undegraded":"2024-09-12T17:14:51.119433+0000","last_fullsized":"2024-09-12T17:14:51.119433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.990500+0000","last_change":"2024-09-12T17:11:06.695753+0000","last_active":"2024-09-12T17:11:49.990500+0000","last_peered":"2024-09-12T17:11:49.990500+0000","last_clean":"2024-09-12T17:11:49.990500+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:11:49.990500+0000","last_undegraded":"2024-09-12T17:11:49.990500+0000","last_fullsized":"2024-09-12T17:11:49.990500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:25.077773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.272260+0000","last_change":"2024-09-12T17:15:01.272260+0000","last_active":"2024-09-12T17:15:01.272260+0000","last_peered":"2024-09-12T17:15:01.272260+0000","last_clean":"2024-09-12T17:15:01.272260+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:15:01.272260+0000","last_undegraded":"2024-09-12T17:15:01.272260+0000","last_fullsized":"2024-09-12T17:15:01.272260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.272070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:11.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798199+0000","last_change":"2024-09-12T17:11:08.714597+0000","last_active":"2024-09-12T17:11:43.798199+0000","last_peered":"2024-09-12T17:11:43.798199+0000","last_clean":"2024-09-12T17:11:43.798199+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:11:43.798199+0000","last_undegraded":"2024-09-12T17:11:43.798199+0000","last_fullsized":"2024-09-12T17:11:43.798199+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:35.426981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788656+0000","last_change":"2024-09-12T17:11:06.695233+0000","last_active":"2024-09-12T17:14:19.788656+0000","last_peered":"2024-09-12T17:14:19.788656+0000","last_clean":"2024-09-12T17:14:19.788656+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:14:19.788656+0000","last_undegraded":"2024-09-12T17:14:19.788656+0000","last_fullsized":"2024-09-12T17:14:19.788656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:07.207850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.310022+0000","last_change":"2024-09-12T17:15:07.310022+0000","last_active":"2024-09-12T17:15:07.310022+0000","last_peered":"2024-09-12T17:15:07.310022+0000","last_clean":"2024-09-12T17:15:07.310022+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:15:07.310022+0000","last_undegraded":"2024-09-12T17:15:07.310022+0000","last_fullsized":"2024-09-12T17:15:07.310022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.309797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:17.281335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.803868+0000","last_change":"2024-09-12T17:11:08.703714+0000","last_active":"2024-09-12T17:11:43.803868+0000","last_peered":"2024-09-12T17:11:43.803868+0000","last_clean":"2024-09-12T17:11:43.803868+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:11:43.803868+0000","last_undegraded":"2024-09-12T17:11:43.803868+0000","last_fullsized":"2024-09-12T17:11:43.803868+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:58.130892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861195+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:50.861195+0000","last_peered":"2024-09-12T17:14:50.861195+0000","last_clean":"2024-09-12T17:14:50.861195+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:50.861195+0000","last_undegraded":"2024-09-12T17:14:50.861195+0000","last_fullsized":"2024-09-12T17:14:50.861195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.646081+0000","last_change":"2024-09-12T17:15:13.646081+0000","last_active":"2024-09-12T17:15:13.646081+0000","last_peered":"2024-09-12T17:15:13.646081+0000","last_clean":"2024-09-12T17:15:13.646081+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:15:13.646081+0000","last_undegraded":"2024-09-12T17:15:13.646081+0000","last_fullsized":"2024-09-12T17:15:13.646081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.645895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.910932+0000","last_change":"2024-09-12T17:14:57.910932+0000","last_active":"2024-09-12T17:14:57.910932+0000","last_peered":"2024-09-12T17:14:57.910932+0000","last_clean":"2024-09-12T17:14:57.910932+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:14:57.910932+0000","last_undegraded":"2024-09-12T17:14:57.910932+0000","last_fullsized":"2024-09-12T17:14:57.910932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.910723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:55.914281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.076109+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:14:51.076109+0000","last_peered":"2024-09-12T17:14:51.076109+0000","last_clean":"2024-09-12T17:14:51.076109+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.076109+0000","last_undegraded":"2024-09-12T17:14:51.076109+0000","last_fullsized":"2024-09-12T17:14:51.076109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.869172+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:50.869172+0000","last_peered":"2024-09-12T17:14:50.869172+0000","last_clean":"2024-09-12T17:14:50.869172+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:50.869172+0000","last_undegraded":"2024-09-12T17:14:50.869172+0000","last_fullsized":"2024-09-12T17:14:50.869172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856733+0000","last_change":"2024-09-12T17:11:06.689516+0000","last_active":"2024-09-12T17:14:19.856733+0000","last_peered":"2024-09-12T17:14:19.856733+0000","last_clean":"2024-09-12T17:14:19.856733+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:14:19.856733+0000","last_undegraded":"2024-09-12T17:14:19.856733+0000","last_fullsized":"2024-09-12T17:14:19.856733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:22.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.252598+0000","last_change":"2024-09-12T17:15:00.252598+0000","last_active":"2024-09-12T17:15:00.252598+0000","last_peered":"2024-09-12T17:15:00.252598+0000","last_clean":"2024-09-12T17:15:00.252598+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:15:00.252598+0000","last_undegraded":"2024-09-12T17:15:00.252598+0000","last_fullsized":"2024-09-12T17:15:00.252598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.252406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:21.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801252+0000","last_change":"2024-09-12T17:11:08.711989+0000","last_active":"2024-09-12T17:11:43.801252+0000","last_peered":"2024-09-12T17:11:43.801252+0000","last_clean":"2024-09-12T17:11:43.801252+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:11:43.801252+0000","last_undegraded":"2024-09-12T17:11:43.801252+0000","last_fullsized":"2024-09-12T17:11:43.801252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:37.301429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.151553+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:14:51.151553+0000","last_peered":"2024-09-12T17:14:51.151553+0000","last_clean":"2024-09-12T17:14:51.151553+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:14:51.151553+0000","last_undegraded":"2024-09-12T17:14:51.151553+0000","last_fullsized":"2024-09-12T17:14:51.151553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:45.945294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.700337+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:12:33.700337+0000","last_peered":"2024-09-12T17:12:33.700337+0000","last_clean":"2024-09-12T17:12:33.700337+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:12:33.700337+0000","last_undegraded":"2024-09-12T17:12:33.700337+0000","last_fullsized":"2024-09-12T17:12:33.700337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:14.320323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.886035+0000","last_change":"2024-09-12T17:15:11.886035+0000","last_active":"2024-09-12T17:15:11.886035+0000","last_peered":"2024-09-12T17:15:11.886035+0000","last_clean":"2024-09-12T17:15:11.886035+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:15:11.886035+0000","last_undegraded":"2024-09-12T17:15:11.886035+0000","last_fullsized":"2024-09-12T17:15:11.886035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.885853+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.230528+0000","last_change":"2024-09-12T17:14:58.230528+0000","last_active":"2024-09-12T17:14:58.230528+0000","last_peered":"2024-09-12T17:14:58.230528+0000","last_clean":"2024-09-12T17:14:58.230528+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:58.230528+0000","last_undegraded":"2024-09-12T17:14:58.230528+0000","last_fullsized":"2024-09-12T17:14:58.230528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.230294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:55.690708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797606+0000","last_change":"2024-09-12T17:11:08.703591+0000","last_active":"2024-09-12T17:11:43.797606+0000","last_peered":"2024-09-12T17:11:43.797606+0000","last_clean":"2024-09-12T17:11:43.797606+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:11:43.797606+0000","last_undegraded":"2024-09-12T17:11:43.797606+0000","last_fullsized":"2024-09-12T17:11:43.797606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:30.362634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.011543+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:14:51.011543+0000","last_peered":"2024-09-12T17:14:51.011543+0000","last_clean":"2024-09-12T17:14:51.011543+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:14:51.011543+0000","last_undegraded":"2024-09-12T17:14:51.011543+0000","last_fullsized":"2024-09-12T17:14:51.011543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797367+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:11:43.797367+0000","last_peered":"2024-09-12T17:11:43.797367+0000","last_clean":"2024-09-12T17:11:43.797367+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:11:43.797367+0000","last_undegraded":"2024-09-12T17:11:43.797367+0000","last_fullsized":"2024-09-12T17:11:43.797367+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:21.311032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:27.988084+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:12:27.988084+0000","last_peered":"2024-09-12T17:12:27.988084+0000","last_clean":"2024-09-12T17:12:27.988084+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:12:27.988084+0000","last_undegraded":"2024-09-12T17:12:27.988084+0000","last_fullsized":"2024-09-12T17:12:27.988084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:12.424031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.156505+0000","last_change":"2024-09-12T17:15:12.156505+0000","last_active":"2024-09-12T17:15:12.156505+0000","last_peered":"2024-09-12T17:15:12.156505+0000","last_clean":"2024-09-12T17:15:12.156505+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:15:12.156505+0000","last_undegraded":"2024-09-12T17:15:12.156505+0000","last_fullsized":"2024-09-12T17:15:12.156505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.156239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:25.415656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.346855+0000","last_change":"2024-09-12T17:15:06.346855+0000","last_active":"2024-09-12T17:15:06.346855+0000","last_peered":"2024-09-12T17:15:06.346855+0000","last_clean":"2024-09-12T17:15:06.346855+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:15:06.346855+0000","last_undegraded":"2024-09-12T17:15:06.346855+0000","last_fullsized":"2024-09-12T17:15:06.346855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.346636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:51.428823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802068+0000","last_change":"2024-09-12T17:11:08.703554+0000","last_active":"2024-09-12T17:11:43.802068+0000","last_peered":"2024-09-12T17:11:43.802068+0000","last_clean":"2024-09-12T17:11:43.802068+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:11:43.802068+0000","last_undegraded":"2024-09-12T17:11:43.802068+0000","last_fullsized":"2024-09-12T17:11:43.802068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:43.928545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.166354+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:14:51.166354+0000","last_peered":"2024-09-12T17:14:51.166354+0000","last_clean":"2024-09-12T17:14:51.166354+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:14:51.166354+0000","last_undegraded":"2024-09-12T17:14:51.166354+0000","last_fullsized":"2024-09-12T17:14:51.166354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:15.747423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":353,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.872194+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:50.872194+0000","last_peered":"2024-09-12T17:14:50.872194+0000","last_clean":"2024-09-12T17:14:50.872194+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:50.872194+0000","last_undegraded":"2024-09-12T17:14:50.872194+0000","last_fullsized":"2024-09-12T17:14:50.872194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:58.989870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802324+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:11:43.802324+0000","last_peered":"2024-09-12T17:11:43.802324+0000","last_clean":"2024-09-12T17:11:43.802324+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:11:43.802324+0000","last_undegraded":"2024-09-12T17:11:43.802324+0000","last_fullsized":"2024-09-12T17:11:43.802324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:27.921640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874529+0000","last_change":"2024-09-12T17:11:06.692668+0000","last_active":"2024-09-12T17:14:19.874529+0000","last_peered":"2024-09-12T17:14:19.874529+0000","last_clean":"2024-09-12T17:14:19.874529+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:14:19.874529+0000","last_undegraded":"2024-09-12T17:14:19.874529+0000","last_fullsized":"2024-09-12T17:14:19.874529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:04.849314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.804443+0000","last_change":"2024-09-12T17:11:04.705352+0000","last_active":"2024-09-12T17:11:43.804443+0000","last_peered":"2024-09-12T17:11:43.804443+0000","last_clean":"2024-09-12T17:11:43.804443+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:11:43.804443+0000","last_undegraded":"2024-09-12T17:11:43.804443+0000","last_fullsized":"2024-09-12T17:11:43.804443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:50:32.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798335+0000","last_change":"2024-09-12T17:11:08.718239+0000","last_active":"2024-09-12T17:11:43.798335+0000","last_peered":"2024-09-12T17:11:43.798335+0000","last_clean":"2024-09-12T17:11:43.798335+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:11:43.798335+0000","last_undegraded":"2024-09-12T17:11:43.798335+0000","last_fullsized":"2024-09-12T17:11:43.798335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:43:05.261510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":126,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.180728+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:14:51.180728+0000","last_peered":"2024-09-12T17:14:51.180728+0000","last_clean":"2024-09-12T17:14:51.180728+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:14:51.180728+0000","last_undegraded":"2024-09-12T17:14:51.180728+0000","last_fullsized":"2024-09-12T17:14:51.180728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:08.295074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797078+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:11:43.797078+0000","last_peered":"2024-09-12T17:11:43.797078+0000","last_clean":"2024-09-12T17:11:43.797078+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:11:43.797078+0000","last_undegraded":"2024-09-12T17:11:43.797078+0000","last_fullsized":"2024-09-12T17:11:43.797078+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:12.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.020204+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.020204+0000","last_peered":"2024-09-12T17:14:20.020204+0000","last_clean":"2024-09-12T17:14:20.020204+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.020204+0000","last_undegraded":"2024-09-12T17:14:20.020204+0000","last_fullsized":"2024-09-12T17:14:20.020204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:56:39.726074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.848522+0000","last_change":"2024-09-12T17:15:12.848522+0000","last_active":"2024-09-12T17:15:12.848522+0000","last_peered":"2024-09-12T17:15:12.848522+0000","last_clean":"2024-09-12T17:15:12.848522+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:15:12.848522+0000","last_undegraded":"2024-09-12T17:15:12.848522+0000","last_fullsized":"2024-09-12T17:15:12.848522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.848285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.476233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.570059+0000","last_change":"2024-09-12T17:15:01.570059+0000","last_active":"2024-09-12T17:15:01.570059+0000","last_peered":"2024-09-12T17:15:01.570059+0000","last_clean":"2024-09-12T17:15:01.570059+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:15:01.570059+0000","last_undegraded":"2024-09-12T17:15:01.570059+0000","last_fullsized":"2024-09-12T17:15:01.570059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.569882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:12.460985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793223+0000","last_change":"2024-09-12T17:11:08.714019+0000","last_active":"2024-09-12T17:11:43.793223+0000","last_peered":"2024-09-12T17:11:43.793223+0000","last_clean":"2024-09-12T17:11:43.793223+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:11:43.793223+0000","last_undegraded":"2024-09-12T17:11:43.793223+0000","last_fullsized":"2024-09-12T17:11:43.793223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:48.242476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.034930+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:14:51.034930+0000","last_peered":"2024-09-12T17:14:51.034930+0000","last_clean":"2024-09-12T17:14:51.034930+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:14:51.034930+0000","last_undegraded":"2024-09-12T17:14:51.034930+0000","last_fullsized":"2024-09-12T17:14:51.034930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.970318+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:14:19.970318+0000","last_peered":"2024-09-12T17:14:19.970318+0000","last_clean":"2024-09-12T17:14:19.970318+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:14:19.970318+0000","last_undegraded":"2024-09-12T17:14:19.970318+0000","last_fullsized":"2024-09-12T17:14:19.970318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856766+0000","last_change":"2024-09-12T17:11:06.709152+0000","last_active":"2024-09-12T17:14:19.856766+0000","last_peered":"2024-09-12T17:14:19.856766+0000","last_clean":"2024-09-12T17:14:19.856766+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:14:19.856766+0000","last_undegraded":"2024-09-12T17:14:19.856766+0000","last_fullsized":"2024-09-12T17:14:19.856766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:48.578776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.406881+0000","last_change":"2024-09-12T17:15:04.406881+0000","last_active":"2024-09-12T17:15:04.406881+0000","last_peered":"2024-09-12T17:15:04.406881+0000","last_clean":"2024-09-12T17:15:04.406881+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:15:04.406881+0000","last_undegraded":"2024-09-12T17:15:04.406881+0000","last_fullsized":"2024-09-12T17:15:04.406881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.406686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:45.243217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798665+0000","last_change":"2024-09-12T17:11:08.717768+0000","last_active":"2024-09-12T17:11:43.798665+0000","last_peered":"2024-09-12T17:11:43.798665+0000","last_clean":"2024-09-12T17:11:43.798665+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:11:43.798665+0000","last_undegraded":"2024-09-12T17:11:43.798665+0000","last_fullsized":"2024-09-12T17:11:43.798665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:18:07.209528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'41","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.989960+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:14:50.989960+0000","last_peered":"2024-09-12T17:14:50.989960+0000","last_clean":"2024-09-12T17:14:50.989960+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:14:50.989960+0000","last_undegraded":"2024-09-12T17:14:50.989960+0000","last_fullsized":"2024-09-12T17:14:50.989960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861779+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:50.861779+0000","last_peered":"2024-09-12T17:14:50.861779+0000","last_clean":"2024-09-12T17:14:50.861779+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:50.861779+0000","last_undegraded":"2024-09-12T17:14:50.861779+0000","last_fullsized":"2024-09-12T17:14:50.861779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759536+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:13:18.759536+0000","last_peered":"2024-09-12T17:13:18.759536+0000","last_clean":"2024-09-12T17:13:18.759536+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:13:18.759536+0000","last_undegraded":"2024-09-12T17:13:18.759536+0000","last_fullsized":"2024-09-12T17:13:18.759536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:24:09.962925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.396693+0000","last_change":"2024-09-12T17:11:06.700331+0000","last_active":"2024-09-12T17:11:50.396693+0000","last_peered":"2024-09-12T17:11:50.396693+0000","last_clean":"2024-09-12T17:11:50.396693+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:11:50.396693+0000","last_undegraded":"2024-09-12T17:11:50.396693+0000","last_fullsized":"2024-09-12T17:11:50.396693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.369239+0000","last_change":"2024-09-12T17:15:05.369239+0000","last_active":"2024-09-12T17:15:05.369239+0000","last_peered":"2024-09-12T17:15:05.369239+0000","last_clean":"2024-09-12T17:15:05.369239+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:15:05.369239+0000","last_undegraded":"2024-09-12T17:15:05.369239+0000","last_fullsized":"2024-09-12T17:15:05.369239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.369026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:56.089945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":430,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.832803+0000","last_change":"2024-09-12T17:11:43.830390+0000","last_active":"2024-09-12T17:14:50.832803+0000","last_peered":"2024-09-12T17:14:50.832803+0000","last_clean":"2024-09-12T17:14:50.832803+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:14:50.832803+0000","last_undegraded":"2024-09-12T17:14:50.832803+0000","last_fullsized":"2024-09-12T17:14:50.832803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:29.517561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":515,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.864673+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:50.864673+0000","last_peered":"2024-09-12T17:14:50.864673+0000","last_clean":"2024-09-12T17:14:50.864673+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:50.864673+0000","last_undegraded":"2024-09-12T17:14:50.864673+0000","last_fullsized":"2024-09-12T17:14:50.864673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.965720+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:19.965720+0000","last_peered":"2024-09-12T17:14:19.965720+0000","last_clean":"2024-09-12T17:14:19.965720+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:19.965720+0000","last_undegraded":"2024-09-12T17:14:19.965720+0000","last_fullsized":"2024-09-12T17:14:19.965720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:28:13.448676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.876344+0000","last_change":"2024-09-12T17:15:13.876344+0000","last_active":"2024-09-12T17:15:13.876344+0000","last_peered":"2024-09-12T17:15:13.876344+0000","last_clean":"2024-09-12T17:15:13.876344+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:15:13.876344+0000","last_undegraded":"2024-09-12T17:15:13.876344+0000","last_fullsized":"2024-09-12T17:15:13.876344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.876174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:45.655514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.392219+0000","last_change":"2024-09-12T17:15:03.392219+0000","last_active":"2024-09-12T17:15:03.392219+0000","last_peered":"2024-09-12T17:15:03.392219+0000","last_clean":"2024-09-12T17:15:03.392219+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:15:03.392219+0000","last_undegraded":"2024-09-12T17:15:03.392219+0000","last_fullsized":"2024-09-12T17:15:03.392219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.392030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:57.279126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.128009+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:14:51.128009+0000","last_peered":"2024-09-12T17:14:51.128009+0000","last_clean":"2024-09-12T17:14:51.128009+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:14:51.128009+0000","last_undegraded":"2024-09-12T17:14:51.128009+0000","last_fullsized":"2024-09-12T17:14:51.128009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.928411+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:19.928411+0000","last_peered":"2024-09-12T17:14:19.928411+0000","last_clean":"2024-09-12T17:14:19.928411+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:19.928411+0000","last_undegraded":"2024-09-12T17:14:19.928411+0000","last_fullsized":"2024-09-12T17:14:19.928411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:09.033244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669049+0000","last_change":"2024-09-12T17:11:06.709109+0000","last_active":"2024-09-12T17:13:14.669049+0000","last_peered":"2024-09-12T17:13:14.669049+0000","last_clean":"2024-09-12T17:13:14.669049+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:13:14.669049+0000","last_undegraded":"2024-09-12T17:13:14.669049+0000","last_fullsized":"2024-09-12T17:13:14.669049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:51.560480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.911446+0000","last_change":"2024-09-12T17:14:55.911446+0000","last_active":"2024-09-12T17:14:55.911446+0000","last_peered":"2024-09-12T17:14:55.911446+0000","last_clean":"2024-09-12T17:14:55.911446+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:14:55.911446+0000","last_undegraded":"2024-09-12T17:14:55.911446+0000","last_fullsized":"2024-09-12T17:14:55.911446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.911203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:43.813828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.344255+0000","last_change":"2024-09-12T17:14:58.344110+0000","last_active":"2024-09-12T17:14:58.344255+0000","last_peered":"2024-09-12T17:14:58.344255+0000","last_clean":"2024-09-12T17:14:58.344255+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:14:58.344255+0000","last_undegraded":"2024-09-12T17:14:58.344255+0000","last_fullsized":"2024-09-12T17:14:58.344255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.343916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:58.763095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.363397+0000","last_change":"2024-09-12T17:15:00.363177+0000","last_active":"2024-09-12T17:15:00.363397+0000","last_peered":"2024-09-12T17:15:00.363397+0000","last_clean":"2024-09-12T17:15:00.363397+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:15:00.363397+0000","last_undegraded":"2024-09-12T17:15:00.363397+0000","last_fullsized":"2024-09-12T17:15:00.363397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.362898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:40.201170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818268+0000","last_change":"2024-09-12T17:11:43.816300+0000","last_active":"2024-09-12T17:11:43.818268+0000","last_peered":"2024-09-12T17:11:43.818268+0000","last_clean":"2024-09-12T17:11:43.818268+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:11:43.818268+0000","last_undegraded":"2024-09-12T17:11:43.818268+0000","last_fullsized":"2024-09-12T17:11:43.818268+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:09:37.695610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":167,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.143383+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:14:51.143383+0000","last_peered":"2024-09-12T17:14:51.143383+0000","last_clean":"2024-09-12T17:14:51.143383+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:14:51.143383+0000","last_undegraded":"2024-09-12T17:14:51.143383+0000","last_fullsized":"2024-09-12T17:14:51.143383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:40.493734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802475+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:11:43.802475+0000","last_peered":"2024-09-12T17:11:43.802475+0000","last_clean":"2024-09-12T17:11:43.802475+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:11:43.802475+0000","last_undegraded":"2024-09-12T17:11:43.802475+0000","last_fullsized":"2024-09-12T17:11:43.802475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:03:25.075965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'7","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.804563+0000","last_change":"2024-09-12T17:11:06.693422+0000","last_active":"2024-09-12T17:14:19.804563+0000","last_peered":"2024-09-12T17:14:19.804563+0000","last_clean":"2024-09-12T17:14:19.804563+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:14:19.804563+0000","last_undegraded":"2024-09-12T17:14:19.804563+0000","last_fullsized":"2024-09-12T17:14:19.804563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:57.467976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.355017+0000","last_change":"2024-09-12T17:14:56.355017+0000","last_active":"2024-09-12T17:14:56.355017+0000","last_peered":"2024-09-12T17:14:56.355017+0000","last_clean":"2024-09-12T17:14:56.355017+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:14:56.355017+0000","last_undegraded":"2024-09-12T17:14:56.355017+0000","last_fullsized":"2024-09-12T17:14:56.355017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.354829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:11.179727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.554007+0000","last_change":"2024-09-12T17:15:00.553874+0000","last_active":"2024-09-12T17:15:00.554007+0000","last_peered":"2024-09-12T17:15:00.554007+0000","last_clean":"2024-09-12T17:15:00.554007+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:15:00.554007+0000","last_undegraded":"2024-09-12T17:15:00.554007+0000","last_fullsized":"2024-09-12T17:15:00.554007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.553655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:28.442790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.819515+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:11:43.819515+0000","last_peered":"2024-09-12T17:11:43.819515+0000","last_clean":"2024-09-12T17:11:43.819515+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:11:43.819515+0000","last_undegraded":"2024-09-12T17:11:43.819515+0000","last_fullsized":"2024-09-12T17:11:43.819515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:52.790398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'286","reported_seq":504,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.138023+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:51.138023+0000","last_peered":"2024-09-12T17:14:51.138023+0000","last_clean":"2024-09-12T17:14:51.138023+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:51.138023+0000","last_undegraded":"2024-09-12T17:14:51.138023+0000","last_fullsized":"2024-09-12T17:14:51.138023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:01.609491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805519+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:11:43.805519+0000","last_peered":"2024-09-12T17:11:43.805519+0000","last_clean":"2024-09-12T17:11:43.805519+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:11:43.805519+0000","last_undegraded":"2024-09-12T17:11:43.805519+0000","last_fullsized":"2024-09-12T17:11:43.805519+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:45.855549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.692612+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:12:33.692612+0000","last_peered":"2024-09-12T17:12:33.692612+0000","last_clean":"2024-09-12T17:12:33.692612+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:12:33.692612+0000","last_undegraded":"2024-09-12T17:12:33.692612+0000","last_fullsized":"2024-09-12T17:12:33.692612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:46:23.700288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'25","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.876594+0000","last_change":"2024-09-12T17:11:06.700482+0000","last_active":"2024-09-12T17:14:19.876594+0000","last_peered":"2024-09-12T17:14:19.876594+0000","last_clean":"2024-09-12T17:14:19.876594+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:14:19.876594+0000","last_undegraded":"2024-09-12T17:14:19.876594+0000","last_fullsized":"2024-09-12T17:14:19.876594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:53.954037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.253023+0000","last_change":"2024-09-12T17:14:56.252899+0000","last_active":"2024-09-12T17:14:56.253023+0000","last_peered":"2024-09-12T17:14:56.253023+0000","last_clean":"2024-09-12T17:14:56.253023+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:14:56.253023+0000","last_undegraded":"2024-09-12T17:14:56.253023+0000","last_fullsized":"2024-09-12T17:14:56.253023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.252710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:23.672480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.622944+0000","last_change":"2024-09-12T17:14:57.622760+0000","last_active":"2024-09-12T17:14:57.622944+0000","last_peered":"2024-09-12T17:14:57.622944+0000","last_clean":"2024-09-12T17:14:57.622944+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:14:57.622944+0000","last_undegraded":"2024-09-12T17:14:57.622944+0000","last_fullsized":"2024-09-12T17:14:57.622944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.622572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.441681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.793377+0000","last_change":"2024-09-12T17:11:08.712933+0000","last_active":"2024-09-12T17:11:43.793377+0000","last_peered":"2024-09-12T17:11:43.793377+0000","last_clean":"2024-09-12T17:11:43.793377+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:11:43.793377+0000","last_undegraded":"2024-09-12T17:11:43.793377+0000","last_fullsized":"2024-09-12T17:11:43.793377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:59.902245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.956445+0000","last_change":"2024-09-12T17:11:10.735305+0000","last_active":"2024-09-12T17:14:18.956445+0000","last_peered":"2024-09-12T17:14:18.956445+0000","last_clean":"2024-09-12T17:14:18.956445+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:14:18.956445+0000","last_undegraded":"2024-09-12T17:14:18.956445+0000","last_fullsized":"2024-09-12T17:14:18.956445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:41.801702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799591+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:11:43.799591+0000","last_peered":"2024-09-12T17:11:43.799591+0000","last_clean":"2024-09-12T17:11:43.799591+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:11:43.799591+0000","last_undegraded":"2024-09-12T17:11:43.799591+0000","last_fullsized":"2024-09-12T17:11:43.799591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:20.273638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.619313+0000","last_change":"2024-09-12T17:15:12.619313+0000","last_active":"2024-09-12T17:15:12.619313+0000","last_peered":"2024-09-12T17:15:12.619313+0000","last_clean":"2024-09-12T17:15:12.619313+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:15:12.619313+0000","last_undegraded":"2024-09-12T17:15:12.619313+0000","last_fullsized":"2024-09-12T17:15:12.619313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.619133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.401095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.349942+0000","last_change":"2024-09-12T17:14:57.349792+0000","last_active":"2024-09-12T17:14:57.349942+0000","last_peered":"2024-09-12T17:14:57.349942+0000","last_clean":"2024-09-12T17:14:57.349942+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:14:57.349942+0000","last_undegraded":"2024-09-12T17:14:57.349942+0000","last_fullsized":"2024-09-12T17:14:57.349942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.349607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:49.102885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.265630+0000","last_change":"2024-09-12T17:14:57.265630+0000","last_active":"2024-09-12T17:14:57.265630+0000","last_peered":"2024-09-12T17:14:57.265630+0000","last_clean":"2024-09-12T17:14:57.265630+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:14:57.265630+0000","last_undegraded":"2024-09-12T17:14:57.265630+0000","last_fullsized":"2024-09-12T17:14:57.265630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.265430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:07.327769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800092+0000","last_change":"2024-09-12T17:11:08.711996+0000","last_active":"2024-09-12T17:11:43.800092+0000","last_peered":"2024-09-12T17:11:43.800092+0000","last_clean":"2024-09-12T17:11:43.800092+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:11:43.800092+0000","last_undegraded":"2024-09-12T17:11:43.800092+0000","last_fullsized":"2024-09-12T17:11:43.800092+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:39.784952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.753060+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.753060+0000","last_peered":"2024-09-12T17:14:18.753060+0000","last_clean":"2024-09-12T17:14:18.753060+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.753060+0000","last_undegraded":"2024-09-12T17:14:18.753060+0000","last_fullsized":"2024-09-12T17:14:18.753060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:23.846254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818300+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:11:43.818300+0000","last_peered":"2024-09-12T17:11:43.818300+0000","last_clean":"2024-09-12T17:11:43.818300+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:11:43.818300+0000","last_undegraded":"2024-09-12T17:11:43.818300+0000","last_fullsized":"2024-09-12T17:11:43.818300+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:33.198581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.354515+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:18.354515+0000","last_peered":"2024-09-12T17:13:18.354515+0000","last_clean":"2024-09-12T17:13:18.354515+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:18.354515+0000","last_undegraded":"2024-09-12T17:13:18.354515+0000","last_fullsized":"2024-09-12T17:13:18.354515+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:36:16.583308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.823868+0000","last_change":"2024-09-12T17:15:09.823868+0000","last_active":"2024-09-12T17:15:09.823868+0000","last_peered":"2024-09-12T17:15:09.823868+0000","last_clean":"2024-09-12T17:15:09.823868+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:15:09.823868+0000","last_undegraded":"2024-09-12T17:15:09.823868+0000","last_fullsized":"2024-09-12T17:15:09.823868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.823660+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.275856+0000","last_change":"2024-09-12T17:14:59.275856+0000","last_active":"2024-09-12T17:14:59.275856+0000","last_peered":"2024-09-12T17:14:59.275856+0000","last_clean":"2024-09-12T17:14:59.275856+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:59.275856+0000","last_undegraded":"2024-09-12T17:14:59.275856+0000","last_fullsized":"2024-09-12T17:14:59.275856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.275635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:08.199637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.609810+0000","last_change":"2024-09-12T17:14:55.609658+0000","last_active":"2024-09-12T17:14:55.609810+0000","last_peered":"2024-09-12T17:14:55.609810+0000","last_clean":"2024-09-12T17:14:55.609810+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:14:55.609810+0000","last_undegraded":"2024-09-12T17:14:55.609810+0000","last_fullsized":"2024-09-12T17:14:55.609810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.609474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:43.527501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.064927+0000","last_change":"2024-09-12T17:11:08.714792+0000","last_active":"2024-09-12T17:14:20.064927+0000","last_peered":"2024-09-12T17:14:20.064927+0000","last_clean":"2024-09-12T17:14:20.064927+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:14:20.064927+0000","last_undegraded":"2024-09-12T17:14:20.064927+0000","last_fullsized":"2024-09-12T17:14:20.064927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:27.037237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'67","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.087863+0000","last_change":"2024-09-12T17:11:10.745089+0000","last_active":"2024-09-12T17:14:51.087863+0000","last_peered":"2024-09-12T17:14:51.087863+0000","last_clean":"2024-09-12T17:14:51.087863+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:14:51.087863+0000","last_undegraded":"2024-09-12T17:14:51.087863+0000","last_fullsized":"2024-09-12T17:14:51.087863+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791955+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:11:43.791955+0000","last_peered":"2024-09-12T17:11:43.791955+0000","last_clean":"2024-09-12T17:11:43.791955+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:11:43.791955+0000","last_undegraded":"2024-09-12T17:11:43.791955+0000","last_fullsized":"2024-09-12T17:11:43.791955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:21.574053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.842397+0000","last_change":"2024-09-12T17:15:10.842397+0000","last_active":"2024-09-12T17:15:10.842397+0000","last_peered":"2024-09-12T17:15:10.842397+0000","last_clean":"2024-09-12T17:15:10.842397+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:15:10.842397+0000","last_undegraded":"2024-09-12T17:15:10.842397+0000","last_fullsized":"2024-09-12T17:15:10.842397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.842219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:45.585105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.546848+0000","last_change":"2024-09-12T17:14:59.546720+0000","last_active":"2024-09-12T17:14:59.546848+0000","last_peered":"2024-09-12T17:14:59.546848+0000","last_clean":"2024-09-12T17:14:59.546848+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:14:59.546848+0000","last_undegraded":"2024-09-12T17:14:59.546848+0000","last_fullsized":"2024-09-12T17:14:59.546848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.546539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:06.551999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.384965+0000","last_change":"2024-09-12T17:15:02.384841+0000","last_active":"2024-09-12T17:15:02.384965+0000","last_peered":"2024-09-12T17:15:02.384965+0000","last_clean":"2024-09-12T17:15:02.384965+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:15:02.384965+0000","last_undegraded":"2024-09-12T17:15:02.384965+0000","last_fullsized":"2024-09-12T17:15:02.384965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.384664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:21.774531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797949+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:11:43.797949+0000","last_peered":"2024-09-12T17:11:43.797949+0000","last_clean":"2024-09-12T17:11:43.797949+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:11:43.797949+0000","last_undegraded":"2024-09-12T17:11:43.797949+0000","last_fullsized":"2024-09-12T17:11:43.797949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:09.523951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.802889+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:11:43.802889+0000","last_peered":"2024-09-12T17:11:43.802889+0000","last_clean":"2024-09-12T17:11:43.802889+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:11:43.802889+0000","last_undegraded":"2024-09-12T17:11:43.802889+0000","last_fullsized":"2024-09-12T17:11:43.802889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:43.190222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":392,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.204665+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:51.204665+0000","last_peered":"2024-09-12T17:14:51.204665+0000","last_clean":"2024-09-12T17:14:51.204665+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:51.204665+0000","last_undegraded":"2024-09-12T17:14:51.204665+0000","last_fullsized":"2024-09-12T17:14:51.204665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719749+0000","last_change":"2024-09-12T17:11:06.689832+0000","last_active":"2024-09-12T17:14:19.719749+0000","last_peered":"2024-09-12T17:14:19.719749+0000","last_clean":"2024-09-12T17:14:19.719749+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:14:19.719749+0000","last_undegraded":"2024-09-12T17:14:19.719749+0000","last_fullsized":"2024-09-12T17:14:19.719749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.369815+0000","last_change":"2024-09-12T17:15:01.369815+0000","last_active":"2024-09-12T17:15:01.369815+0000","last_peered":"2024-09-12T17:15:01.369815+0000","last_clean":"2024-09-12T17:15:01.369815+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:15:01.369815+0000","last_undegraded":"2024-09-12T17:15:01.369815+0000","last_fullsized":"2024-09-12T17:15:01.369815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.369538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.619390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.591887+0000","last_change":"2024-09-12T17:14:56.591887+0000","last_active":"2024-09-12T17:14:56.591887+0000","last_peered":"2024-09-12T17:14:56.591887+0000","last_clean":"2024-09-12T17:14:56.591887+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:14:56.591887+0000","last_undegraded":"2024-09-12T17:14:56.591887+0000","last_fullsized":"2024-09-12T17:14:56.591887+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.591696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:05.758061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801258+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:11:43.801258+0000","last_peered":"2024-09-12T17:11:43.801258+0000","last_clean":"2024-09-12T17:11:43.801258+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:11:43.801258+0000","last_undegraded":"2024-09-12T17:11:43.801258+0000","last_fullsized":"2024-09-12T17:11:43.801258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:25.268216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:34.005760+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:12:34.005760+0000","last_peered":"2024-09-12T17:12:34.005760+0000","last_clean":"2024-09-12T17:12:34.005760+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:12:34.005760+0000","last_undegraded":"2024-09-12T17:12:34.005760+0000","last_fullsized":"2024-09-12T17:12:34.005760+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:11.052561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.867481+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:50.867481+0000","last_peered":"2024-09-12T17:14:50.867481+0000","last_clean":"2024-09-12T17:14:50.867481+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:50.867481+0000","last_undegraded":"2024-09-12T17:14:50.867481+0000","last_fullsized":"2024-09-12T17:14:50.867481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:45:03.418425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.152858+0000","last_change":"2024-09-12T17:15:11.152858+0000","last_active":"2024-09-12T17:15:11.152858+0000","last_peered":"2024-09-12T17:15:11.152858+0000","last_clean":"2024-09-12T17:15:11.152858+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:15:11.152858+0000","last_undegraded":"2024-09-12T17:15:11.152858+0000","last_fullsized":"2024-09-12T17:15:11.152858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.152634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:17.511951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.954698+0000","last_change":"2024-09-12T17:14:56.954698+0000","last_active":"2024-09-12T17:14:56.954698+0000","last_peered":"2024-09-12T17:14:56.954698+0000","last_clean":"2024-09-12T17:14:56.954698+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:56.954698+0000","last_undegraded":"2024-09-12T17:14:56.954698+0000","last_fullsized":"2024-09-12T17:14:56.954698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.954518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:01.720351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.386536+0000","last_change":"2024-09-12T17:14:59.386412+0000","last_active":"2024-09-12T17:14:59.386536+0000","last_peered":"2024-09-12T17:14:59.386536+0000","last_clean":"2024-09-12T17:14:59.386536+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:14:59.386536+0000","last_undegraded":"2024-09-12T17:14:59.386536+0000","last_fullsized":"2024-09-12T17:14:59.386536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.386232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:09.105379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.790853+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:13:09.790853+0000","last_peered":"2024-09-12T17:13:09.790853+0000","last_clean":"2024-09-12T17:13:09.790853+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:13:09.790853+0000","last_undegraded":"2024-09-12T17:13:09.790853+0000","last_fullsized":"2024-09-12T17:13:09.790853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'93","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.110748+0000","last_change":"2024-09-12T17:11:10.745211+0000","last_active":"2024-09-12T17:14:51.110748+0000","last_peered":"2024-09-12T17:14:51.110748+0000","last_clean":"2024-09-12T17:14:51.110748+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:14:51.110748+0000","last_undegraded":"2024-09-12T17:14:51.110748+0000","last_fullsized":"2024-09-12T17:14:51.110748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:31.455841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799656+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:11:43.799656+0000","last_peered":"2024-09-12T17:11:43.799656+0000","last_clean":"2024-09-12T17:11:43.799656+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:11:43.799656+0000","last_undegraded":"2024-09-12T17:11:43.799656+0000","last_fullsized":"2024-09-12T17:11:43.799656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:40:05.933362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.399063+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:11:50.399063+0000","last_peered":"2024-09-12T17:11:50.399063+0000","last_clean":"2024-09-12T17:11:50.399063+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:11:50.399063+0000","last_undegraded":"2024-09-12T17:11:50.399063+0000","last_fullsized":"2024-09-12T17:11:50.399063+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:09.467743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699249+0000","last_change":"2024-09-12T17:11:06.700916+0000","last_active":"2024-09-12T17:14:19.699249+0000","last_peered":"2024-09-12T17:14:19.699249+0000","last_clean":"2024-09-12T17:14:19.699249+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:14:19.699249+0000","last_undegraded":"2024-09-12T17:14:19.699249+0000","last_fullsized":"2024-09-12T17:14:19.699249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:56.220377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.299261+0000","last_change":"2024-09-12T17:15:12.299261+0000","last_active":"2024-09-12T17:15:12.299261+0000","last_peered":"2024-09-12T17:15:12.299261+0000","last_clean":"2024-09-12T17:15:12.299261+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:15:12.299261+0000","last_undegraded":"2024-09-12T17:15:12.299261+0000","last_fullsized":"2024-09-12T17:15:12.299261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.299076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:16.946359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.820323+0000","last_change":"2024-09-12T17:11:08.715453+0000","last_active":"2024-09-12T17:14:50.820323+0000","last_peered":"2024-09-12T17:14:50.820323+0000","last_clean":"2024-09-12T17:14:50.820323+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:14:50.820323+0000","last_undegraded":"2024-09-12T17:14:50.820323+0000","last_fullsized":"2024-09-12T17:14:50.820323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:50.106634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.159179+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:14:51.159179+0000","last_peered":"2024-09-12T17:14:51.159179+0000","last_clean":"2024-09-12T17:14:51.159179+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:14:51.159179+0000","last_undegraded":"2024-09-12T17:14:51.159179+0000","last_fullsized":"2024-09-12T17:14:51.159179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.386759+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.386759+0000","last_peered":"2024-09-12T17:13:16.386759+0000","last_clean":"2024-09-12T17:13:16.386759+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.386759+0000","last_undegraded":"2024-09-12T17:13:16.386759+0000","last_fullsized":"2024-09-12T17:13:16.386759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807517+0000","last_change":"2024-09-12T17:11:06.701681+0000","last_active":"2024-09-12T17:11:43.807517+0000","last_peered":"2024-09-12T17:11:43.807517+0000","last_clean":"2024-09-12T17:11:43.807517+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:11:43.807517+0000","last_undegraded":"2024-09-12T17:11:43.807517+0000","last_fullsized":"2024-09-12T17:11:43.807517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:16.143106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.314071+0000","last_change":"2024-09-12T17:15:02.314071+0000","last_active":"2024-09-12T17:15:02.314071+0000","last_peered":"2024-09-12T17:15:02.314071+0000","last_clean":"2024-09-12T17:15:02.314071+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:15:02.314071+0000","last_undegraded":"2024-09-12T17:15:02.314071+0000","last_fullsized":"2024-09-12T17:15:02.314071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.313786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:05.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.590855+0000","last_change":"2024-09-12T17:15:11.590855+0000","last_active":"2024-09-12T17:15:11.590855+0000","last_peered":"2024-09-12T17:15:11.590855+0000","last_clean":"2024-09-12T17:15:11.590855+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:15:11.590855+0000","last_undegraded":"2024-09-12T17:15:11.590855+0000","last_fullsized":"2024-09-12T17:15:11.590855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.590645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:52.146542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.289858+0000","last_change":"2024-09-12T17:15:03.289858+0000","last_active":"2024-09-12T17:15:03.289858+0000","last_peered":"2024-09-12T17:15:03.289858+0000","last_clean":"2024-09-12T17:15:03.289858+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:15:03.289858+0000","last_undegraded":"2024-09-12T17:15:03.289858+0000","last_fullsized":"2024-09-12T17:15:03.289858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.289669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.942393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790045+0000","last_change":"2024-09-12T17:11:08.715785+0000","last_active":"2024-09-12T17:11:43.790045+0000","last_peered":"2024-09-12T17:11:43.790045+0000","last_clean":"2024-09-12T17:11:43.790045+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:11:43.790045+0000","last_undegraded":"2024-09-12T17:11:43.790045+0000","last_fullsized":"2024-09-12T17:11:43.790045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:51.935358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.069455+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:51.069455+0000","last_peered":"2024-09-12T17:14:51.069455+0000","last_clean":"2024-09-12T17:14:51.069455+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:51.069455+0000","last_undegraded":"2024-09-12T17:14:51.069455+0000","last_fullsized":"2024-09-12T17:14:51.069455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.789528+0000","last_change":"2024-09-12T17:11:06.689927+0000","last_active":"2024-09-12T17:14:19.789528+0000","last_peered":"2024-09-12T17:14:19.789528+0000","last_clean":"2024-09-12T17:14:19.789528+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:14:19.789528+0000","last_undegraded":"2024-09-12T17:14:19.789528+0000","last_fullsized":"2024-09-12T17:14:19.789528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:00.453472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.890548+0000","last_change":"2024-09-12T17:14:58.890548+0000","last_active":"2024-09-12T17:14:58.890548+0000","last_peered":"2024-09-12T17:14:58.890548+0000","last_clean":"2024-09-12T17:14:58.890548+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:14:58.890548+0000","last_undegraded":"2024-09-12T17:14:58.890548+0000","last_fullsized":"2024-09-12T17:14:58.890548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.890365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:09.596280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.049859+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:14:51.049859+0000","last_peered":"2024-09-12T17:14:51.049859+0000","last_clean":"2024-09-12T17:14:51.049859+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:14:51.049859+0000","last_undegraded":"2024-09-12T17:14:51.049859+0000","last_fullsized":"2024-09-12T17:14:51.049859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.874185+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.874185+0000","last_peered":"2024-09-12T17:14:19.874185+0000","last_clean":"2024-09-12T17:14:19.874185+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.874185+0000","last_undegraded":"2024-09-12T17:14:19.874185+0000","last_fullsized":"2024-09-12T17:14:19.874185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:15.972646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.279239+0000","last_change":"2024-09-12T17:15:09.279239+0000","last_active":"2024-09-12T17:15:09.279239+0000","last_peered":"2024-09-12T17:15:09.279239+0000","last_clean":"2024-09-12T17:15:09.279239+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:15:09.279239+0000","last_undegraded":"2024-09-12T17:15:09.279239+0000","last_fullsized":"2024-09-12T17:15:09.279239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.279045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:06.707329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:08.757291+0000","last_change":"2024-09-12T17:11:08.711173+0000","last_active":"2024-09-12T17:13:08.757291+0000","last_peered":"2024-09-12T17:13:08.757291+0000","last_clean":"2024-09-12T17:13:08.757291+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:13:08.757291+0000","last_undegraded":"2024-09-12T17:13:08.757291+0000","last_fullsized":"2024-09-12T17:13:08.757291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.043008+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:14:51.043008+0000","last_peered":"2024-09-12T17:14:51.043008+0000","last_clean":"2024-09-12T17:14:51.043008+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:14:51.043008+0000","last_undegraded":"2024-09-12T17:14:51.043008+0000","last_fullsized":"2024-09-12T17:14:51.043008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805821+0000","last_change":"2024-09-12T17:11:06.709521+0000","last_active":"2024-09-12T17:14:19.805821+0000","last_peered":"2024-09-12T17:14:19.805821+0000","last_clean":"2024-09-12T17:14:19.805821+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:14:19.805821+0000","last_undegraded":"2024-09-12T17:14:19.805821+0000","last_fullsized":"2024-09-12T17:14:19.805821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.891960+0000","last_change":"2024-09-12T17:14:59.891960+0000","last_active":"2024-09-12T17:14:59.891960+0000","last_peered":"2024-09-12T17:14:59.891960+0000","last_clean":"2024-09-12T17:14:59.891960+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:14:59.891960+0000","last_undegraded":"2024-09-12T17:14:59.891960+0000","last_fullsized":"2024-09-12T17:14:59.891960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.891778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:26.957401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814579+0000","last_change":"2024-09-12T17:11:43.809305+0000","last_active":"2024-09-12T17:11:43.814579+0000","last_peered":"2024-09-12T17:11:43.814579+0000","last_clean":"2024-09-12T17:11:43.814579+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:11:43.814579+0000","last_undegraded":"2024-09-12T17:11:43.814579+0000","last_fullsized":"2024-09-12T17:11:43.814579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:04.779608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.055782+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:14:51.055782+0000","last_peered":"2024-09-12T17:14:51.055782+0000","last_clean":"2024-09-12T17:14:51.055782+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:14:51.055782+0000","last_undegraded":"2024-09-12T17:14:51.055782+0000","last_fullsized":"2024-09-12T17:14:51.055782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.349327+0000","last_change":"2024-09-12T17:11:06.709586+0000","last_active":"2024-09-12T17:14:19.349327+0000","last_peered":"2024-09-12T17:14:19.349327+0000","last_clean":"2024-09-12T17:14:19.349327+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:14:19.349327+0000","last_undegraded":"2024-09-12T17:14:19.349327+0000","last_fullsized":"2024-09-12T17:14:19.349327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:43.877851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.858355+0000","last_change":"2024-09-12T17:15:02.858355+0000","last_active":"2024-09-12T17:15:02.858355+0000","last_peered":"2024-09-12T17:15:02.858355+0000","last_clean":"2024-09-12T17:15:02.858355+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:15:02.858355+0000","last_undegraded":"2024-09-12T17:15:02.858355+0000","last_fullsized":"2024-09-12T17:15:02.858355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.858176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:23.000373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.795517+0000","last_change":"2024-09-12T17:11:08.714321+0000","last_active":"2024-09-12T17:11:43.795517+0000","last_peered":"2024-09-12T17:11:43.795517+0000","last_clean":"2024-09-12T17:11:43.795517+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:11:43.795517+0000","last_undegraded":"2024-09-12T17:11:43.795517+0000","last_fullsized":"2024-09-12T17:11:43.795517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.528516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.191110+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:14:51.191110+0000","last_peered":"2024-09-12T17:14:51.191110+0000","last_clean":"2024-09-12T17:14:51.191110+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:14:51.191110+0000","last_undegraded":"2024-09-12T17:14:51.191110+0000","last_fullsized":"2024-09-12T17:14:51.191110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:55.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758549+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:13:13.758549+0000","last_peered":"2024-09-12T17:13:13.758549+0000","last_clean":"2024-09-12T17:13:13.758549+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:13:13.758549+0000","last_undegraded":"2024-09-12T17:13:13.758549+0000","last_fullsized":"2024-09-12T17:13:13.758549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.732083+0000","last_change":"2024-09-12T17:11:06.701691+0000","last_active":"2024-09-12T17:13:18.732083+0000","last_peered":"2024-09-12T17:13:18.732083+0000","last_clean":"2024-09-12T17:13:18.732083+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:13:18.732083+0000","last_undegraded":"2024-09-12T17:13:18.732083+0000","last_fullsized":"2024-09-12T17:13:18.732083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:07.167115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.275775+0000","last_change":"2024-09-12T17:15:11.275775+0000","last_active":"2024-09-12T17:15:11.275775+0000","last_peered":"2024-09-12T17:15:11.275775+0000","last_clean":"2024-09-12T17:15:11.275775+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:15:11.275775+0000","last_undegraded":"2024-09-12T17:15:11.275775+0000","last_fullsized":"2024-09-12T17:15:11.275775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.275550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.702407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.791268+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:13:09.791268+0000","last_peered":"2024-09-12T17:13:09.791268+0000","last_clean":"2024-09-12T17:13:09.791268+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:13:09.791268+0000","last_undegraded":"2024-09-12T17:13:09.791268+0000","last_fullsized":"2024-09-12T17:13:09.791268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":377,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.855453+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:50.855453+0000","last_peered":"2024-09-12T17:14:50.855453+0000","last_clean":"2024-09-12T17:14:50.855453+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:50.855453+0000","last_undegraded":"2024-09-12T17:14:50.855453+0000","last_fullsized":"2024-09-12T17:14:50.855453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:30:05.585547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.999516+0000","last_change":"2024-09-12T17:11:06.691786+0000","last_active":"2024-09-12T17:12:33.999516+0000","last_peered":"2024-09-12T17:12:33.999516+0000","last_clean":"2024-09-12T17:12:33.999516+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:12:33.999516+0000","last_undegraded":"2024-09-12T17:12:33.999516+0000","last_fullsized":"2024-09-12T17:12:33.999516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:57.050067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.864639+0000","last_change":"2024-09-12T17:15:00.864639+0000","last_active":"2024-09-12T17:15:00.864639+0000","last_peered":"2024-09-12T17:15:00.864639+0000","last_clean":"2024-09-12T17:15:00.864639+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:15:00.864639+0000","last_undegraded":"2024-09-12T17:15:00.864639+0000","last_fullsized":"2024-09-12T17:15:00.864639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.864442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:24.991687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.996107+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:14:50.996107+0000","last_peered":"2024-09-12T17:14:50.996107+0000","last_clean":"2024-09-12T17:14:50.996107+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:14:50.996107+0000","last_undegraded":"2024-09-12T17:14:50.996107+0000","last_fullsized":"2024-09-12T17:14:50.996107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.685021+0000","last_change":"2024-09-12T17:11:06.693085+0000","last_active":"2024-09-12T17:12:33.685021+0000","last_peered":"2024-09-12T17:12:33.685021+0000","last_clean":"2024-09-12T17:12:33.685021+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:12:33.685021+0000","last_undegraded":"2024-09-12T17:12:33.685021+0000","last_fullsized":"2024-09-12T17:12:33.685021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:49.484642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.285556+0000","last_change":"2024-09-12T17:15:10.285556+0000","last_active":"2024-09-12T17:15:10.285556+0000","last_peered":"2024-09-12T17:15:10.285556+0000","last_clean":"2024-09-12T17:15:10.285556+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:15:10.285556+0000","last_undegraded":"2024-09-12T17:15:10.285556+0000","last_fullsized":"2024-09-12T17:15:10.285556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.285362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:12.449928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794217+0000","last_change":"2024-09-12T17:11:08.716093+0000","last_active":"2024-09-12T17:11:43.794217+0000","last_peered":"2024-09-12T17:11:43.794217+0000","last_clean":"2024-09-12T17:11:43.794217+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:11:43.794217+0000","last_undegraded":"2024-09-12T17:11:43.794217+0000","last_fullsized":"2024-09-12T17:11:43.794217+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:18.912768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.004291+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:14:51.004291+0000","last_peered":"2024-09-12T17:14:51.004291+0000","last_clean":"2024-09-12T17:14:51.004291+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.004291+0000","last_undegraded":"2024-09-12T17:14:51.004291+0000","last_fullsized":"2024-09-12T17:14:51.004291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.791235+0000","last_change":"2024-09-12T17:11:43.823977+0000","last_active":"2024-09-12T17:14:19.791235+0000","last_peered":"2024-09-12T17:14:19.791235+0000","last_clean":"2024-09-12T17:14:19.791235+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:14:19.791235+0000","last_undegraded":"2024-09-12T17:14:19.791235+0000","last_fullsized":"2024-09-12T17:14:19.791235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:25.321871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.581681+0000","last_change":"2024-09-12T17:14:58.581536+0000","last_active":"2024-09-12T17:14:58.581681+0000","last_peered":"2024-09-12T17:14:58.581681+0000","last_clean":"2024-09-12T17:14:58.581681+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:14:58.581681+0000","last_undegraded":"2024-09-12T17:14:58.581681+0000","last_fullsized":"2024-09-12T17:14:58.581681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.581351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:14.075025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.819650+0000","last_change":"2024-09-12T17:11:08.722764+0000","last_active":"2024-09-12T17:14:50.819650+0000","last_peered":"2024-09-12T17:14:50.819650+0000","last_clean":"2024-09-12T17:14:50.819650+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:14:50.819650+0000","last_undegraded":"2024-09-12T17:14:50.819650+0000","last_fullsized":"2024-09-12T17:14:50.819650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:27.090536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.173634+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:14:51.173634+0000","last_peered":"2024-09-12T17:14:51.173634+0000","last_clean":"2024-09-12T17:14:51.173634+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:14:51.173634+0000","last_undegraded":"2024-09-12T17:14:51.173634+0000","last_fullsized":"2024-09-12T17:14:51.173634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.699419+0000","last_change":"2024-09-12T17:11:06.689179+0000","last_active":"2024-09-12T17:14:19.699419+0000","last_peered":"2024-09-12T17:14:19.699419+0000","last_clean":"2024-09-12T17:14:19.699419+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:14:19.699419+0000","last_undegraded":"2024-09-12T17:14:19.699419+0000","last_fullsized":"2024-09-12T17:14:19.699419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:40:38.719846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.868010+0000","last_change":"2024-09-12T17:15:01.867847+0000","last_active":"2024-09-12T17:15:01.868010+0000","last_peered":"2024-09-12T17:15:01.868010+0000","last_clean":"2024-09-12T17:15:01.868010+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:15:01.868010+0000","last_undegraded":"2024-09-12T17:15:01.868010+0000","last_fullsized":"2024-09-12T17:15:01.868010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.867668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.434128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.945459+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:50.945459+0000","last_peered":"2024-09-12T17:14:50.945459+0000","last_clean":"2024-09-12T17:14:50.945459+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:50.945459+0000","last_undegraded":"2024-09-12T17:14:50.945459+0000","last_fullsized":"2024-09-12T17:14:50.945459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.821261+0000","last_change":"2024-09-12T17:11:06.707086+0000","last_active":"2024-09-12T17:11:43.821261+0000","last_peered":"2024-09-12T17:11:43.821261+0000","last_clean":"2024-09-12T17:11:43.821261+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:11:43.821261+0000","last_undegraded":"2024-09-12T17:11:43.821261+0000","last_fullsized":"2024-09-12T17:11:43.821261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:01:22.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.238547+0000","last_change":"2024-09-12T17:15:05.238547+0000","last_active":"2024-09-12T17:15:05.238547+0000","last_peered":"2024-09-12T17:15:05.238547+0000","last_clean":"2024-09-12T17:15:05.238547+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:15:05.238547+0000","last_undegraded":"2024-09-12T17:15:05.238547+0000","last_fullsized":"2024-09-12T17:15:05.238547+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.238353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:56.750159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.730752+0000","last_change":"2024-09-12T17:11:06.700232+0000","last_active":"2024-09-12T17:13:18.730752+0000","last_peered":"2024-09-12T17:13:18.730752+0000","last_clean":"2024-09-12T17:13:18.730752+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:13:18.730752+0000","last_undegraded":"2024-09-12T17:13:18.730752+0000","last_fullsized":"2024-09-12T17:13:18.730752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:44.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.616378+0000","last_change":"2024-09-12T17:15:02.616092+0000","last_active":"2024-09-12T17:15:02.616378+0000","last_peered":"2024-09-12T17:15:02.616378+0000","last_clean":"2024-09-12T17:15:02.616378+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:15:02.616378+0000","last_undegraded":"2024-09-12T17:15:02.616378+0000","last_fullsized":"2024-09-12T17:15:02.616378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.615816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.024352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.367423+0000","last_change":"2024-09-12T17:11:06.695274+0000","last_active":"2024-09-12T17:14:19.367423+0000","last_peered":"2024-09-12T17:14:19.367423+0000","last_clean":"2024-09-12T17:14:19.367423+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:14:19.367423+0000","last_undegraded":"2024-09-12T17:14:19.367423+0000","last_fullsized":"2024-09-12T17:14:19.367423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:25.138206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.284536+0000","last_change":"2024-09-12T17:15:13.284400+0000","last_active":"2024-09-12T17:15:13.284536+0000","last_peered":"2024-09-12T17:15:13.284536+0000","last_clean":"2024-09-12T17:15:13.284536+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:15:13.284536+0000","last_undegraded":"2024-09-12T17:15:13.284536+0000","last_fullsized":"2024-09-12T17:15:13.284536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.284187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:57.850098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759765+0000","last_change":"2024-09-12T17:11:06.703392+0000","last_active":"2024-09-12T17:13:18.759765+0000","last_peered":"2024-09-12T17:13:18.759765+0000","last_clean":"2024-09-12T17:13:18.759765+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:13:18.759765+0000","last_undegraded":"2024-09-12T17:13:18.759765+0000","last_fullsized":"2024-09-12T17:13:18.759765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:45.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.567132+0000","last_change":"2024-09-12T17:15:03.566984+0000","last_active":"2024-09-12T17:15:03.567132+0000","last_peered":"2024-09-12T17:15:03.567132+0000","last_clean":"2024-09-12T17:15:03.567132+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:15:03.567132+0000","last_undegraded":"2024-09-12T17:15:03.567132+0000","last_fullsized":"2024-09-12T17:15:03.567132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.566768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:47.560762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799093+0000","last_change":"2024-09-12T17:11:06.702655+0000","last_active":"2024-09-12T17:11:43.799093+0000","last_peered":"2024-09-12T17:11:43.799093+0000","last_clean":"2024-09-12T17:11:43.799093+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:11:43.799093+0000","last_undegraded":"2024-09-12T17:11:43.799093+0000","last_fullsized":"2024-09-12T17:11:43.799093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:12.524592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.571415+0000","last_change":"2024-09-12T17:15:04.571415+0000","last_active":"2024-09-12T17:15:04.571415+0000","last_peered":"2024-09-12T17:15:04.571415+0000","last_clean":"2024-09-12T17:15:04.571415+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:15:04.571415+0000","last_undegraded":"2024-09-12T17:15:04.571415+0000","last_fullsized":"2024-09-12T17:15:04.571415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.571227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:38.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.494618+0000","last_change":"2024-09-12T17:11:06.706847+0000","last_active":"2024-09-12T17:14:19.494618+0000","last_peered":"2024-09-12T17:14:19.494618+0000","last_clean":"2024-09-12T17:14:19.494618+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:14:19.494618+0000","last_undegraded":"2024-09-12T17:14:19.494618+0000","last_fullsized":"2024-09-12T17:14:19.494618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:47.985955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.875105+0000","last_change":"2024-09-12T17:15:03.875105+0000","last_active":"2024-09-12T17:15:03.875105+0000","last_peered":"2024-09-12T17:15:03.875105+0000","last_clean":"2024-09-12T17:15:03.875105+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:15:03.875105+0000","last_undegraded":"2024-09-12T17:15:03.875105+0000","last_fullsized":"2024-09-12T17:15:03.875105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.874897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:32.945371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'1","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758256+0000","last_change":"2024-09-12T17:11:06.699610+0000","last_active":"2024-09-12T17:13:13.758256+0000","last_peered":"2024-09-12T17:13:13.758256+0000","last_clean":"2024-09-12T17:13:13.758256+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:13:13.758256+0000","last_undegraded":"2024-09-12T17:13:13.758256+0000","last_fullsized":"2024-09-12T17:13:13.758256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:08.231580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.247188+0000","last_change":"2024-09-12T17:15:04.247188+0000","last_active":"2024-09-12T17:15:04.247188+0000","last_peered":"2024-09-12T17:15:04.247188+0000","last_clean":"2024-09-12T17:15:04.247188+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:15:04.247188+0000","last_undegraded":"2024-09-12T17:15:04.247188+0000","last_fullsized":"2024-09-12T17:15:04.247188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.247001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:40.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788842+0000","last_change":"2024-09-12T17:11:06.697920+0000","last_active":"2024-09-12T17:14:19.788842+0000","last_peered":"2024-09-12T17:14:19.788842+0000","last_clean":"2024-09-12T17:14:19.788842+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:14:19.788842+0000","last_undegraded":"2024-09-12T17:14:19.788842+0000","last_fullsized":"2024-09-12T17:14:19.788842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:41.481908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.597274+0000","last_change":"2024-09-12T17:15:05.597274+0000","last_active":"2024-09-12T17:15:05.597274+0000","last_peered":"2024-09-12T17:15:05.597274+0000","last_clean":"2024-09-12T17:15:05.597274+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:15:05.597274+0000","last_undegraded":"2024-09-12T17:15:05.597274+0000","last_fullsized":"2024-09-12T17:15:05.597274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.597076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.669536+0000","last_change":"2024-09-12T17:11:06.703492+0000","last_active":"2024-09-12T17:13:14.669536+0000","last_peered":"2024-09-12T17:13:14.669536+0000","last_clean":"2024-09-12T17:13:14.669536+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:13:14.669536+0000","last_undegraded":"2024-09-12T17:13:14.669536+0000","last_fullsized":"2024-09-12T17:13:14.669536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:20:33.304445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.277545+0000","last_change":"2024-09-12T17:15:14.277545+0000","last_active":"2024-09-12T17:15:14.277545+0000","last_peered":"2024-09-12T17:15:14.277545+0000","last_clean":"2024-09-12T17:15:14.277545+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:15:14.277545+0000","last_undegraded":"2024-09-12T17:15:14.277545+0000","last_fullsized":"2024-09-12T17:15:14.277545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.277335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.472821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.549362+0000","last_change":"2024-09-12T17:15:06.549362+0000","last_active":"2024-09-12T17:15:06.549362+0000","last_peered":"2024-09-12T17:15:06.549362+0000","last_clean":"2024-09-12T17:15:06.549362+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:15:06.549362+0000","last_undegraded":"2024-09-12T17:15:06.549362+0000","last_fullsized":"2024-09-12T17:15:06.549362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.549179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:02.554930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491265+0000","last_change":"2024-09-12T17:11:06.702748+0000","last_active":"2024-09-12T17:14:19.491265+0000","last_peered":"2024-09-12T17:14:19.491265+0000","last_clean":"2024-09-12T17:14:19.491265+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:14:19.491265+0000","last_undegraded":"2024-09-12T17:14:19.491265+0000","last_fullsized":"2024-09-12T17:14:19.491265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:51.189029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.916380+0000","last_change":"2024-09-12T17:15:04.916380+0000","last_active":"2024-09-12T17:15:04.916380+0000","last_peered":"2024-09-12T17:15:04.916380+0000","last_clean":"2024-09-12T17:15:04.916380+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:15:04.916380+0000","last_undegraded":"2024-09-12T17:15:04.916380+0000","last_fullsized":"2024-09-12T17:15:04.916380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.916186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:14.335123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'19","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.719500+0000","last_change":"2024-09-12T17:11:06.697799+0000","last_active":"2024-09-12T17:14:19.719500+0000","last_peered":"2024-09-12T17:14:19.719500+0000","last_clean":"2024-09-12T17:14:19.719500+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:14:19.719500+0000","last_undegraded":"2024-09-12T17:14:19.719500+0000","last_fullsized":"2024-09-12T17:14:19.719500+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:51.237525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.892750+0000","last_change":"2024-09-12T17:15:05.892750+0000","last_active":"2024-09-12T17:15:05.892750+0000","last_peered":"2024-09-12T17:15:05.892750+0000","last_clean":"2024-09-12T17:15:05.892750+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:15:05.892750+0000","last_undegraded":"2024-09-12T17:15:05.892750+0000","last_fullsized":"2024-09-12T17:15:05.892750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.892542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.813883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856748+0000","last_change":"2024-09-12T17:11:06.706910+0000","last_active":"2024-09-12T17:14:19.856748+0000","last_peered":"2024-09-12T17:14:19.856748+0000","last_clean":"2024-09-12T17:14:19.856748+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:14:19.856748+0000","last_undegraded":"2024-09-12T17:14:19.856748+0000","last_fullsized":"2024-09-12T17:14:19.856748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:45:09.726713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.255243+0000","last_change":"2024-09-12T17:11:04.698962+0000","last_active":"2024-09-12T17:11:49.255243+0000","last_peered":"2024-09-12T17:11:49.255243+0000","last_clean":"2024-09-12T17:11:49.255243+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:11:49.255243+0000","last_undegraded":"2024-09-12T17:11:49.255243+0000","last_fullsized":"2024-09-12T17:11:49.255243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:58.287096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856816+0000","last_change":"2024-09-12T17:11:06.698579+0000","last_active":"2024-09-12T17:14:19.856816+0000","last_peered":"2024-09-12T17:14:19.856816+0000","last_clean":"2024-09-12T17:14:19.856816+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:14:19.856816+0000","last_undegraded":"2024-09-12T17:14:19.856816+0000","last_fullsized":"2024-09-12T17:14:19.856816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:02.305167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.810471+0000","last_change":"2024-09-12T17:11:04.706258+0000","last_active":"2024-09-12T17:11:43.810471+0000","last_peered":"2024-09-12T17:11:43.810471+0000","last_clean":"2024-09-12T17:11:43.810471+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:11:43.810471+0000","last_undegraded":"2024-09-12T17:11:43.810471+0000","last_fullsized":"2024-09-12T17:11:43.810471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:51.595508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.856680+0000","last_change":"2024-09-12T17:11:43.799543+0000","last_active":"2024-09-12T17:14:19.856680+0000","last_peered":"2024-09-12T17:14:19.856680+0000","last_clean":"2024-09-12T17:14:19.856680+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:14:19.856680+0000","last_undegraded":"2024-09-12T17:14:19.856680+0000","last_fullsized":"2024-09-12T17:14:19.856680+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:03.634562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.206386+0000","last_change":"2024-09-12T17:15:06.206386+0000","last_active":"2024-09-12T17:15:06.206386+0000","last_peered":"2024-09-12T17:15:06.206386+0000","last_clean":"2024-09-12T17:15:06.206386+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:15:06.206386+0000","last_undegraded":"2024-09-12T17:15:06.206386+0000","last_fullsized":"2024-09-12T17:15:06.206386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.206190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:25.118231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.491662+0000","last_change":"2024-09-12T17:11:06.692150+0000","last_active":"2024-09-12T17:14:19.491662+0000","last_peered":"2024-09-12T17:14:19.491662+0000","last_clean":"2024-09-12T17:14:19.491662+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:14:19.491662+0000","last_undegraded":"2024-09-12T17:14:19.491662+0000","last_fullsized":"2024-09-12T17:14:19.491662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:03.537778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.818404+0000","last_change":"2024-09-12T17:11:04.699011+0000","last_active":"2024-09-12T17:11:43.818404+0000","last_peered":"2024-09-12T17:11:43.818404+0000","last_clean":"2024-09-12T17:11:43.818404+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:11:43.818404+0000","last_undegraded":"2024-09-12T17:11:43.818404+0000","last_fullsized":"2024-09-12T17:11:43.818404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:22.663093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.129572+0000","last_change":"2024-09-12T17:11:04.699035+0000","last_active":"2024-09-12T17:14:19.129572+0000","last_peered":"2024-09-12T17:14:19.129572+0000","last_clean":"2024-09-12T17:14:19.129572+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:14:19.129572+0000","last_undegraded":"2024-09-12T17:14:19.129572+0000","last_fullsized":"2024-09-12T17:14:19.129572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:03.636512+0000","last_clean_scrub_stamp":"2024-09-12T17:11:03.636512+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:14.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.788135+0000","last_change":"2024-09-12T17:11:06.699450+0000","last_active":"2024-09-12T17:14:19.788135+0000","last_peered":"2024-09-12T17:14:19.788135+0000","last_clean":"2024-09-12T17:14:19.788135+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:14:19.788135+0000","last_undegraded":"2024-09-12T17:14:19.788135+0000","last_fullsized":"2024-09-12T17:14:19.788135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.494877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.598077+0000","last_change":"2024-09-12T17:15:07.598077+0000","last_active":"2024-09-12T17:15:07.598077+0000","last_peered":"2024-09-12T17:15:07.598077+0000","last_clean":"2024-09-12T17:15:07.598077+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:15:07.598077+0000","last_undegraded":"2024-09-12T17:15:07.598077+0000","last_fullsized":"2024-09-12T17:15:07.598077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.597893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:32.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.735133+0000","last_change":"2024-09-12T17:11:06.707075+0000","last_active":"2024-09-12T17:13:18.735133+0000","last_peered":"2024-09-12T17:13:18.735133+0000","last_clean":"2024-09-12T17:13:18.735133+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:13:18.735133+0000","last_undegraded":"2024-09-12T17:13:18.735133+0000","last_fullsized":"2024-09-12T17:13:18.735133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:46.709626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":474,"ondisk_log_size":474,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640314,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640314,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335484,"statfs":{"total":96636764160,"available":96599535616,"internally_reserved":0,"allocated":1036288,"data_stored":740928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673018,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705721,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.960 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.961 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.962 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.963 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.964 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.965 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.966 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.967 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.968 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.969 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.970 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.971 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.972 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.973 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.974 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.975 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.976 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.977 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.978 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.979 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.980 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.981 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.982 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:11:03.636512+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.983 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.983 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:16.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:15:36.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:15:37.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f9337b19640 1 Processor -- start 2024-09-12T17:15:37.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f9337b19640 1 -- start start 2024-09-12T17:15:37.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f9337b19640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9330111890 0x7f9330134750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:37.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f9337b19640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9330112730 con 0x7f9330110da0 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f9337b19640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9330073a90 con 0x7f9330111890 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f93350b4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9330111890 0x7f9330134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f93350b4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9330111890 0x7f9330134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51896/0 (socket says 172.21.15.62:51896) 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f93350b4640 1 -- 172.21.15.62:0/2340063744 learned_addr learned my addr 172.21.15.62:0/2340063744 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f93350b4640 1 -- 172.21.15.62:0/2340063744 >> v1:172.21.15.62:6789/0 conn(0x7f9330110da0 legacy=0x7f9330111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:37.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.118+0000 7f93350b4640 1 -- 172.21.15.62:0/2340063744 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9330112b70 con 0x7f9330111890 2024-09-12T17:15:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93350b4640 1 --2- 172.21.15.62:0/2340063744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330111890 0x7f9330134750 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9324009e50 tx=0x7f932401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37b23c7c4eb29a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93348b3640 1 -- 172.21.15.62:0/2340063744 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9324009200 con 0x7f9330111890 2024-09-12T17:15:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93348b3640 1 -- 172.21.15.62:0/2340063744 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93240a55c0 con 0x7f9330111890 2024-09-12T17:15:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93348b3640 1 -- 172.21.15.62:0/2340063744 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93240a58c0 con 0x7f9330111890 2024-09-12T17:15:37.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- 172.21.15.62:0/2340063744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330111890 msgr2=0x7f9330134750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 --2- 172.21.15.62:0/2340063744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330111890 0x7f9330134750 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f9324009e50 tx=0x7f932401c980 comp rx=0 tx=0).stop 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- 172.21.15.62:0/2340063744 shutdown_connections 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 --2- 172.21.15.62:0/2340063744 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330111890 0x7f9330134750 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- 172.21.15.62:0/2340063744 >> 172.21.15.62:0/2340063744 conn(0x7f9330070900 msgr2=0x7f9330072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- 172.21.15.62:0/2340063744 shutdown_connections 2024-09-12T17:15:37.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- 172.21.15.62:0/2340063744 wait complete. 2024-09-12T17:15:37.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 Processor -- start 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- start start 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f9337b19640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9330137840 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93358b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93358b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51902/0 (socket says 172.21.15.62:51902) 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93358b5640 1 -- 172.21.15.62:0/3566875575 learned_addr learned my addr 172.21.15.62:0/3566875575 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.122+0000 7f93358b5640 1 -- 172.21.15.62:0/3566875575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9330114400 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f93358b5640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f932800c430 tx=0x7f932800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9328017070 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9328005200 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f933011e3b0 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9328003600 con 0x7f9330110da0 2024-09-12T17:15:37.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f933012bda0 con 0x7f9330110da0 2024-09-12T17:15:37.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9330111180 con 0x7f9330110da0 2024-09-12T17:15:37.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f932801a070 con 0x7f9330110da0 2024-09-12T17:15:37.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 0x7f931c03d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:37.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f932804eae0 con 0x7f9330110da0 2024-09-12T17:15:37.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f93350b4640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 0x7f931c03d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:37.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.126+0000 7f93350b4640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 0x7f931c03d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93240ae000 tx=0x7f93240a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:37.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.130+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f9330112730 con 0x7f9330110da0 2024-09-12T17:15:37.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.298+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f933011dfa0 con 0x7f931c03b1d0 2024-09-12T17:15:37.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.330+0000 7f932e7fc640 1 -- 172.21.15.62:0/3566875575 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664401 (secure 0 0 0) 0x7f933011dfa0 con 0x7f931c03b1d0 2024-09-12T17:15:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:15:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 msgr2=0x7f931c03d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 0x7f931c03d690 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f93240ae000 tx=0x7f93240a7070 comp rx=0 tx=0).stop 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 msgr2=0x7f933012b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f932800c430 tx=0x7f932800c8f0 comp rx=0 tx=0).stop 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 shutdown_connections 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f931c03b1d0 0x7f931c03d690 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 --2- 172.21.15.62:0/3566875575 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9330110da0 0x7f933012b690 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 >> 172.21.15.62:0/3566875575 conn(0x7f9330070900 msgr2=0x7f9330072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 shutdown_connections 2024-09-12T17:15:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:37.334+0000 7f9337b19640 1 -- 172.21.15.62:0/3566875575 wait complete. 2024-09-12T17:15:37.357 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-12T17:15:36.802574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5148,"num_read_kb":4734,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4608,"ondisk_log_size":4608,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160928,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326432,"statfs":{"total":386547056640,"available":386382266368,"internally_reserved":0,"allocated":2981888,"data_stored":1783504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006660"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.201214+0000","last_change":"2024-09-12T17:15:10.201061+0000","last_active":"2024-09-12T17:15:10.201214+0000","last_peered":"2024-09-12T17:15:10.201214+0000","last_clean":"2024-09-12T17:15:10.201214+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:15:10.201214+0000","last_undegraded":"2024-09-12T17:15:10.201214+0000","last_fullsized":"2024-09-12T17:15:10.201214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.200874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:33.595229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.829156+0000","last_change":"2024-09-12T17:15:26.829156+0000","last_active":"2024-09-12T17:15:26.829156+0000","last_peered":"2024-09-12T17:15:26.829156+0000","last_clean":"2024-09-12T17:15:26.829156+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:15:26.829156+0000","last_undegraded":"2024-09-12T17:15:26.829156+0000","last_fullsized":"2024-09-12T17:15:26.829156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.828983+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:58.923967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.622651+0000","last_change":"2024-09-12T17:15:10.622455+0000","last_active":"2024-09-12T17:15:10.622651+0000","last_peered":"2024-09-12T17:15:10.622651+0000","last_clean":"2024-09-12T17:15:10.622651+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:15:10.622651+0000","last_undegraded":"2024-09-12T17:15:10.622651+0000","last_fullsized":"2024-09-12T17:15:10.622651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.622272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:24.192408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.800604+0000","last_change":"2024-09-12T17:11:06.689418+0000","last_active":"2024-09-12T17:11:43.800604+0000","last_peered":"2024-09-12T17:11:43.800604+0000","last_clean":"2024-09-12T17:11:43.800604+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:11:43.800604+0000","last_undegraded":"2024-09-12T17:11:43.800604+0000","last_fullsized":"2024-09-12T17:11:43.800604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:44.284831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.322131+0000","last_change":"2024-09-12T17:15:24.322131+0000","last_active":"2024-09-12T17:15:24.322131+0000","last_peered":"2024-09-12T17:15:24.322131+0000","last_clean":"2024-09-12T17:15:24.322131+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:15:24.322131+0000","last_undegraded":"2024-09-12T17:15:24.322131+0000","last_fullsized":"2024-09-12T17:15:24.322131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.321949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:20.438915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'5","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.805201+0000","last_change":"2024-09-12T17:11:06.691800+0000","last_active":"2024-09-12T17:14:19.805201+0000","last_peered":"2024-09-12T17:14:19.805201+0000","last_clean":"2024-09-12T17:14:19.805201+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:14:19.805201+0000","last_undegraded":"2024-09-12T17:14:19.805201+0000","last_fullsized":"2024-09-12T17:14:19.805201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:34.706587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.169692+0000","last_change":"2024-09-12T17:15:09.169692+0000","last_active":"2024-09-12T17:15:09.169692+0000","last_peered":"2024-09-12T17:15:09.169692+0000","last_clean":"2024-09-12T17:15:09.169692+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:15:09.169692+0000","last_undegraded":"2024-09-12T17:15:09.169692+0000","last_fullsized":"2024-09-12T17:15:09.169692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.169513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:40.605000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.167353+0000","last_change":"2024-09-12T17:15:21.167353+0000","last_active":"2024-09-12T17:15:21.167353+0000","last_peered":"2024-09-12T17:15:21.167353+0000","last_clean":"2024-09-12T17:15:21.167353+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:15:21.167353+0000","last_undegraded":"2024-09-12T17:15:21.167353+0000","last_fullsized":"2024-09-12T17:15:21.167353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.167170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:52.575705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.283073+0000","last_change":"2024-09-12T17:15:22.283073+0000","last_active":"2024-09-12T17:15:22.283073+0000","last_peered":"2024-09-12T17:15:22.283073+0000","last_clean":"2024-09-12T17:15:22.283073+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:15:22.283073+0000","last_undegraded":"2024-09-12T17:15:22.283073+0000","last_fullsized":"2024-09-12T17:15:22.283073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.282894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.208753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.854962+0000","last_change":"2024-09-12T17:15:27.854962+0000","last_active":"2024-09-12T17:15:27.854962+0000","last_peered":"2024-09-12T17:15:27.854962+0000","last_clean":"2024-09-12T17:15:27.854962+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:15:27.854962+0000","last_undegraded":"2024-09-12T17:15:27.854962+0000","last_fullsized":"2024-09-12T17:15:27.854962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.854752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:50.593286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.164616+0000","last_change":"2024-09-12T17:15:07.164616+0000","last_active":"2024-09-12T17:15:07.164616+0000","last_peered":"2024-09-12T17:15:07.164616+0000","last_clean":"2024-09-12T17:15:07.164616+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:15:07.164616+0000","last_undegraded":"2024-09-12T17:15:07.164616+0000","last_fullsized":"2024-09-12T17:15:07.164616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.164431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:00.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.806588+0000","last_change":"2024-09-12T17:11:06.708787+0000","last_active":"2024-09-12T17:14:19.806588+0000","last_peered":"2024-09-12T17:14:19.806588+0000","last_clean":"2024-09-12T17:14:19.806588+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:14:19.806588+0000","last_undegraded":"2024-09-12T17:14:19.806588+0000","last_fullsized":"2024-09-12T17:14:19.806588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.293319+0000","last_change":"2024-09-12T17:15:23.293319+0000","last_active":"2024-09-12T17:15:23.293319+0000","last_peered":"2024-09-12T17:15:23.293319+0000","last_clean":"2024-09-12T17:15:23.293319+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:15:23.293319+0000","last_undegraded":"2024-09-12T17:15:23.293319+0000","last_fullsized":"2024-09-12T17:15:23.293319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.293137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:49.114945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.127964+0000","last_change":"2024-09-12T17:15:23.127964+0000","last_active":"2024-09-12T17:15:23.127964+0000","last_peered":"2024-09-12T17:15:23.127964+0000","last_clean":"2024-09-12T17:15:23.127964+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:15:23.127964+0000","last_undegraded":"2024-09-12T17:15:23.127964+0000","last_fullsized":"2024-09-12T17:15:23.127964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.127781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:57.207825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.599330+0000","last_change":"2024-09-12T17:15:09.599330+0000","last_active":"2024-09-12T17:15:09.599330+0000","last_peered":"2024-09-12T17:15:09.599330+0000","last_clean":"2024-09-12T17:15:09.599330+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:15:09.599330+0000","last_undegraded":"2024-09-12T17:15:09.599330+0000","last_fullsized":"2024-09-12T17:15:09.599330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.599149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:05.569735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.044367+0000","last_change":"2024-09-12T17:15:25.044367+0000","last_active":"2024-09-12T17:15:25.044367+0000","last_peered":"2024-09-12T17:15:25.044367+0000","last_clean":"2024-09-12T17:15:25.044367+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:15:25.044367+0000","last_undegraded":"2024-09-12T17:15:25.044367+0000","last_fullsized":"2024-09-12T17:15:25.044367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.044184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.581742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'15","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796432+0000","last_change":"2024-09-12T17:11:06.693097+0000","last_active":"2024-09-12T17:13:29.796432+0000","last_peered":"2024-09-12T17:13:29.796432+0000","last_clean":"2024-09-12T17:13:29.796432+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:13:29.796432+0000","last_undegraded":"2024-09-12T17:13:29.796432+0000","last_fullsized":"2024-09-12T17:13:29.796432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:53.791846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.870146+0000","last_change":"2024-09-12T17:15:08.870146+0000","last_active":"2024-09-12T17:15:08.870146+0000","last_peered":"2024-09-12T17:15:08.870146+0000","last_clean":"2024-09-12T17:15:08.870146+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:15:08.870146+0000","last_undegraded":"2024-09-12T17:15:08.870146+0000","last_fullsized":"2024-09-12T17:15:08.870146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.869833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:16.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.845462+0000","last_change":"2024-09-12T17:15:23.845462+0000","last_active":"2024-09-12T17:15:23.845462+0000","last_peered":"2024-09-12T17:15:23.845462+0000","last_clean":"2024-09-12T17:15:23.845462+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:15:23.845462+0000","last_undegraded":"2024-09-12T17:15:23.845462+0000","last_fullsized":"2024-09-12T17:15:23.845462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.845288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.261304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.197517+0000","last_change":"2024-09-12T17:15:08.197517+0000","last_active":"2024-09-12T17:15:08.197517+0000","last_peered":"2024-09-12T17:15:08.197517+0000","last_clean":"2024-09-12T17:15:08.197517+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:15:08.197517+0000","last_undegraded":"2024-09-12T17:15:08.197517+0000","last_fullsized":"2024-09-12T17:15:08.197517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.197226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.048616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.879802+0000","last_change":"2024-09-12T17:15:24.879802+0000","last_active":"2024-09-12T17:15:24.879802+0000","last_peered":"2024-09-12T17:15:24.879802+0000","last_clean":"2024-09-12T17:15:24.879802+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:15:24.879802+0000","last_undegraded":"2024-09-12T17:15:24.879802+0000","last_fullsized":"2024-09-12T17:15:24.879802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.879626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:47.997644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.892541+0000","last_change":"2024-09-12T17:15:07.892541+0000","last_active":"2024-09-12T17:15:07.892541+0000","last_peered":"2024-09-12T17:15:07.892541+0000","last_clean":"2024-09-12T17:15:07.892541+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:15:07.892541+0000","last_undegraded":"2024-09-12T17:15:07.892541+0000","last_fullsized":"2024-09-12T17:15:07.892541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.892360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:31.964096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.648776+0000","last_change":"2024-09-12T17:15:23.648776+0000","last_active":"2024-09-12T17:15:23.648776+0000","last_peered":"2024-09-12T17:15:23.648776+0000","last_clean":"2024-09-12T17:15:23.648776+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:23.648776+0000","last_undegraded":"2024-09-12T17:15:23.648776+0000","last_fullsized":"2024-09-12T17:15:23.648776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.648589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:28.617881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.918374+0000","last_change":"2024-09-12T17:15:06.918374+0000","last_active":"2024-09-12T17:15:06.918374+0000","last_peered":"2024-09-12T17:15:06.918374+0000","last_clean":"2024-09-12T17:15:06.918374+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:15:06.918374+0000","last_undegraded":"2024-09-12T17:15:06.918374+0000","last_fullsized":"2024-09-12T17:15:06.918374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.918133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:39.266087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.163926+0000","last_change":"2024-09-12T17:15:22.163926+0000","last_active":"2024-09-12T17:15:22.163926+0000","last_peered":"2024-09-12T17:15:22.163926+0000","last_clean":"2024-09-12T17:15:22.163926+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:15:22.163926+0000","last_undegraded":"2024-09-12T17:15:22.163926+0000","last_fullsized":"2024-09-12T17:15:22.163926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.163684+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:25.007706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.559195+0000","last_change":"2024-09-12T17:15:08.559195+0000","last_active":"2024-09-12T17:15:08.559195+0000","last_peered":"2024-09-12T17:15:08.559195+0000","last_clean":"2024-09-12T17:15:08.559195+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:15:08.559195+0000","last_undegraded":"2024-09-12T17:15:08.559195+0000","last_fullsized":"2024-09-12T17:15:08.559195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.558975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.680852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.841423+0000","last_change":"2024-09-12T17:15:25.841423+0000","last_active":"2024-09-12T17:15:25.841423+0000","last_peered":"2024-09-12T17:15:25.841423+0000","last_clean":"2024-09-12T17:15:25.841423+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:25.841423+0000","last_undegraded":"2024-09-12T17:15:25.841423+0000","last_fullsized":"2024-09-12T17:15:25.841423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.841247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.853720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.329873+0000","last_change":"2024-09-12T17:15:19.329873+0000","last_active":"2024-09-12T17:15:19.329873+0000","last_peered":"2024-09-12T17:15:19.329873+0000","last_clean":"2024-09-12T17:15:19.329873+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:15:19.329873+0000","last_undegraded":"2024-09-12T17:15:19.329873+0000","last_fullsized":"2024-09-12T17:15:19.329873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.329648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:26.468038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.310675+0000","last_change":"2024-09-12T17:15:31.310675+0000","last_active":"2024-09-12T17:15:31.310675+0000","last_peered":"2024-09-12T17:15:31.310675+0000","last_clean":"2024-09-12T17:15:31.310675+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:15:31.310675+0000","last_undegraded":"2024-09-12T17:15:31.310675+0000","last_fullsized":"2024-09-12T17:15:31.310675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.310493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:52.984419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.263324+0000","last_change":"2024-09-12T17:15:08.263324+0000","last_active":"2024-09-12T17:15:08.263324+0000","last_peered":"2024-09-12T17:15:08.263324+0000","last_clean":"2024-09-12T17:15:08.263324+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:15:08.263324+0000","last_undegraded":"2024-09-12T17:15:08.263324+0000","last_fullsized":"2024-09-12T17:15:08.263324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.263141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:50.866547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809414+0000","last_change":"2024-09-12T17:11:08.727844+0000","last_active":"2024-09-12T17:11:43.809414+0000","last_peered":"2024-09-12T17:11:43.809414+0000","last_clean":"2024-09-12T17:11:43.809414+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:11:43.809414+0000","last_undegraded":"2024-09-12T17:11:43.809414+0000","last_fullsized":"2024-09-12T17:11:43.809414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:09.822958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.119433+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:14:51.119433+0000","last_peered":"2024-09-12T17:14:51.119433+0000","last_clean":"2024-09-12T17:14:51.119433+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:14:51.119433+0000","last_undegraded":"2024-09-12T17:14:51.119433+0000","last_fullsized":"2024-09-12T17:14:51.119433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820668+0000","last_change":"2024-09-12T17:11:12.754343+0000","last_active":"2024-09-12T17:11:43.820668+0000","last_peered":"2024-09-12T17:11:43.820668+0000","last_clean":"2024-09-12T17:11:43.820668+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:11:43.820668+0000","last_undegraded":"2024-09-12T17:11:43.820668+0000","last_fullsized":"2024-09-12T17:11:43.820668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:06.725744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.328446+0000","last_change":"2024-09-12T17:15:30.328446+0000","last_active":"2024-09-12T17:15:30.328446+0000","last_peered":"2024-09-12T17:15:30.328446+0000","last_clean":"2024-09-12T17:15:30.328446+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:15:30.328446+0000","last_undegraded":"2024-09-12T17:15:30.328446+0000","last_fullsized":"2024-09-12T17:15:30.328446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.328228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.601658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.272260+0000","last_change":"2024-09-12T17:15:01.272260+0000","last_active":"2024-09-12T17:15:01.272260+0000","last_peered":"2024-09-12T17:15:01.272260+0000","last_clean":"2024-09-12T17:15:01.272260+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:15:01.272260+0000","last_undegraded":"2024-09-12T17:15:01.272260+0000","last_fullsized":"2024-09-12T17:15:01.272260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.272070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:11.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.670135+0000","last_change":"2024-09-12T17:15:30.670135+0000","last_active":"2024-09-12T17:15:30.670135+0000","last_peered":"2024-09-12T17:15:30.670135+0000","last_clean":"2024-09-12T17:15:30.670135+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:15:30.670135+0000","last_undegraded":"2024-09-12T17:15:30.670135+0000","last_fullsized":"2024-09-12T17:15:30.670135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.669946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:54.167361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'7","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.689686+0000","last_change":"2024-09-12T17:11:10.724242+0000","last_active":"2024-09-12T17:12:33.689686+0000","last_peered":"2024-09-12T17:12:33.689686+0000","last_clean":"2024-09-12T17:12:33.689686+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:12:33.689686+0000","last_undegraded":"2024-09-12T17:12:33.689686+0000","last_fullsized":"2024-09-12T17:12:33.689686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:59.083232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815094+0000","last_change":"2024-09-12T17:11:12.755877+0000","last_active":"2024-09-12T17:11:43.815094+0000","last_peered":"2024-09-12T17:11:43.815094+0000","last_clean":"2024-09-12T17:11:43.815094+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:11:43.815094+0000","last_undegraded":"2024-09-12T17:11:43.815094+0000","last_fullsized":"2024-09-12T17:11:43.815094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:32.008769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.331908+0000","last_change":"2024-09-12T17:15:32.331908+0000","last_active":"2024-09-12T17:15:32.331908+0000","last_peered":"2024-09-12T17:15:32.331908+0000","last_clean":"2024-09-12T17:15:32.331908+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:15:32.331908+0000","last_undegraded":"2024-09-12T17:15:32.331908+0000","last_fullsized":"2024-09-12T17:15:32.331908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.331702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.106105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.310022+0000","last_change":"2024-09-12T17:15:07.310022+0000","last_active":"2024-09-12T17:15:07.310022+0000","last_peered":"2024-09-12T17:15:07.310022+0000","last_clean":"2024-09-12T17:15:07.310022+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:15:07.310022+0000","last_undegraded":"2024-09-12T17:15:07.310022+0000","last_fullsized":"2024-09-12T17:15:07.310022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.309797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:17.281335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.656874+0000","last_change":"2024-09-12T17:15:31.656874+0000","last_active":"2024-09-12T17:15:31.656874+0000","last_peered":"2024-09-12T17:15:31.656874+0000","last_clean":"2024-09-12T17:15:31.656874+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:15:31.656874+0000","last_undegraded":"2024-09-12T17:15:31.656874+0000","last_fullsized":"2024-09-12T17:15:31.656874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.656700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:53.215267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799602+0000","last_change":"2024-09-12T17:11:10.751979+0000","last_active":"2024-09-12T17:11:43.799602+0000","last_peered":"2024-09-12T17:11:43.799602+0000","last_clean":"2024-09-12T17:11:43.799602+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:11:43.799602+0000","last_undegraded":"2024-09-12T17:11:43.799602+0000","last_fullsized":"2024-09-12T17:11:43.799602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:00.147641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861195+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:50.861195+0000","last_peered":"2024-09-12T17:14:50.861195+0000","last_clean":"2024-09-12T17:14:50.861195+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:50.861195+0000","last_undegraded":"2024-09-12T17:14:50.861195+0000","last_fullsized":"2024-09-12T17:14:50.861195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.789350+0000","last_change":"2024-09-12T17:11:14.777729+0000","last_active":"2024-09-12T17:11:43.789350+0000","last_peered":"2024-09-12T17:11:43.789350+0000","last_clean":"2024-09-12T17:11:43.789350+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:11:43.789350+0000","last_undegraded":"2024-09-12T17:11:43.789350+0000","last_fullsized":"2024-09-12T17:11:43.789350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:01.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.646081+0000","last_change":"2024-09-12T17:15:13.646081+0000","last_active":"2024-09-12T17:15:13.646081+0000","last_peered":"2024-09-12T17:15:13.646081+0000","last_clean":"2024-09-12T17:15:13.646081+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:15:13.646081+0000","last_undegraded":"2024-09-12T17:15:13.646081+0000","last_fullsized":"2024-09-12T17:15:13.646081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.645895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.910932+0000","last_change":"2024-09-12T17:14:57.910932+0000","last_active":"2024-09-12T17:14:57.910932+0000","last_peered":"2024-09-12T17:14:57.910932+0000","last_clean":"2024-09-12T17:14:57.910932+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:14:57.910932+0000","last_undegraded":"2024-09-12T17:14:57.910932+0000","last_fullsized":"2024-09-12T17:14:57.910932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.910723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:55.914281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816480+0000","last_change":"2024-09-12T17:11:08.729376+0000","last_active":"2024-09-12T17:11:43.816480+0000","last_peered":"2024-09-12T17:11:43.816480+0000","last_clean":"2024-09-12T17:11:43.816480+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:11:43.816480+0000","last_undegraded":"2024-09-12T17:11:43.816480+0000","last_fullsized":"2024-09-12T17:11:43.816480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:31.614497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'35","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.076109+0000","last_change":"2024-09-12T17:11:10.744907+0000","last_active":"2024-09-12T17:14:51.076109+0000","last_peered":"2024-09-12T17:14:51.076109+0000","last_clean":"2024-09-12T17:14:51.076109+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.076109+0000","last_undegraded":"2024-09-12T17:14:51.076109+0000","last_fullsized":"2024-09-12T17:14:51.076109+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.692817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":410,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.869172+0000","last_change":"2024-09-12T17:11:12.748911+0000","last_active":"2024-09-12T17:14:50.869172+0000","last_peered":"2024-09-12T17:14:50.869172+0000","last_clean":"2024-09-12T17:14:50.869172+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:14:50.869172+0000","last_undegraded":"2024-09-12T17:14:50.869172+0000","last_fullsized":"2024-09-12T17:14:50.869172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.270515+0000","last_change":"2024-09-12T17:15:27.270380+0000","last_active":"2024-09-12T17:15:27.270515+0000","last_peered":"2024-09-12T17:15:27.270515+0000","last_clean":"2024-09-12T17:15:27.270515+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:15:27.270515+0000","last_undegraded":"2024-09-12T17:15:27.270515+0000","last_fullsized":"2024-09-12T17:15:27.270515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.270201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.252598+0000","last_change":"2024-09-12T17:15:00.252598+0000","last_active":"2024-09-12T17:15:00.252598+0000","last_peered":"2024-09-12T17:15:00.252598+0000","last_clean":"2024-09-12T17:15:00.252598+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:15:00.252598+0000","last_undegraded":"2024-09-12T17:15:00.252598+0000","last_fullsized":"2024-09-12T17:15:00.252598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.252406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:21.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.845483+0000","last_change":"2024-09-12T17:15:28.845304+0000","last_active":"2024-09-12T17:15:28.845483+0000","last_peered":"2024-09-12T17:15:28.845483+0000","last_clean":"2024-09-12T17:15:28.845483+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:15:28.845483+0000","last_undegraded":"2024-09-12T17:15:28.845483+0000","last_fullsized":"2024-09-12T17:15:28.845483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.845128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:39.718369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'44","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.154028+0000","last_change":"2024-09-12T17:11:10.722143+0000","last_active":"2024-09-12T17:14:51.154028+0000","last_peered":"2024-09-12T17:14:51.154028+0000","last_clean":"2024-09-12T17:14:51.154028+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:14:51.154028+0000","last_undegraded":"2024-09-12T17:14:51.154028+0000","last_fullsized":"2024-09-12T17:14:51.154028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799324+0000","last_change":"2024-09-12T17:11:12.749349+0000","last_active":"2024-09-12T17:11:43.799324+0000","last_peered":"2024-09-12T17:11:43.799324+0000","last_clean":"2024-09-12T17:11:43.799324+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:11:43.799324+0000","last_undegraded":"2024-09-12T17:11:43.799324+0000","last_fullsized":"2024-09-12T17:11:43.799324+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:06.131647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:22.757480+0000","last_change":"2024-09-12T17:11:14.778899+0000","last_active":"2024-09-12T17:13:22.757480+0000","last_peered":"2024-09-12T17:13:22.757480+0000","last_clean":"2024-09-12T17:13:22.757480+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:13:22.757480+0000","last_undegraded":"2024-09-12T17:13:22.757480+0000","last_fullsized":"2024-09-12T17:13:22.757480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.886220+0000","last_change":"2024-09-12T17:15:11.886035+0000","last_active":"2024-09-12T17:15:11.886220+0000","last_peered":"2024-09-12T17:15:11.886220+0000","last_clean":"2024-09-12T17:15:11.886220+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:15:11.886220+0000","last_undegraded":"2024-09-12T17:15:11.886220+0000","last_fullsized":"2024-09-12T17:15:11.886220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.885853+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.230528+0000","last_change":"2024-09-12T17:14:58.230528+0000","last_active":"2024-09-12T17:14:58.230528+0000","last_peered":"2024-09-12T17:14:58.230528+0000","last_clean":"2024-09-12T17:14:58.230528+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:58.230528+0000","last_undegraded":"2024-09-12T17:14:58.230528+0000","last_fullsized":"2024-09-12T17:14:58.230528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.230294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:55.690708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.679025+0000","last_change":"2024-09-12T17:15:26.678715+0000","last_active":"2024-09-12T17:15:26.679025+0000","last_peered":"2024-09-12T17:15:26.679025+0000","last_clean":"2024-09-12T17:15:26.679025+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:15:26.679025+0000","last_undegraded":"2024-09-12T17:15:26.679025+0000","last_fullsized":"2024-09-12T17:15:26.679025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.678505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:32.805993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.011543+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:14:51.011543+0000","last_peered":"2024-09-12T17:14:51.011543+0000","last_clean":"2024-09-12T17:14:51.011543+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:14:51.011543+0000","last_undegraded":"2024-09-12T17:14:51.011543+0000","last_fullsized":"2024-09-12T17:14:51.011543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:44.818521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:23.760981+0000","last_change":"2024-09-12T17:11:12.757331+0000","last_active":"2024-09-12T17:13:23.760981+0000","last_peered":"2024-09-12T17:13:23.760981+0000","last_clean":"2024-09-12T17:13:23.760981+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:13:23.760981+0000","last_undegraded":"2024-09-12T17:13:23.760981+0000","last_fullsized":"2024-09-12T17:13:23.760981+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.758608+0000","last_change":"2024-09-12T17:11:14.768869+0000","last_active":"2024-09-12T17:13:19.758608+0000","last_peered":"2024-09-12T17:13:19.758608+0000","last_clean":"2024-09-12T17:13:19.758608+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:13:19.758608+0000","last_undegraded":"2024-09-12T17:13:19.758608+0000","last_fullsized":"2024-09-12T17:13:19.758608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.156810+0000","last_change":"2024-09-12T17:15:12.156505+0000","last_active":"2024-09-12T17:15:12.156810+0000","last_peered":"2024-09-12T17:15:12.156810+0000","last_clean":"2024-09-12T17:15:12.156810+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:15:12.156810+0000","last_undegraded":"2024-09-12T17:15:12.156810+0000","last_fullsized":"2024-09-12T17:15:12.156810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.156239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:25.415656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.347019+0000","last_change":"2024-09-12T17:15:06.346855+0000","last_active":"2024-09-12T17:15:06.347019+0000","last_peered":"2024-09-12T17:15:06.347019+0000","last_clean":"2024-09-12T17:15:06.347019+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:15:06.347019+0000","last_undegraded":"2024-09-12T17:15:06.347019+0000","last_fullsized":"2024-09-12T17:15:06.347019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.346636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:51.428823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.667097+0000","last_change":"2024-09-12T17:15:29.667097+0000","last_active":"2024-09-12T17:15:29.667097+0000","last_peered":"2024-09-12T17:15:29.667097+0000","last_clean":"2024-09-12T17:15:29.667097+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:15:29.667097+0000","last_undegraded":"2024-09-12T17:15:29.667097+0000","last_fullsized":"2024-09-12T17:15:29.667097+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.666868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:49.783995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'39","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.168657+0000","last_change":"2024-09-12T17:11:10.742922+0000","last_active":"2024-09-12T17:14:51.168657+0000","last_peered":"2024-09-12T17:14:51.168657+0000","last_clean":"2024-09-12T17:14:51.168657+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:14:51.168657+0000","last_undegraded":"2024-09-12T17:14:51.168657+0000","last_fullsized":"2024-09-12T17:14:51.168657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":354,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.220861+0000","last_change":"2024-09-12T17:11:12.748581+0000","last_active":"2024-09-12T17:14:51.220861+0000","last_peered":"2024-09-12T17:14:51.220861+0000","last_clean":"2024-09-12T17:14:51.220861+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:14:51.220861+0000","last_undegraded":"2024-09-12T17:14:51.220861+0000","last_fullsized":"2024-09-12T17:14:51.220861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:23.761240+0000","last_change":"2024-09-12T17:11:14.782603+0000","last_active":"2024-09-12T17:13:23.761240+0000","last_peered":"2024-09-12T17:13:23.761240+0000","last_clean":"2024-09-12T17:13:23.761240+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:13:23.761240+0000","last_undegraded":"2024-09-12T17:13:23.761240+0000","last_fullsized":"2024-09-12T17:13:23.761240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.111502+0000","last_change":"2024-09-12T17:15:13.111502+0000","last_active":"2024-09-12T17:15:13.111502+0000","last_peered":"2024-09-12T17:15:13.111502+0000","last_clean":"2024-09-12T17:15:13.111502+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:15:13.111502+0000","last_undegraded":"2024-09-12T17:15:13.111502+0000","last_fullsized":"2024-09-12T17:15:13.111502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.111208+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.802604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.322359+0000","last_change":"2024-09-12T17:15:15.322215+0000","last_active":"2024-09-12T17:15:15.322359+0000","last_peered":"2024-09-12T17:15:15.322359+0000","last_clean":"2024-09-12T17:15:15.322359+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:15:15.322359+0000","last_undegraded":"2024-09-12T17:15:15.322359+0000","last_fullsized":"2024-09-12T17:15:15.322359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.322029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:41.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.655138+0000","last_change":"2024-09-12T17:15:27.654987+0000","last_active":"2024-09-12T17:15:27.655138+0000","last_peered":"2024-09-12T17:15:27.655138+0000","last_clean":"2024-09-12T17:15:27.655138+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:15:27.655138+0000","last_undegraded":"2024-09-12T17:15:27.655138+0000","last_fullsized":"2024-09-12T17:15:27.655138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.654755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:35.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'61","reported_seq":127,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.182953+0000","last_change":"2024-09-12T17:11:10.742585+0000","last_active":"2024-09-12T17:14:51.182953+0000","last_peered":"2024-09-12T17:14:51.182953+0000","last_clean":"2024-09-12T17:14:51.182953+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:14:51.182953+0000","last_undegraded":"2024-09-12T17:14:51.182953+0000","last_fullsized":"2024-09-12T17:14:51.182953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:23.760787+0000","last_change":"2024-09-12T17:11:12.750599+0000","last_active":"2024-09-12T17:13:23.760787+0000","last_peered":"2024-09-12T17:13:23.760787+0000","last_clean":"2024-09-12T17:13:23.760787+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:13:23.760787+0000","last_undegraded":"2024-09-12T17:13:23.760787+0000","last_fullsized":"2024-09-12T17:13:23.760787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.029701+0000","last_change":"2024-09-12T17:11:14.753036+0000","last_active":"2024-09-12T17:14:20.029701+0000","last_peered":"2024-09-12T17:14:20.029701+0000","last_clean":"2024-09-12T17:14:20.029701+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:14:20.029701+0000","last_undegraded":"2024-09-12T17:14:20.029701+0000","last_fullsized":"2024-09-12T17:14:20.029701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.848522+0000","last_change":"2024-09-12T17:15:12.848522+0000","last_active":"2024-09-12T17:15:12.848522+0000","last_peered":"2024-09-12T17:15:12.848522+0000","last_clean":"2024-09-12T17:15:12.848522+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:15:12.848522+0000","last_undegraded":"2024-09-12T17:15:12.848522+0000","last_fullsized":"2024-09-12T17:15:12.848522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.848285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.476233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.570224+0000","last_change":"2024-09-12T17:15:01.570059+0000","last_active":"2024-09-12T17:15:01.570224+0000","last_peered":"2024-09-12T17:15:01.570224+0000","last_clean":"2024-09-12T17:15:01.570224+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:15:01.570224+0000","last_undegraded":"2024-09-12T17:15:01.570224+0000","last_fullsized":"2024-09-12T17:15:01.570224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.569882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:12.460985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.079585+0000","last_change":"2024-09-12T17:15:26.079585+0000","last_active":"2024-09-12T17:15:26.079585+0000","last_peered":"2024-09-12T17:15:26.079585+0000","last_clean":"2024-09-12T17:15:26.079585+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:15:26.079585+0000","last_undegraded":"2024-09-12T17:15:26.079585+0000","last_fullsized":"2024-09-12T17:15:26.079585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.079373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:00.776520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.034930+0000","last_change":"2024-09-12T17:11:10.722920+0000","last_active":"2024-09-12T17:14:51.034930+0000","last_peered":"2024-09-12T17:14:51.034930+0000","last_clean":"2024-09-12T17:14:51.034930+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:14:51.034930+0000","last_undegraded":"2024-09-12T17:14:51.034930+0000","last_fullsized":"2024-09-12T17:14:51.034930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:03.101721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816877+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:11:43.816877+0000","last_peered":"2024-09-12T17:11:43.816877+0000","last_clean":"2024-09-12T17:11:43.816877+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:11:43.816877+0000","last_undegraded":"2024-09-12T17:11:43.816877+0000","last_fullsized":"2024-09-12T17:11:43.816877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:10.929944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.970318+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:14:19.970318+0000","last_peered":"2024-09-12T17:14:19.970318+0000","last_clean":"2024-09-12T17:14:19.970318+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:14:19.970318+0000","last_undegraded":"2024-09-12T17:14:19.970318+0000","last_fullsized":"2024-09-12T17:14:19.970318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.307333+0000","last_change":"2024-09-12T17:15:28.307333+0000","last_active":"2024-09-12T17:15:28.307333+0000","last_peered":"2024-09-12T17:15:28.307333+0000","last_clean":"2024-09-12T17:15:28.307333+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:15:28.307333+0000","last_undegraded":"2024-09-12T17:15:28.307333+0000","last_fullsized":"2024-09-12T17:15:28.307333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.307157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:43.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.407052+0000","last_change":"2024-09-12T17:15:04.406881+0000","last_active":"2024-09-12T17:15:04.407052+0000","last_peered":"2024-09-12T17:15:04.407052+0000","last_clean":"2024-09-12T17:15:04.407052+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:15:04.407052+0000","last_undegraded":"2024-09-12T17:15:04.407052+0000","last_fullsized":"2024-09-12T17:15:04.407052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.406686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:45.243217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.658287+0000","last_change":"2024-09-12T17:15:28.658287+0000","last_active":"2024-09-12T17:15:28.658287+0000","last_peered":"2024-09-12T17:15:28.658287+0000","last_clean":"2024-09-12T17:15:28.658287+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:15:28.658287+0000","last_undegraded":"2024-09-12T17:15:28.658287+0000","last_fullsized":"2024-09-12T17:15:28.658287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.658107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:41.190010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'41","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.989960+0000","last_change":"2024-09-12T17:11:10.721852+0000","last_active":"2024-09-12T17:14:50.989960+0000","last_peered":"2024-09-12T17:14:50.989960+0000","last_clean":"2024-09-12T17:14:50.989960+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:14:50.989960+0000","last_undegraded":"2024-09-12T17:14:50.989960+0000","last_fullsized":"2024-09-12T17:14:50.989960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:22.101524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":408,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861779+0000","last_change":"2024-09-12T17:11:12.752646+0000","last_active":"2024-09-12T17:14:50.861779+0000","last_peered":"2024-09-12T17:14:50.861779+0000","last_clean":"2024-09-12T17:14:50.861779+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:14:50.861779+0000","last_undegraded":"2024-09-12T17:14:50.861779+0000","last_fullsized":"2024-09-12T17:14:50.861779+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:27:58.217434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'16","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.974939+0000","last_change":"2024-09-12T17:11:14.778545+0000","last_active":"2024-09-12T17:14:19.974939+0000","last_peered":"2024-09-12T17:14:19.974939+0000","last_clean":"2024-09-12T17:14:19.974939+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:14:19.974939+0000","last_undegraded":"2024-09-12T17:14:19.974939+0000","last_fullsized":"2024-09-12T17:14:19.974939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.119259+0000","last_change":"2024-09-12T17:15:14.119259+0000","last_active":"2024-09-12T17:15:14.119259+0000","last_peered":"2024-09-12T17:15:14.119259+0000","last_clean":"2024-09-12T17:15:14.119259+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:15:14.119259+0000","last_undegraded":"2024-09-12T17:15:14.119259+0000","last_fullsized":"2024-09-12T17:15:14.119259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.119067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:19.587103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.369479+0000","last_change":"2024-09-12T17:15:05.369239+0000","last_active":"2024-09-12T17:15:05.369479+0000","last_peered":"2024-09-12T17:15:05.369479+0000","last_clean":"2024-09-12T17:15:05.369479+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:15:05.369479+0000","last_undegraded":"2024-09-12T17:15:05.369479+0000","last_fullsized":"2024-09-12T17:15:05.369479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.369026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:56.089945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":440,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.846241+0000","last_change":"2024-09-12T17:15:30.846241+0000","last_active":"2024-09-12T17:15:30.846241+0000","last_peered":"2024-09-12T17:15:30.846241+0000","last_clean":"2024-09-12T17:15:30.846241+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:15:30.846241+0000","last_undegraded":"2024-09-12T17:15:30.846241+0000","last_fullsized":"2024-09-12T17:15:30.846241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.846040+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:03.566242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805528+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:11:43.805528+0000","last_peered":"2024-09-12T17:11:43.805528+0000","last_clean":"2024-09-12T17:11:43.805528+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:11:43.805528+0000","last_undegraded":"2024-09-12T17:11:43.805528+0000","last_fullsized":"2024-09-12T17:11:43.805528+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:51.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":515,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.864673+0000","last_change":"2024-09-12T17:11:12.754417+0000","last_active":"2024-09-12T17:14:50.864673+0000","last_peered":"2024-09-12T17:14:50.864673+0000","last_clean":"2024-09-12T17:14:50.864673+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:14:50.864673+0000","last_undegraded":"2024-09-12T17:14:50.864673+0000","last_fullsized":"2024-09-12T17:14:50.864673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:35.389974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.044029+0000","last_change":"2024-09-12T17:11:14.775933+0000","last_active":"2024-09-12T17:14:20.044029+0000","last_peered":"2024-09-12T17:14:20.044029+0000","last_clean":"2024-09-12T17:14:20.044029+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:14:20.044029+0000","last_undegraded":"2024-09-12T17:14:20.044029+0000","last_fullsized":"2024-09-12T17:14:20.044029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.876344+0000","last_change":"2024-09-12T17:15:13.876344+0000","last_active":"2024-09-12T17:15:13.876344+0000","last_peered":"2024-09-12T17:15:13.876344+0000","last_clean":"2024-09-12T17:15:13.876344+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:15:13.876344+0000","last_undegraded":"2024-09-12T17:15:13.876344+0000","last_fullsized":"2024-09-12T17:15:13.876344+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.876174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:45.655514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.392362+0000","last_change":"2024-09-12T17:15:03.392219+0000","last_active":"2024-09-12T17:15:03.392362+0000","last_peered":"2024-09-12T17:15:03.392362+0000","last_clean":"2024-09-12T17:15:03.392362+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:15:03.392362+0000","last_undegraded":"2024-09-12T17:15:03.392362+0000","last_fullsized":"2024-09-12T17:15:03.392362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.392030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:57.279126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.814576+0000","last_change":"2024-09-12T17:11:08.727939+0000","last_active":"2024-09-12T17:11:43.814576+0000","last_peered":"2024-09-12T17:11:43.814576+0000","last_clean":"2024-09-12T17:11:43.814576+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:11:43.814576+0000","last_undegraded":"2024-09-12T17:11:43.814576+0000","last_fullsized":"2024-09-12T17:11:43.814576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:43.946315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'42","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.128009+0000","last_change":"2024-09-12T17:11:10.725261+0000","last_active":"2024-09-12T17:14:51.128009+0000","last_peered":"2024-09-12T17:14:51.128009+0000","last_clean":"2024-09-12T17:14:51.128009+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:14:51.128009+0000","last_undegraded":"2024-09-12T17:14:51.128009+0000","last_fullsized":"2024-09-12T17:14:51.128009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:56.636265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798821+0000","last_change":"2024-09-12T17:11:12.759058+0000","last_active":"2024-09-12T17:11:43.798821+0000","last_peered":"2024-09-12T17:11:43.798821+0000","last_clean":"2024-09-12T17:11:43.798821+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:11:43.798821+0000","last_undegraded":"2024-09-12T17:11:43.798821+0000","last_fullsized":"2024-09-12T17:11:43.798821+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:47.392299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:20.024914+0000","last_change":"2024-09-12T17:11:14.752858+0000","last_active":"2024-09-12T17:14:20.024914+0000","last_peered":"2024-09-12T17:14:20.024914+0000","last_clean":"2024-09-12T17:14:20.024914+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:14:20.024914+0000","last_undegraded":"2024-09-12T17:14:20.024914+0000","last_fullsized":"2024-09-12T17:14:20.024914+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.275587+0000","last_change":"2024-09-12T17:15:25.275587+0000","last_active":"2024-09-12T17:15:25.275587+0000","last_peered":"2024-09-12T17:15:25.275587+0000","last_clean":"2024-09-12T17:15:25.275587+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:15:25.275587+0000","last_undegraded":"2024-09-12T17:15:25.275587+0000","last_fullsized":"2024-09-12T17:15:25.275587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.275402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:48.030414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.911446+0000","last_change":"2024-09-12T17:14:55.911446+0000","last_active":"2024-09-12T17:14:55.911446+0000","last_peered":"2024-09-12T17:14:55.911446+0000","last_clean":"2024-09-12T17:14:55.911446+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:14:55.911446+0000","last_undegraded":"2024-09-12T17:14:55.911446+0000","last_fullsized":"2024-09-12T17:14:55.911446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.911203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:43.813828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.344255+0000","last_change":"2024-09-12T17:14:58.344110+0000","last_active":"2024-09-12T17:14:58.344255+0000","last_peered":"2024-09-12T17:14:58.344255+0000","last_clean":"2024-09-12T17:14:58.344255+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:14:58.344255+0000","last_undegraded":"2024-09-12T17:14:58.344255+0000","last_fullsized":"2024-09-12T17:14:58.344255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.343916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:58.763095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.363397+0000","last_change":"2024-09-12T17:15:00.363177+0000","last_active":"2024-09-12T17:15:00.363397+0000","last_peered":"2024-09-12T17:15:00.363397+0000","last_clean":"2024-09-12T17:15:00.363397+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:15:00.363397+0000","last_undegraded":"2024-09-12T17:15:00.363397+0000","last_fullsized":"2024-09-12T17:15:00.363397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.362898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:40.201170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.860319+0000","last_change":"2024-09-12T17:15:33.860319+0000","last_active":"2024-09-12T17:15:33.860319+0000","last_peered":"2024-09-12T17:15:33.860319+0000","last_clean":"2024-09-12T17:15:33.860319+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:15:33.860319+0000","last_undegraded":"2024-09-12T17:15:33.860319+0000","last_fullsized":"2024-09-12T17:15:33.860319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.860118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:13.485835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'85","reported_seq":168,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.146206+0000","last_change":"2024-09-12T17:11:10.743191+0000","last_active":"2024-09-12T17:14:51.146206+0000","last_peered":"2024-09-12T17:14:51.146206+0000","last_clean":"2024-09-12T17:14:51.146206+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:14:51.146206+0000","last_undegraded":"2024-09-12T17:14:51.146206+0000","last_fullsized":"2024-09-12T17:14:51.146206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:23.761282+0000","last_change":"2024-09-12T17:11:12.755373+0000","last_active":"2024-09-12T17:13:23.761282+0000","last_peered":"2024-09-12T17:13:23.761282+0000","last_clean":"2024-09-12T17:13:23.761282+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:13:23.761282+0000","last_undegraded":"2024-09-12T17:13:23.761282+0000","last_fullsized":"2024-09-12T17:13:23.761282+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.883471+0000","last_change":"2024-09-12T17:11:14.774552+0000","last_active":"2024-09-12T17:14:19.883471+0000","last_peered":"2024-09-12T17:14:19.883471+0000","last_clean":"2024-09-12T17:14:19.883471+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:14:19.883471+0000","last_undegraded":"2024-09-12T17:14:19.883471+0000","last_fullsized":"2024-09-12T17:14:19.883471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:48.965665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.251384+0000","last_change":"2024-09-12T17:15:26.251257+0000","last_active":"2024-09-12T17:15:26.251384+0000","last_peered":"2024-09-12T17:15:26.251384+0000","last_clean":"2024-09-12T17:15:26.251384+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:15:26.251384+0000","last_undegraded":"2024-09-12T17:15:26.251384+0000","last_fullsized":"2024-09-12T17:15:26.251384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.251080+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:57.034203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.355017+0000","last_change":"2024-09-12T17:14:56.355017+0000","last_active":"2024-09-12T17:14:56.355017+0000","last_peered":"2024-09-12T17:14:56.355017+0000","last_clean":"2024-09-12T17:14:56.355017+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:14:56.355017+0000","last_undegraded":"2024-09-12T17:14:56.355017+0000","last_fullsized":"2024-09-12T17:14:56.355017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.354829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:11.179727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.554007+0000","last_change":"2024-09-12T17:15:00.553874+0000","last_active":"2024-09-12T17:15:00.554007+0000","last_peered":"2024-09-12T17:15:00.554007+0000","last_clean":"2024-09-12T17:15:00.554007+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:15:00.554007+0000","last_undegraded":"2024-09-12T17:15:00.554007+0000","last_fullsized":"2024-09-12T17:15:00.554007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.553655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:28.442790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.793915+0000","last_change":"2024-09-12T17:11:08.728141+0000","last_active":"2024-09-12T17:13:19.793915+0000","last_peered":"2024-09-12T17:13:19.793915+0000","last_clean":"2024-09-12T17:13:19.793915+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:13:19.793915+0000","last_undegraded":"2024-09-12T17:13:19.793915+0000","last_fullsized":"2024-09-12T17:13:19.793915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'286","reported_seq":505,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.199435+0000","last_change":"2024-09-12T17:11:10.754306+0000","last_active":"2024-09-12T17:14:51.199435+0000","last_peered":"2024-09-12T17:14:51.199435+0000","last_clean":"2024-09-12T17:14:51.199435+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:14:51.199435+0000","last_undegraded":"2024-09-12T17:14:51.199435+0000","last_fullsized":"2024-09-12T17:14:51.199435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.793588+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:13:19.793588+0000","last_peered":"2024-09-12T17:13:19.793588+0000","last_clean":"2024-09-12T17:13:19.793588+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:13:19.793588+0000","last_undegraded":"2024-09-12T17:13:19.793588+0000","last_fullsized":"2024-09-12T17:13:19.793588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759811+0000","last_change":"2024-09-12T17:11:14.777886+0000","last_active":"2024-09-12T17:13:24.759811+0000","last_peered":"2024-09-12T17:13:24.759811+0000","last_clean":"2024-09-12T17:13:24.759811+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:13:24.759811+0000","last_undegraded":"2024-09-12T17:13:24.759811+0000","last_fullsized":"2024-09-12T17:13:24.759811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'26","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.649839+0000","last_change":"2024-09-12T17:15:14.649699+0000","last_active":"2024-09-12T17:15:14.649839+0000","last_peered":"2024-09-12T17:15:14.649839+0000","last_clean":"2024-09-12T17:15:14.649839+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:15:14.649839+0000","last_undegraded":"2024-09-12T17:15:14.649839+0000","last_fullsized":"2024-09-12T17:15:14.649839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.649518+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:27.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.253023+0000","last_change":"2024-09-12T17:14:56.252899+0000","last_active":"2024-09-12T17:14:56.253023+0000","last_peered":"2024-09-12T17:14:56.253023+0000","last_clean":"2024-09-12T17:14:56.253023+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:14:56.253023+0000","last_undegraded":"2024-09-12T17:14:56.253023+0000","last_fullsized":"2024-09-12T17:14:56.253023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.252710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:23.672480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.622944+0000","last_change":"2024-09-12T17:14:57.622760+0000","last_active":"2024-09-12T17:14:57.622944+0000","last_peered":"2024-09-12T17:14:57.622944+0000","last_clean":"2024-09-12T17:14:57.622944+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:14:57.622944+0000","last_undegraded":"2024-09-12T17:14:57.622944+0000","last_fullsized":"2024-09-12T17:14:57.622944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.622572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.441681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.094456+0000","last_change":"2024-09-12T17:15:24.094317+0000","last_active":"2024-09-12T17:15:24.094456+0000","last_peered":"2024-09-12T17:15:24.094456+0000","last_clean":"2024-09-12T17:15:24.094456+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:15:24.094456+0000","last_undegraded":"2024-09-12T17:15:24.094456+0000","last_fullsized":"2024-09-12T17:15:24.094456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.094126+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:04.533467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.032736+0000","last_change":"2024-09-12T17:15:31.032736+0000","last_active":"2024-09-12T17:15:31.032736+0000","last_peered":"2024-09-12T17:15:31.032736+0000","last_clean":"2024-09-12T17:15:31.032736+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:15:31.032736+0000","last_undegraded":"2024-09-12T17:15:31.032736+0000","last_fullsized":"2024-09-12T17:15:31.032736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.032542+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.819963+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759746+0000","last_change":"2024-09-12T17:11:12.758254+0000","last_active":"2024-09-12T17:13:18.759746+0000","last_peered":"2024-09-12T17:13:18.759746+0000","last_clean":"2024-09-12T17:13:18.759746+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:13:18.759746+0000","last_undegraded":"2024-09-12T17:13:18.759746+0000","last_fullsized":"2024-09-12T17:13:18.759746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801814+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:11:43.801814+0000","last_peered":"2024-09-12T17:11:43.801814+0000","last_clean":"2024-09-12T17:11:43.801814+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:11:43.801814+0000","last_undegraded":"2024-09-12T17:11:43.801814+0000","last_fullsized":"2024-09-12T17:11:43.801814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:05.265169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.619454+0000","last_change":"2024-09-12T17:15:12.619313+0000","last_active":"2024-09-12T17:15:12.619454+0000","last_peered":"2024-09-12T17:15:12.619454+0000","last_clean":"2024-09-12T17:15:12.619454+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:15:12.619454+0000","last_undegraded":"2024-09-12T17:15:12.619454+0000","last_fullsized":"2024-09-12T17:15:12.619454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.619133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.401095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.349942+0000","last_change":"2024-09-12T17:14:57.349792+0000","last_active":"2024-09-12T17:14:57.349942+0000","last_peered":"2024-09-12T17:14:57.349942+0000","last_clean":"2024-09-12T17:14:57.349942+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:14:57.349942+0000","last_undegraded":"2024-09-12T17:14:57.349942+0000","last_fullsized":"2024-09-12T17:14:57.349942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.349607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:49.102885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.265774+0000","last_change":"2024-09-12T17:14:57.265630+0000","last_active":"2024-09-12T17:14:57.265774+0000","last_peered":"2024-09-12T17:14:57.265774+0000","last_clean":"2024-09-12T17:14:57.265774+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:14:57.265774+0000","last_undegraded":"2024-09-12T17:14:57.265774+0000","last_fullsized":"2024-09-12T17:14:57.265774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.265430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:07.327769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.650742+0000","last_change":"2024-09-12T17:15:25.650742+0000","last_active":"2024-09-12T17:15:25.650742+0000","last_peered":"2024-09-12T17:15:25.650742+0000","last_clean":"2024-09-12T17:15:25.650742+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:15:25.650742+0000","last_undegraded":"2024-09-12T17:15:25.650742+0000","last_fullsized":"2024-09-12T17:15:25.650742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.650567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:13.066845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.783725+0000","last_change":"2024-09-12T17:11:10.747296+0000","last_active":"2024-09-12T17:14:18.783725+0000","last_peered":"2024-09-12T17:14:18.783725+0000","last_clean":"2024-09-12T17:14:18.783725+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:14:18.783725+0000","last_undegraded":"2024-09-12T17:14:18.783725+0000","last_fullsized":"2024-09-12T17:14:18.783725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795407+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:13:24.795407+0000","last_peered":"2024-09-12T17:13:24.795407+0000","last_clean":"2024-09-12T17:13:24.795407+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:13:24.795407+0000","last_undegraded":"2024-09-12T17:13:24.795407+0000","last_fullsized":"2024-09-12T17:13:24.795407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.759711+0000","last_change":"2024-09-12T17:11:14.767000+0000","last_active":"2024-09-12T17:13:24.759711+0000","last_peered":"2024-09-12T17:13:24.759711+0000","last_clean":"2024-09-12T17:13:24.759711+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:13:24.759711+0000","last_undegraded":"2024-09-12T17:13:24.759711+0000","last_fullsized":"2024-09-12T17:13:24.759711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.824007+0000","last_change":"2024-09-12T17:15:09.823868+0000","last_active":"2024-09-12T17:15:09.824007+0000","last_peered":"2024-09-12T17:15:09.824007+0000","last_clean":"2024-09-12T17:15:09.824007+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:15:09.824007+0000","last_undegraded":"2024-09-12T17:15:09.824007+0000","last_fullsized":"2024-09-12T17:15:09.824007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.823660+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.276097+0000","last_change":"2024-09-12T17:14:59.275856+0000","last_active":"2024-09-12T17:14:59.276097+0000","last_peered":"2024-09-12T17:14:59.276097+0000","last_clean":"2024-09-12T17:14:59.276097+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:59.276097+0000","last_undegraded":"2024-09-12T17:14:59.276097+0000","last_fullsized":"2024-09-12T17:14:59.276097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.275635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:08.199637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.609810+0000","last_change":"2024-09-12T17:14:55.609658+0000","last_active":"2024-09-12T17:14:55.609810+0000","last_peered":"2024-09-12T17:14:55.609810+0000","last_clean":"2024-09-12T17:14:55.609810+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:14:55.609810+0000","last_undegraded":"2024-09-12T17:14:55.609810+0000","last_fullsized":"2024-09-12T17:14:55.609810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.609474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:43.527501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.687586+0000","last_change":"2024-09-12T17:15:24.687586+0000","last_active":"2024-09-12T17:15:24.687586+0000","last_peered":"2024-09-12T17:15:24.687586+0000","last_clean":"2024-09-12T17:15:24.687586+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:15:24.687586+0000","last_undegraded":"2024-09-12T17:15:24.687586+0000","last_fullsized":"2024-09-12T17:15:24.687586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.687400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:45.771402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.685630+0000","last_change":"2024-09-12T17:15:32.685630+0000","last_active":"2024-09-12T17:15:32.685630+0000","last_peered":"2024-09-12T17:15:32.685630+0000","last_clean":"2024-09-12T17:15:32.685630+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:15:32.685630+0000","last_undegraded":"2024-09-12T17:15:32.685630+0000","last_fullsized":"2024-09-12T17:15:32.685630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.685518+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.484233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:17.756278+0000","last_change":"2024-09-12T17:11:12.752938+0000","last_active":"2024-09-12T17:13:17.756278+0000","last_peered":"2024-09-12T17:13:17.756278+0000","last_clean":"2024-09-12T17:13:17.756278+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:13:17.756278+0000","last_undegraded":"2024-09-12T17:13:17.756278+0000","last_fullsized":"2024-09-12T17:13:17.756278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.794473+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.794473+0000","last_peered":"2024-09-12T17:14:19.794473+0000","last_clean":"2024-09-12T17:14:19.794473+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.794473+0000","last_undegraded":"2024-09-12T17:14:19.794473+0000","last_fullsized":"2024-09-12T17:14:19.794473+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:58.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.842566+0000","last_change":"2024-09-12T17:15:10.842397+0000","last_active":"2024-09-12T17:15:10.842566+0000","last_peered":"2024-09-12T17:15:10.842566+0000","last_clean":"2024-09-12T17:15:10.842566+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:15:10.842566+0000","last_undegraded":"2024-09-12T17:15:10.842566+0000","last_fullsized":"2024-09-12T17:15:10.842566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.842219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:45.585105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.546848+0000","last_change":"2024-09-12T17:14:59.546720+0000","last_active":"2024-09-12T17:14:59.546848+0000","last_peered":"2024-09-12T17:14:59.546848+0000","last_clean":"2024-09-12T17:14:59.546848+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:14:59.546848+0000","last_undegraded":"2024-09-12T17:14:59.546848+0000","last_fullsized":"2024-09-12T17:14:59.546848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.546539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:06.551999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.384965+0000","last_change":"2024-09-12T17:15:02.384841+0000","last_active":"2024-09-12T17:15:02.384965+0000","last_peered":"2024-09-12T17:15:02.384965+0000","last_clean":"2024-09-12T17:15:02.384965+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:15:02.384965+0000","last_undegraded":"2024-09-12T17:15:02.384965+0000","last_fullsized":"2024-09-12T17:15:02.384965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.384664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:21.774531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.792125+0000","last_change":"2024-09-12T17:11:08.725358+0000","last_active":"2024-09-12T17:13:14.792125+0000","last_peered":"2024-09-12T17:13:14.792125+0000","last_clean":"2024-09-12T17:13:14.792125+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:13:14.792125+0000","last_undegraded":"2024-09-12T17:13:14.792125+0000","last_fullsized":"2024-09-12T17:13:14.792125+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.757332+0000","last_change":"2024-09-12T17:11:10.745377+0000","last_active":"2024-09-12T17:13:14.757332+0000","last_peered":"2024-09-12T17:13:14.757332+0000","last_clean":"2024-09-12T17:13:14.757332+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:13:14.757332+0000","last_undegraded":"2024-09-12T17:13:14.757332+0000","last_fullsized":"2024-09-12T17:13:14.757332+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":392,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.204665+0000","last_change":"2024-09-12T17:11:12.753506+0000","last_active":"2024-09-12T17:14:51.204665+0000","last_peered":"2024-09-12T17:14:51.204665+0000","last_clean":"2024-09-12T17:14:51.204665+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:14:51.204665+0000","last_undegraded":"2024-09-12T17:14:51.204665+0000","last_fullsized":"2024-09-12T17:14:51.204665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:49.985319+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:11:49.985319+0000","last_peered":"2024-09-12T17:11:49.985319+0000","last_clean":"2024-09-12T17:11:49.985319+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:11:49.985319+0000","last_undegraded":"2024-09-12T17:11:49.985319+0000","last_fullsized":"2024-09-12T17:11:49.985319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:06.955946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.324685+0000","last_change":"2024-09-12T17:15:21.324685+0000","last_active":"2024-09-12T17:15:21.324685+0000","last_peered":"2024-09-12T17:15:21.324685+0000","last_clean":"2024-09-12T17:15:21.324685+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:15:21.324685+0000","last_undegraded":"2024-09-12T17:15:21.324685+0000","last_fullsized":"2024-09-12T17:15:21.324685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.324508+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:04.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.370073+0000","last_change":"2024-09-12T17:15:01.369815+0000","last_active":"2024-09-12T17:15:01.370073+0000","last_peered":"2024-09-12T17:15:01.370073+0000","last_clean":"2024-09-12T17:15:01.370073+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:15:01.370073+0000","last_undegraded":"2024-09-12T17:15:01.370073+0000","last_fullsized":"2024-09-12T17:15:01.370073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.369538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.619390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.592043+0000","last_change":"2024-09-12T17:14:56.591887+0000","last_active":"2024-09-12T17:14:56.592043+0000","last_peered":"2024-09-12T17:14:56.592043+0000","last_clean":"2024-09-12T17:14:56.592043+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:14:56.592043+0000","last_undegraded":"2024-09-12T17:14:56.592043+0000","last_fullsized":"2024-09-12T17:14:56.592043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.591696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:05.758061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.792108+0000","last_change":"2024-09-12T17:11:08.725510+0000","last_active":"2024-09-12T17:13:14.792108+0000","last_peered":"2024-09-12T17:13:14.792108+0000","last_clean":"2024-09-12T17:13:14.792108+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:13:14.792108+0000","last_undegraded":"2024-09-12T17:13:14.792108+0000","last_fullsized":"2024-09-12T17:13:14.792108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:14.792156+0000","last_change":"2024-09-12T17:11:10.746081+0000","last_active":"2024-09-12T17:13:14.792156+0000","last_peered":"2024-09-12T17:13:14.792156+0000","last_clean":"2024-09-12T17:13:14.792156+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:13:14.792156+0000","last_undegraded":"2024-09-12T17:13:14.792156+0000","last_fullsized":"2024-09-12T17:13:14.792156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":404,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.214962+0000","last_change":"2024-09-12T17:11:12.749754+0000","last_active":"2024-09-12T17:14:51.214962+0000","last_peered":"2024-09-12T17:14:51.214962+0000","last_clean":"2024-09-12T17:14:51.214962+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:14:51.214962+0000","last_undegraded":"2024-09-12T17:14:51.214962+0000","last_fullsized":"2024-09-12T17:14:51.214962+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.811442+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:11:43.811442+0000","last_peered":"2024-09-12T17:11:43.811442+0000","last_clean":"2024-09-12T17:11:43.811442+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:11:43.811442+0000","last_undegraded":"2024-09-12T17:11:43.811442+0000","last_fullsized":"2024-09-12T17:11:43.811442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.292391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.153122+0000","last_change":"2024-09-12T17:15:11.152858+0000","last_active":"2024-09-12T17:15:11.153122+0000","last_peered":"2024-09-12T17:15:11.153122+0000","last_clean":"2024-09-12T17:15:11.153122+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:15:11.153122+0000","last_undegraded":"2024-09-12T17:15:11.153122+0000","last_fullsized":"2024-09-12T17:15:11.153122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.152634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:17.511951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.954866+0000","last_change":"2024-09-12T17:14:56.954698+0000","last_active":"2024-09-12T17:14:56.954866+0000","last_peered":"2024-09-12T17:14:56.954866+0000","last_clean":"2024-09-12T17:14:56.954866+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:56.954866+0000","last_undegraded":"2024-09-12T17:14:56.954866+0000","last_fullsized":"2024-09-12T17:14:56.954866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.954518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:01.720351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.386536+0000","last_change":"2024-09-12T17:14:59.386412+0000","last_active":"2024-09-12T17:14:59.386536+0000","last_peered":"2024-09-12T17:14:59.386536+0000","last_clean":"2024-09-12T17:14:59.386536+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:14:59.386536+0000","last_undegraded":"2024-09-12T17:14:59.386536+0000","last_fullsized":"2024-09-12T17:14:59.386536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.386232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:09.105379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.790853+0000","last_change":"2024-09-12T17:11:08.723309+0000","last_active":"2024-09-12T17:13:09.790853+0000","last_peered":"2024-09-12T17:13:09.790853+0000","last_clean":"2024-09-12T17:13:09.790853+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:13:09.790853+0000","last_undegraded":"2024-09-12T17:13:09.790853+0000","last_fullsized":"2024-09-12T17:13:09.790853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'101","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.074417+0000","last_change":"2024-09-12T17:15:32.074417+0000","last_active":"2024-09-12T17:15:32.074417+0000","last_peered":"2024-09-12T17:15:32.074417+0000","last_clean":"2024-09-12T17:15:32.074417+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:15:32.074417+0000","last_undegraded":"2024-09-12T17:15:32.074417+0000","last_fullsized":"2024-09-12T17:15:32.074417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'101","last_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_deep_scrub":"34'101","last_deep_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.074146+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.161569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.759639+0000","last_change":"2024-09-12T17:11:12.757308+0000","last_active":"2024-09-12T17:13:18.759639+0000","last_peered":"2024-09-12T17:13:18.759639+0000","last_clean":"2024-09-12T17:13:18.759639+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:13:18.759639+0000","last_undegraded":"2024-09-12T17:13:18.759639+0000","last_fullsized":"2024-09-12T17:13:18.759639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.794762+0000","last_change":"2024-09-12T17:11:14.774909+0000","last_active":"2024-09-12T17:11:43.794762+0000","last_peered":"2024-09-12T17:11:43.794762+0000","last_clean":"2024-09-12T17:11:43.794762+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:11:43.794762+0000","last_undegraded":"2024-09-12T17:11:43.794762+0000","last_fullsized":"2024-09-12T17:11:43.794762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:18.380593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:22.757635+0000","last_change":"2024-09-12T17:11:14.776424+0000","last_active":"2024-09-12T17:13:22.757635+0000","last_peered":"2024-09-12T17:13:22.757635+0000","last_clean":"2024-09-12T17:13:22.757635+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:13:22.757635+0000","last_undegraded":"2024-09-12T17:13:22.757635+0000","last_fullsized":"2024-09-12T17:13:22.757635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.151829+0000","last_change":"2024-09-12T17:15:15.151829+0000","last_active":"2024-09-12T17:15:15.151829+0000","last_peered":"2024-09-12T17:15:15.151829+0000","last_clean":"2024-09-12T17:15:15.151829+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:15:15.151829+0000","last_undegraded":"2024-09-12T17:15:15.151829+0000","last_fullsized":"2024-09-12T17:15:15.151829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.151618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:24.317983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.299261+0000","last_change":"2024-09-12T17:15:12.299261+0000","last_active":"2024-09-12T17:15:12.299261+0000","last_peered":"2024-09-12T17:15:12.299261+0000","last_clean":"2024-09-12T17:15:12.299261+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:15:12.299261+0000","last_undegraded":"2024-09-12T17:15:12.299261+0000","last_fullsized":"2024-09-12T17:15:12.299261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.299076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:16.946359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"34'2","reported_seq":230,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.890554+0000","last_change":"2024-09-12T17:15:31.890554+0000","last_active":"2024-09-12T17:15:31.890554+0000","last_peered":"2024-09-12T17:15:31.890554+0000","last_clean":"2024-09-12T17:15:31.890554+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:15:31.890554+0000","last_undegraded":"2024-09-12T17:15:31.890554+0000","last_fullsized":"2024-09-12T17:15:31.890554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.890371+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:17.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.159179+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:14:51.159179+0000","last_peered":"2024-09-12T17:14:51.159179+0000","last_clean":"2024-09-12T17:14:51.159179+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:14:51.159179+0000","last_undegraded":"2024-09-12T17:14:51.159179+0000","last_fullsized":"2024-09-12T17:14:51.159179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:09.186940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.801716+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:11:43.801716+0000","last_peered":"2024-09-12T17:11:43.801716+0000","last_clean":"2024-09-12T17:11:43.801716+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:11:43.801716+0000","last_undegraded":"2024-09-12T17:11:43.801716+0000","last_fullsized":"2024-09-12T17:11:43.801716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:58.933373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.386759+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.386759+0000","last_peered":"2024-09-12T17:13:16.386759+0000","last_clean":"2024-09-12T17:13:16.386759+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.386759+0000","last_undegraded":"2024-09-12T17:13:16.386759+0000","last_fullsized":"2024-09-12T17:13:16.386759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.850267+0000","last_change":"2024-09-12T17:15:14.850267+0000","last_active":"2024-09-12T17:15:14.850267+0000","last_peered":"2024-09-12T17:15:14.850267+0000","last_clean":"2024-09-12T17:15:14.850267+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:15:14.850267+0000","last_undegraded":"2024-09-12T17:15:14.850267+0000","last_fullsized":"2024-09-12T17:15:14.850267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.850076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:10.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.314071+0000","last_change":"2024-09-12T17:15:02.314071+0000","last_active":"2024-09-12T17:15:02.314071+0000","last_peered":"2024-09-12T17:15:02.314071+0000","last_clean":"2024-09-12T17:15:02.314071+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:15:02.314071+0000","last_undegraded":"2024-09-12T17:15:02.314071+0000","last_fullsized":"2024-09-12T17:15:02.314071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.313786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:05.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805711+0000","last_change":"2024-09-12T17:11:08.727258+0000","last_active":"2024-09-12T17:11:43.805711+0000","last_peered":"2024-09-12T17:11:43.805711+0000","last_clean":"2024-09-12T17:11:43.805711+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:11:43.805711+0000","last_undegraded":"2024-09-12T17:11:43.805711+0000","last_fullsized":"2024-09-12T17:11:43.805711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:10.949640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:18.762264+0000","last_change":"2024-09-12T17:11:10.722868+0000","last_active":"2024-09-12T17:14:18.762264+0000","last_peered":"2024-09-12T17:14:18.762264+0000","last_clean":"2024-09-12T17:14:18.762264+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:14:18.762264+0000","last_undegraded":"2024-09-12T17:14:18.762264+0000","last_fullsized":"2024-09-12T17:14:18.762264+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:35.642034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.791081+0000","last_change":"2024-09-12T17:11:12.756243+0000","last_active":"2024-09-12T17:11:43.791081+0000","last_peered":"2024-09-12T17:11:43.791081+0000","last_clean":"2024-09-12T17:11:43.791081+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:11:43.791081+0000","last_undegraded":"2024-09-12T17:11:43.791081+0000","last_fullsized":"2024-09-12T17:11:43.791081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:22:44.687492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.590855+0000","last_change":"2024-09-12T17:15:11.590855+0000","last_active":"2024-09-12T17:15:11.590855+0000","last_peered":"2024-09-12T17:15:11.590855+0000","last_clean":"2024-09-12T17:15:11.590855+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:15:11.590855+0000","last_undegraded":"2024-09-12T17:15:11.590855+0000","last_fullsized":"2024-09-12T17:15:11.590855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.590645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:52.146542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.289858+0000","last_change":"2024-09-12T17:15:03.289858+0000","last_active":"2024-09-12T17:15:03.289858+0000","last_peered":"2024-09-12T17:15:03.289858+0000","last_clean":"2024-09-12T17:15:03.289858+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:15:03.289858+0000","last_undegraded":"2024-09-12T17:15:03.289858+0000","last_fullsized":"2024-09-12T17:15:03.289858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.289669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.942393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.086675+0000","last_change":"2024-09-12T17:15:27.086675+0000","last_active":"2024-09-12T17:15:27.086675+0000","last_peered":"2024-09-12T17:15:27.086675+0000","last_clean":"2024-09-12T17:15:27.086675+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:15:27.086675+0000","last_undegraded":"2024-09-12T17:15:27.086675+0000","last_fullsized":"2024-09-12T17:15:27.086675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.086490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:57.656954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.069455+0000","last_change":"2024-09-12T17:11:10.725717+0000","last_active":"2024-09-12T17:14:51.069455+0000","last_peered":"2024-09-12T17:14:51.069455+0000","last_clean":"2024-09-12T17:14:51.069455+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:14:51.069455+0000","last_undegraded":"2024-09-12T17:14:51.069455+0000","last_fullsized":"2024-09-12T17:14:51.069455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:07.668107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.807797+0000","last_change":"2024-09-12T17:11:12.750567+0000","last_active":"2024-09-12T17:11:43.807797+0000","last_peered":"2024-09-12T17:11:43.807797+0000","last_clean":"2024-09-12T17:11:43.807797+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:11:43.807797+0000","last_undegraded":"2024-09-12T17:11:43.807797+0000","last_fullsized":"2024-09-12T17:11:43.807797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:45.473714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.353247+0000","last_change":"2024-09-12T17:15:29.353247+0000","last_active":"2024-09-12T17:15:29.353247+0000","last_peered":"2024-09-12T17:15:29.353247+0000","last_clean":"2024-09-12T17:15:29.353247+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:15:29.353247+0000","last_undegraded":"2024-09-12T17:15:29.353247+0000","last_fullsized":"2024-09-12T17:15:29.353247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.353071+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:11.062516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.890548+0000","last_change":"2024-09-12T17:14:58.890548+0000","last_active":"2024-09-12T17:14:58.890548+0000","last_peered":"2024-09-12T17:14:58.890548+0000","last_clean":"2024-09-12T17:14:58.890548+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:14:58.890548+0000","last_undegraded":"2024-09-12T17:14:58.890548+0000","last_fullsized":"2024-09-12T17:14:58.890548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.890365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:09.596280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797909+0000","last_change":"2024-09-12T17:11:08.719838+0000","last_active":"2024-09-12T17:11:43.797909+0000","last_peered":"2024-09-12T17:11:43.797909+0000","last_clean":"2024-09-12T17:11:43.797909+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:11:43.797909+0000","last_undegraded":"2024-09-12T17:11:43.797909+0000","last_fullsized":"2024-09-12T17:11:43.797909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:38.007806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.049859+0000","last_change":"2024-09-12T17:11:10.722248+0000","last_active":"2024-09-12T17:14:51.049859+0000","last_peered":"2024-09-12T17:14:51.049859+0000","last_clean":"2024-09-12T17:14:51.049859+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:14:51.049859+0000","last_undegraded":"2024-09-12T17:14:51.049859+0000","last_fullsized":"2024-09-12T17:14:51.049859+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.053987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.790390+0000","last_change":"2024-09-12T17:11:12.743674+0000","last_active":"2024-09-12T17:11:43.790390+0000","last_peered":"2024-09-12T17:11:43.790390+0000","last_clean":"2024-09-12T17:11:43.790390+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:11:43.790390+0000","last_undegraded":"2024-09-12T17:11:43.790390+0000","last_fullsized":"2024-09-12T17:11:43.790390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:04.323928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'9","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.961281+0000","last_change":"2024-09-12T17:11:06.691087+0000","last_active":"2024-09-12T17:14:19.961281+0000","last_peered":"2024-09-12T17:14:19.961281+0000","last_clean":"2024-09-12T17:14:19.961281+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:14:19.961281+0000","last_undegraded":"2024-09-12T17:14:19.961281+0000","last_fullsized":"2024-09-12T17:14:19.961281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.279239+0000","last_change":"2024-09-12T17:15:09.279239+0000","last_active":"2024-09-12T17:15:09.279239+0000","last_peered":"2024-09-12T17:15:09.279239+0000","last_clean":"2024-09-12T17:15:09.279239+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:15:09.279239+0000","last_undegraded":"2024-09-12T17:15:09.279239+0000","last_fullsized":"2024-09-12T17:15:09.279239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.279045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:06.707329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.686351+0000","last_change":"2024-09-12T17:15:33.686351+0000","last_active":"2024-09-12T17:15:33.686351+0000","last_peered":"2024-09-12T17:15:33.686351+0000","last_clean":"2024-09-12T17:15:33.686351+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:15:33.686351+0000","last_undegraded":"2024-09-12T17:15:33.686351+0000","last_fullsized":"2024-09-12T17:15:33.686351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.686171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:43.686493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.043008+0000","last_change":"2024-09-12T17:11:10.726383+0000","last_active":"2024-09-12T17:14:51.043008+0000","last_peered":"2024-09-12T17:14:51.043008+0000","last_clean":"2024-09-12T17:14:51.043008+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:14:51.043008+0000","last_undegraded":"2024-09-12T17:14:51.043008+0000","last_fullsized":"2024-09-12T17:14:51.043008+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:02.045322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798392+0000","last_change":"2024-09-12T17:11:12.743480+0000","last_active":"2024-09-12T17:11:43.798392+0000","last_peered":"2024-09-12T17:11:43.798392+0000","last_clean":"2024-09-12T17:11:43.798392+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:11:43.798392+0000","last_undegraded":"2024-09-12T17:11:43.798392+0000","last_fullsized":"2024-09-12T17:11:43.798392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.277625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.574956+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:18.574956+0000","last_peered":"2024-09-12T17:13:18.574956+0000","last_clean":"2024-09-12T17:13:18.574956+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:18.574956+0000","last_undegraded":"2024-09-12T17:13:18.574956+0000","last_fullsized":"2024-09-12T17:13:18.574956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:32.334235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.679383+0000","last_change":"2024-09-12T17:15:16.679383+0000","last_active":"2024-09-12T17:15:16.679383+0000","last_peered":"2024-09-12T17:15:16.679383+0000","last_clean":"2024-09-12T17:15:16.679383+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:15:16.679383+0000","last_undegraded":"2024-09-12T17:15:16.679383+0000","last_fullsized":"2024-09-12T17:15:16.679383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.679191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:01.792668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.891960+0000","last_change":"2024-09-12T17:14:59.891960+0000","last_active":"2024-09-12T17:14:59.891960+0000","last_peered":"2024-09-12T17:14:59.891960+0000","last_clean":"2024-09-12T17:14:59.891960+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:14:59.891960+0000","last_undegraded":"2024-09-12T17:14:59.891960+0000","last_fullsized":"2024-09-12T17:14:59.891960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.891778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:26.957401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.044894+0000","last_change":"2024-09-12T17:15:30.044894+0000","last_active":"2024-09-12T17:15:30.044894+0000","last_peered":"2024-09-12T17:15:30.044894+0000","last_clean":"2024-09-12T17:15:30.044894+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:15:30.044894+0000","last_undegraded":"2024-09-12T17:15:30.044894+0000","last_fullsized":"2024-09-12T17:15:30.044894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.044721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:10.826683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.055782+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:14:51.055782+0000","last_peered":"2024-09-12T17:14:51.055782+0000","last_clean":"2024-09-12T17:14:51.055782+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:14:51.055782+0000","last_undegraded":"2024-09-12T17:14:51.055782+0000","last_fullsized":"2024-09-12T17:14:51.055782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.813259+0000","last_change":"2024-09-12T17:11:12.758936+0000","last_active":"2024-09-12T17:11:43.813259+0000","last_peered":"2024-09-12T17:11:43.813259+0000","last_clean":"2024-09-12T17:11:43.813259+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:11:43.813259+0000","last_undegraded":"2024-09-12T17:11:43.813259+0000","last_fullsized":"2024-09-12T17:11:43.813259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:55.308768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.724121+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:18.724121+0000","last_peered":"2024-09-12T17:13:18.724121+0000","last_clean":"2024-09-12T17:13:18.724121+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:18.724121+0000","last_undegraded":"2024-09-12T17:13:18.724121+0000","last_fullsized":"2024-09-12T17:13:18.724121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:35:23.130614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.347117+0000","last_change":"2024-09-12T17:15:33.347117+0000","last_active":"2024-09-12T17:15:33.347117+0000","last_peered":"2024-09-12T17:15:33.347117+0000","last_clean":"2024-09-12T17:15:33.347117+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:15:33.347117+0000","last_undegraded":"2024-09-12T17:15:33.347117+0000","last_fullsized":"2024-09-12T17:15:33.347117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.346944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:57.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.858355+0000","last_change":"2024-09-12T17:15:02.858355+0000","last_active":"2024-09-12T17:15:02.858355+0000","last_peered":"2024-09-12T17:15:02.858355+0000","last_clean":"2024-09-12T17:15:02.858355+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:15:02.858355+0000","last_undegraded":"2024-09-12T17:15:02.858355+0000","last_fullsized":"2024-09-12T17:15:02.858355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.858176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:23.000373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.068082+0000","last_change":"2024-09-12T17:15:28.068082+0000","last_active":"2024-09-12T17:15:28.068082+0000","last_peered":"2024-09-12T17:15:28.068082+0000","last_clean":"2024-09-12T17:15:28.068082+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:15:28.068082+0000","last_undegraded":"2024-09-12T17:15:28.068082+0000","last_fullsized":"2024-09-12T17:15:28.068082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.067903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:07.804712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.194850+0000","last_change":"2024-09-12T17:11:10.740086+0000","last_active":"2024-09-12T17:14:51.194850+0000","last_peered":"2024-09-12T17:14:51.194850+0000","last_clean":"2024-09-12T17:14:51.194850+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:14:51.194850+0000","last_undegraded":"2024-09-12T17:14:51.194850+0000","last_fullsized":"2024-09-12T17:14:51.194850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:13.758549+0000","last_change":"2024-09-12T17:11:12.753587+0000","last_active":"2024-09-12T17:13:13.758549+0000","last_peered":"2024-09-12T17:13:13.758549+0000","last_clean":"2024-09-12T17:13:13.758549+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:13:13.758549+0000","last_undegraded":"2024-09-12T17:13:13.758549+0000","last_fullsized":"2024-09-12T17:13:13.758549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:18.719934+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:18.719934+0000","last_peered":"2024-09-12T17:13:18.719934+0000","last_clean":"2024-09-12T17:13:18.719934+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:18.719934+0000","last_undegraded":"2024-09-12T17:13:18.719934+0000","last_fullsized":"2024-09-12T17:13:18.719934+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:46.397387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.694857+0000","last_change":"2024-09-12T17:15:15.694857+0000","last_active":"2024-09-12T17:15:15.694857+0000","last_peered":"2024-09-12T17:15:15.694857+0000","last_clean":"2024-09-12T17:15:15.694857+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:15:15.694857+0000","last_undegraded":"2024-09-12T17:15:15.694857+0000","last_fullsized":"2024-09-12T17:15:15.694857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.694614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:28.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.275775+0000","last_change":"2024-09-12T17:15:11.275775+0000","last_active":"2024-09-12T17:15:11.275775+0000","last_peered":"2024-09-12T17:15:11.275775+0000","last_clean":"2024-09-12T17:15:11.275775+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:15:11.275775+0000","last_undegraded":"2024-09-12T17:15:11.275775+0000","last_fullsized":"2024-09-12T17:15:11.275775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.275550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.702407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.816254+0000","last_change":"2024-09-12T17:11:08.703671+0000","last_active":"2024-09-12T17:11:43.816254+0000","last_peered":"2024-09-12T17:11:43.816254+0000","last_clean":"2024-09-12T17:11:43.816254+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:11:43.816254+0000","last_undegraded":"2024-09-12T17:11:43.816254+0000","last_fullsized":"2024-09-12T17:11:43.816254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:38.026816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.791268+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:13:09.791268+0000","last_peered":"2024-09-12T17:13:09.791268+0000","last_clean":"2024-09-12T17:13:09.791268+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:13:09.791268+0000","last_undegraded":"2024-09-12T17:13:09.791268+0000","last_fullsized":"2024-09-12T17:13:09.791268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.201870+0000","last_change":"2024-09-12T17:11:12.759429+0000","last_active":"2024-09-12T17:14:51.201870+0000","last_peered":"2024-09-12T17:14:51.201870+0000","last_clean":"2024-09-12T17:14:51.201870+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:14:51.201870+0000","last_undegraded":"2024-09-12T17:14:51.201870+0000","last_fullsized":"2024-09-12T17:14:51.201870+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.762629+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.762629+0000","last_peered":"2024-09-12T17:14:19.762629+0000","last_clean":"2024-09-12T17:14:19.762629+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.762629+0000","last_undegraded":"2024-09-12T17:14:19.762629+0000","last_fullsized":"2024-09-12T17:14:19.762629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:33.853873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.160440+0000","last_change":"2024-09-12T17:15:19.160440+0000","last_active":"2024-09-12T17:15:19.160440+0000","last_peered":"2024-09-12T17:15:19.160440+0000","last_clean":"2024-09-12T17:15:19.160440+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:15:19.160440+0000","last_undegraded":"2024-09-12T17:15:19.160440+0000","last_fullsized":"2024-09-12T17:15:19.160440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.160245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:47.049379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.864639+0000","last_change":"2024-09-12T17:15:00.864639+0000","last_active":"2024-09-12T17:15:00.864639+0000","last_peered":"2024-09-12T17:15:00.864639+0000","last_clean":"2024-09-12T17:15:00.864639+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:15:00.864639+0000","last_undegraded":"2024-09-12T17:15:00.864639+0000","last_fullsized":"2024-09-12T17:15:00.864639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.864442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:24.991687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.809314+0000","last_change":"2024-09-12T17:11:08.716845+0000","last_active":"2024-09-12T17:11:43.809314+0000","last_peered":"2024-09-12T17:11:43.809314+0000","last_clean":"2024-09-12T17:11:43.809314+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:11:43.809314+0000","last_undegraded":"2024-09-12T17:11:43.809314+0000","last_fullsized":"2024-09-12T17:11:43.809314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:12.530236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.996107+0000","last_change":"2024-09-12T17:11:10.722181+0000","last_active":"2024-09-12T17:14:50.996107+0000","last_peered":"2024-09-12T17:14:50.996107+0000","last_clean":"2024-09-12T17:14:50.996107+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:14:50.996107+0000","last_undegraded":"2024-09-12T17:14:50.996107+0000","last_fullsized":"2024-09-12T17:14:50.996107+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:59.474868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.796641+0000","last_change":"2024-09-12T17:11:12.755247+0000","last_active":"2024-09-12T17:11:43.796641+0000","last_peered":"2024-09-12T17:11:43.796641+0000","last_clean":"2024-09-12T17:11:43.796641+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:11:43.796641+0000","last_undegraded":"2024-09-12T17:11:43.796641+0000","last_fullsized":"2024-09-12T17:11:43.796641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:07.452224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.820930+0000","last_change":"2024-09-12T17:11:14.771522+0000","last_active":"2024-09-12T17:11:43.820930+0000","last_peered":"2024-09-12T17:11:43.820930+0000","last_clean":"2024-09-12T17:11:43.820930+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:11:43.820930+0000","last_undegraded":"2024-09-12T17:11:43.820930+0000","last_fullsized":"2024-09-12T17:11:43.820930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:22.233222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.127348+0000","last_change":"2024-09-12T17:15:18.127348+0000","last_active":"2024-09-12T17:15:18.127348+0000","last_peered":"2024-09-12T17:15:18.127348+0000","last_clean":"2024-09-12T17:15:18.127348+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:15:18.127348+0000","last_undegraded":"2024-09-12T17:15:18.127348+0000","last_fullsized":"2024-09-12T17:15:18.127348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.127110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:36.993142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.285556+0000","last_change":"2024-09-12T17:15:10.285556+0000","last_active":"2024-09-12T17:15:10.285556+0000","last_peered":"2024-09-12T17:15:10.285556+0000","last_clean":"2024-09-12T17:15:10.285556+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:15:10.285556+0000","last_undegraded":"2024-09-12T17:15:10.285556+0000","last_fullsized":"2024-09-12T17:15:10.285556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.285362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:12.449928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.037671+0000","last_change":"2024-09-12T17:15:29.037671+0000","last_active":"2024-09-12T17:15:29.037671+0000","last_peered":"2024-09-12T17:15:29.037671+0000","last_clean":"2024-09-12T17:15:29.037671+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:15:29.037671+0000","last_undegraded":"2024-09-12T17:15:29.037671+0000","last_fullsized":"2024-09-12T17:15:29.037671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.037477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:54.325784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.004291+0000","last_change":"2024-09-12T17:11:10.744710+0000","last_active":"2024-09-12T17:14:51.004291+0000","last_peered":"2024-09-12T17:14:51.004291+0000","last_clean":"2024-09-12T17:14:51.004291+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:14:51.004291+0000","last_undegraded":"2024-09-12T17:14:51.004291+0000","last_fullsized":"2024-09-12T17:14:51.004291+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:54:36.899826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.119280+0000","last_change":"2024-09-12T17:15:17.119280+0000","last_active":"2024-09-12T17:15:17.119280+0000","last_peered":"2024-09-12T17:15:17.119280+0000","last_clean":"2024-09-12T17:15:17.119280+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:15:17.119280+0000","last_undegraded":"2024-09-12T17:15:17.119280+0000","last_fullsized":"2024-09-12T17:15:17.119280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.119084+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:32.612758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.581681+0000","last_change":"2024-09-12T17:14:58.581536+0000","last_active":"2024-09-12T17:14:58.581681+0000","last_peered":"2024-09-12T17:14:58.581681+0000","last_clean":"2024-09-12T17:14:58.581681+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:14:58.581681+0000","last_undegraded":"2024-09-12T17:14:58.581681+0000","last_fullsized":"2024-09-12T17:14:58.581681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.581351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:14.075025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.898232+0000","last_change":"2024-09-12T17:15:32.898232+0000","last_active":"2024-09-12T17:15:32.898232+0000","last_peered":"2024-09-12T17:15:32.898232+0000","last_clean":"2024-09-12T17:15:32.898232+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:15:32.898232+0000","last_undegraded":"2024-09-12T17:15:32.898232+0000","last_fullsized":"2024-09-12T17:15:32.898232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.898046+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:58.817691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.173634+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:14:51.173634+0000","last_peered":"2024-09-12T17:14:51.173634+0000","last_clean":"2024-09-12T17:14:51.173634+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:14:51.173634+0000","last_undegraded":"2024-09-12T17:14:51.173634+0000","last_fullsized":"2024-09-12T17:14:51.173634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.132949+0000","last_change":"2024-09-12T17:15:16.132949+0000","last_active":"2024-09-12T17:15:16.132949+0000","last_peered":"2024-09-12T17:15:16.132949+0000","last_clean":"2024-09-12T17:15:16.132949+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:15:16.132949+0000","last_undegraded":"2024-09-12T17:15:16.132949+0000","last_fullsized":"2024-09-12T17:15:16.132949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.132765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:16.951874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.868010+0000","last_change":"2024-09-12T17:15:01.867847+0000","last_active":"2024-09-12T17:15:01.868010+0000","last_peered":"2024-09-12T17:15:01.868010+0000","last_clean":"2024-09-12T17:15:01.868010+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:15:01.868010+0000","last_undegraded":"2024-09-12T17:15:01.868010+0000","last_fullsized":"2024-09-12T17:15:01.868010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.867668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.434128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:15.181154+0000","last_change":"2024-09-12T17:11:08.717659+0000","last_active":"2024-09-12T17:13:15.181154+0000","last_peered":"2024-09-12T17:13:15.181154+0000","last_clean":"2024-09-12T17:13:15.181154+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:13:15.181154+0000","last_undegraded":"2024-09-12T17:13:15.181154+0000","last_fullsized":"2024-09-12T17:13:15.181154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:07.665249+0000","last_clean_scrub_stamp":"2024-09-12T17:11:07.665249+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:01.649493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.945459+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:50.945459+0000","last_peered":"2024-09-12T17:14:50.945459+0000","last_clean":"2024-09-12T17:14:50.945459+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:50.945459+0000","last_undegraded":"2024-09-12T17:14:50.945459+0000","last_fullsized":"2024-09-12T17:14:50.945459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798254+0000","last_change":"2024-09-12T17:11:12.755331+0000","last_active":"2024-09-12T17:11:43.798254+0000","last_peered":"2024-09-12T17:11:43.798254+0000","last_clean":"2024-09-12T17:11:43.798254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:11:43.798254+0000","last_undegraded":"2024-09-12T17:11:43.798254+0000","last_fullsized":"2024-09-12T17:11:43.798254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:16.365074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.810587+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:16.810587+0000","last_peered":"2024-09-12T17:13:16.810587+0000","last_clean":"2024-09-12T17:13:16.810587+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:16.810587+0000","last_undegraded":"2024-09-12T17:13:16.810587+0000","last_fullsized":"2024-09-12T17:13:16.810587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:16.834095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.889371+0000","last_change":"2024-09-12T17:15:17.889200+0000","last_active":"2024-09-12T17:15:17.889371+0000","last_peered":"2024-09-12T17:15:17.889371+0000","last_clean":"2024-09-12T17:15:17.889371+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:15:17.889371+0000","last_undegraded":"2024-09-12T17:15:17.889371+0000","last_fullsized":"2024-09-12T17:15:17.889371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.889016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:57.728810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.238720+0000","last_change":"2024-09-12T17:15:05.238547+0000","last_active":"2024-09-12T17:15:05.238720+0000","last_peered":"2024-09-12T17:15:05.238720+0000","last_clean":"2024-09-12T17:15:05.238720+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:15:05.238720+0000","last_undegraded":"2024-09-12T17:15:05.238720+0000","last_fullsized":"2024-09-12T17:15:05.238720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.238353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:56.750159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.671276+0000","last_change":"2024-09-12T17:15:20.671042+0000","last_active":"2024-09-12T17:15:20.671276+0000","last_peered":"2024-09-12T17:15:20.671276+0000","last_clean":"2024-09-12T17:15:20.671276+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:15:20.671276+0000","last_undegraded":"2024-09-12T17:15:20.671276+0000","last_fullsized":"2024-09-12T17:15:20.671276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.670806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:30.872392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.616378+0000","last_change":"2024-09-12T17:15:02.616092+0000","last_active":"2024-09-12T17:15:02.616378+0000","last_peered":"2024-09-12T17:15:02.616378+0000","last_clean":"2024-09-12T17:15:02.616378+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:15:02.616378+0000","last_undegraded":"2024-09-12T17:15:02.616378+0000","last_fullsized":"2024-09-12T17:15:02.616378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.615816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.024352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.322903+0000","last_change":"2024-09-12T17:15:34.322903+0000","last_active":"2024-09-12T17:15:34.322903+0000","last_peered":"2024-09-12T17:15:34.322903+0000","last_clean":"2024-09-12T17:15:34.322903+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:15:34.322903+0000","last_undegraded":"2024-09-12T17:15:34.322903+0000","last_fullsized":"2024-09-12T17:15:34.322903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.322694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:48.925147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.284536+0000","last_change":"2024-09-12T17:15:13.284400+0000","last_active":"2024-09-12T17:15:13.284536+0000","last_peered":"2024-09-12T17:15:13.284536+0000","last_clean":"2024-09-12T17:15:13.284536+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:15:13.284536+0000","last_undegraded":"2024-09-12T17:15:13.284536+0000","last_fullsized":"2024-09-12T17:15:13.284536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.284187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:57.850098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.670504+0000","last_change":"2024-09-12T17:15:19.670350+0000","last_active":"2024-09-12T17:15:19.670504+0000","last_peered":"2024-09-12T17:15:19.670504+0000","last_clean":"2024-09-12T17:15:19.670504+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:15:19.670504+0000","last_undegraded":"2024-09-12T17:15:19.670504+0000","last_fullsized":"2024-09-12T17:15:19.670504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.670162+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:29.009474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.567132+0000","last_change":"2024-09-12T17:15:03.566984+0000","last_active":"2024-09-12T17:15:03.567132+0000","last_peered":"2024-09-12T17:15:03.567132+0000","last_clean":"2024-09-12T17:15:03.567132+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:15:03.567132+0000","last_undegraded":"2024-09-12T17:15:03.567132+0000","last_fullsized":"2024-09-12T17:15:03.567132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.566768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:47.560762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.649801+0000","last_change":"2024-09-12T17:15:17.649633+0000","last_active":"2024-09-12T17:15:17.649801+0000","last_peered":"2024-09-12T17:15:17.649801+0000","last_clean":"2024-09-12T17:15:17.649801+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:15:17.649801+0000","last_undegraded":"2024-09-12T17:15:17.649801+0000","last_fullsized":"2024-09-12T17:15:17.649801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.649454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:05.606953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.571576+0000","last_change":"2024-09-12T17:15:04.571415+0000","last_active":"2024-09-12T17:15:04.571576+0000","last_peered":"2024-09-12T17:15:04.571576+0000","last_clean":"2024-09-12T17:15:04.571576+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:15:04.571576+0000","last_undegraded":"2024-09-12T17:15:04.571576+0000","last_fullsized":"2024-09-12T17:15:04.571576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.571227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:38.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.873095+0000","last_change":"2024-09-12T17:15:16.872841+0000","last_active":"2024-09-12T17:15:16.873095+0000","last_peered":"2024-09-12T17:15:16.873095+0000","last_clean":"2024-09-12T17:15:16.873095+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:15:16.873095+0000","last_undegraded":"2024-09-12T17:15:16.873095+0000","last_fullsized":"2024-09-12T17:15:16.873095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.872542+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:45.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.875249+0000","last_change":"2024-09-12T17:15:03.875105+0000","last_active":"2024-09-12T17:15:03.875249+0000","last_peered":"2024-09-12T17:15:03.875249+0000","last_clean":"2024-09-12T17:15:03.875249+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:15:03.875249+0000","last_undegraded":"2024-09-12T17:15:03.875249+0000","last_fullsized":"2024-09-12T17:15:03.875249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.874897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:32.945371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.700030+0000","last_change":"2024-09-12T17:15:18.699771+0000","last_active":"2024-09-12T17:15:18.700030+0000","last_peered":"2024-09-12T17:15:18.700030+0000","last_clean":"2024-09-12T17:15:18.700030+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:15:18.700030+0000","last_undegraded":"2024-09-12T17:15:18.700030+0000","last_fullsized":"2024-09-12T17:15:18.700030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.699553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:11.188707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.247386+0000","last_change":"2024-09-12T17:15:04.247188+0000","last_active":"2024-09-12T17:15:04.247386+0000","last_peered":"2024-09-12T17:15:04.247386+0000","last_clean":"2024-09-12T17:15:04.247386+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:15:04.247386+0000","last_undegraded":"2024-09-12T17:15:04.247386+0000","last_fullsized":"2024-09-12T17:15:04.247386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.247001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:40.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.861612+0000","last_change":"2024-09-12T17:15:15.861444+0000","last_active":"2024-09-12T17:15:15.861612+0000","last_peered":"2024-09-12T17:15:15.861612+0000","last_clean":"2024-09-12T17:15:15.861612+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:15:15.861612+0000","last_undegraded":"2024-09-12T17:15:15.861612+0000","last_fullsized":"2024-09-12T17:15:15.861612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.861265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.696684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.597439+0000","last_change":"2024-09-12T17:15:05.597274+0000","last_active":"2024-09-12T17:15:05.597439+0000","last_peered":"2024-09-12T17:15:05.597439+0000","last_clean":"2024-09-12T17:15:05.597439+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:15:05.597439+0000","last_undegraded":"2024-09-12T17:15:05.597439+0000","last_fullsized":"2024-09-12T17:15:05.597439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.597076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.894740+0000","last_change":"2024-09-12T17:15:21.894740+0000","last_active":"2024-09-12T17:15:21.894740+0000","last_peered":"2024-09-12T17:15:21.894740+0000","last_clean":"2024-09-12T17:15:21.894740+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:15:21.894740+0000","last_undegraded":"2024-09-12T17:15:21.894740+0000","last_fullsized":"2024-09-12T17:15:21.894740+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.894560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:42.114364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.277700+0000","last_change":"2024-09-12T17:15:14.277545+0000","last_active":"2024-09-12T17:15:14.277700+0000","last_peered":"2024-09-12T17:15:14.277700+0000","last_clean":"2024-09-12T17:15:14.277700+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:15:14.277700+0000","last_undegraded":"2024-09-12T17:15:14.277700+0000","last_fullsized":"2024-09-12T17:15:14.277700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.277335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.472821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.815860+0000","last_change":"2024-09-12T17:11:06.695150+0000","last_active":"2024-09-12T17:11:43.815860+0000","last_peered":"2024-09-12T17:11:43.815860+0000","last_clean":"2024-09-12T17:11:43.815860+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:11:43.815860+0000","last_undegraded":"2024-09-12T17:11:43.815860+0000","last_fullsized":"2024-09-12T17:11:43.815860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:05.648722+0000","last_clean_scrub_stamp":"2024-09-12T17:11:05.648722+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:41.509810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.549503+0000","last_change":"2024-09-12T17:15:06.549362+0000","last_active":"2024-09-12T17:15:06.549503+0000","last_peered":"2024-09-12T17:15:06.549503+0000","last_clean":"2024-09-12T17:15:06.549503+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:15:06.549503+0000","last_undegraded":"2024-09-12T17:15:06.549503+0000","last_fullsized":"2024-09-12T17:15:06.549503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.549179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:02.554930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.628515+0000","last_change":"2024-09-12T17:15:21.628515+0000","last_active":"2024-09-12T17:15:21.628515+0000","last_peered":"2024-09-12T17:15:21.628515+0000","last_clean":"2024-09-12T17:15:21.628515+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:15:21.628515+0000","last_undegraded":"2024-09-12T17:15:21.628515+0000","last_fullsized":"2024-09-12T17:15:21.628515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.628332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:19.659256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.916560+0000","last_change":"2024-09-12T17:15:04.916380+0000","last_active":"2024-09-12T17:15:04.916560+0000","last_peered":"2024-09-12T17:15:04.916560+0000","last_clean":"2024-09-12T17:15:04.916560+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:15:04.916560+0000","last_undegraded":"2024-09-12T17:15:04.916560+0000","last_fullsized":"2024-09-12T17:15:04.916560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.916186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:14.335123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'20","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.882754+0000","last_change":"2024-09-12T17:15:22.882754+0000","last_active":"2024-09-12T17:15:22.882754+0000","last_peered":"2024-09-12T17:15:22.882754+0000","last_clean":"2024-09-12T17:15:22.882754+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:15:22.882754+0000","last_undegraded":"2024-09-12T17:15:22.882754+0000","last_fullsized":"2024-09-12T17:15:22.882754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.882573+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:01.302462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.892920+0000","last_change":"2024-09-12T17:15:05.892750+0000","last_active":"2024-09-12T17:15:05.892920+0000","last_peered":"2024-09-12T17:15:05.892920+0000","last_clean":"2024-09-12T17:15:05.892920+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:15:05.892920+0000","last_undegraded":"2024-09-12T17:15:05.892920+0000","last_fullsized":"2024-09-12T17:15:05.892920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.892542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.813883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.916708+0000","last_change":"2024-09-12T17:15:19.916708+0000","last_active":"2024-09-12T17:15:19.916708+0000","last_peered":"2024-09-12T17:15:19.916708+0000","last_clean":"2024-09-12T17:15:19.916708+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:15:19.916708+0000","last_undegraded":"2024-09-12T17:15:19.916708+0000","last_fullsized":"2024-09-12T17:15:19.916708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.916525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.259459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.324327+0000","last_change":"2024-09-12T17:15:20.324077+0000","last_active":"2024-09-12T17:15:20.324327+0000","last_peered":"2024-09-12T17:15:20.324327+0000","last_clean":"2024-09-12T17:15:20.324327+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:15:20.324327+0000","last_undegraded":"2024-09-12T17:15:20.324327+0000","last_fullsized":"2024-09-12T17:15:20.324327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.323778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:06.113896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.882625+0000","last_change":"2024-09-12T17:15:20.882625+0000","last_active":"2024-09-12T17:15:20.882625+0000","last_peered":"2024-09-12T17:15:20.882625+0000","last_clean":"2024-09-12T17:15:20.882625+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:15:20.882625+0000","last_undegraded":"2024-09-12T17:15:20.882625+0000","last_fullsized":"2024-09-12T17:15:20.882625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.882443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.227785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.295924+0000","last_change":"2024-09-12T17:15:16.295674+0000","last_active":"2024-09-12T17:15:16.295924+0000","last_peered":"2024-09-12T17:15:16.295924+0000","last_clean":"2024-09-12T17:15:16.295924+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:15:16.295924+0000","last_undegraded":"2024-09-12T17:15:16.295924+0000","last_fullsized":"2024-09-12T17:15:16.295924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.295447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:39.795551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.138893+0000","last_change":"2024-09-12T17:15:20.138893+0000","last_active":"2024-09-12T17:15:20.138893+0000","last_peered":"2024-09-12T17:15:20.138893+0000","last_clean":"2024-09-12T17:15:20.138893+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:15:20.138893+0000","last_undegraded":"2024-09-12T17:15:20.138893+0000","last_fullsized":"2024-09-12T17:15:20.138893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.138667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.029770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.206386+0000","last_change":"2024-09-12T17:15:06.206386+0000","last_active":"2024-09-12T17:15:06.206386+0000","last_peered":"2024-09-12T17:15:06.206386+0000","last_clean":"2024-09-12T17:15:06.206386+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:15:06.206386+0000","last_undegraded":"2024-09-12T17:15:06.206386+0000","last_fullsized":"2024-09-12T17:15:06.206386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.206190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:25.118231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.926993+0000","last_change":"2024-09-12T17:15:18.926822+0000","last_active":"2024-09-12T17:15:18.926993+0000","last_peered":"2024-09-12T17:15:18.926993+0000","last_clean":"2024-09-12T17:15:18.926993+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:15:18.926993+0000","last_undegraded":"2024-09-12T17:15:18.926993+0000","last_fullsized":"2024-09-12T17:15:18.926993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.926612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.452117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.317282+0000","last_change":"2024-09-12T17:15:17.317282+0000","last_active":"2024-09-12T17:15:17.317282+0000","last_peered":"2024-09-12T17:15:17.317282+0000","last_clean":"2024-09-12T17:15:17.317282+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:15:17.317282+0000","last_undegraded":"2024-09-12T17:15:17.317282+0000","last_fullsized":"2024-09-12T17:15:17.317282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.317078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:13.516624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.338825+0000","last_change":"2024-09-12T17:15:18.338825+0000","last_active":"2024-09-12T17:15:18.338825+0000","last_peered":"2024-09-12T17:15:18.338825+0000","last_clean":"2024-09-12T17:15:18.338825+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:15:18.338825+0000","last_undegraded":"2024-09-12T17:15:18.338825+0000","last_fullsized":"2024-09-12T17:15:18.338825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.338612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:11.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.612356+0000","last_change":"2024-09-12T17:15:22.612356+0000","last_active":"2024-09-12T17:15:22.612356+0000","last_peered":"2024-09-12T17:15:22.612356+0000","last_clean":"2024-09-12T17:15:22.612356+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:15:22.612356+0000","last_undegraded":"2024-09-12T17:15:22.612356+0000","last_fullsized":"2024-09-12T17:15:22.612356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.612179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:31.610905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.598077+0000","last_change":"2024-09-12T17:15:07.598077+0000","last_active":"2024-09-12T17:15:07.598077+0000","last_peered":"2024-09-12T17:15:07.598077+0000","last_clean":"2024-09-12T17:15:07.598077+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:15:07.598077+0000","last_undegraded":"2024-09-12T17:15:07.598077+0000","last_fullsized":"2024-09-12T17:15:07.598077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.597893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:32.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.854853+0000","last_change":"2024-09-12T17:15:29.854853+0000","last_active":"2024-09-12T17:15:29.854853+0000","last_peered":"2024-09-12T17:15:29.854853+0000","last_clean":"2024-09-12T17:15:29.854853+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:15:29.854853+0000","last_undegraded":"2024-09-12T17:15:29.854853+0000","last_fullsized":"2024-09-12T17:15:29.854853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.854616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:22.735044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1399,"ondisk_log_size":1399,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":481,"ondisk_log_size":481,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640318,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640318,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673022,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:15:37.368 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.368 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.369 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.370 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.371 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.372 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.373 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.374 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.375 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.375 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.375 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.375 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.375 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.376 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.377 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.377 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.377 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.377 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.377 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.378 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.378 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.378 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.378 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.378 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.379 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.380 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.381 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.382 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:11:07.665249+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.383 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:11:05.648722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:37.384 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:15:57.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:15:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6696961640 1 Processor -- start 2024-09-12T17:15:57.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6696961640 1 -- start start 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6696961640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6690111890 0x7f6690132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6696961640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6690073a90 con 0x7f6690110da0 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6696961640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f66900696e0 con 0x7f6690111890 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6690110da0 0x7f6690111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55458/0 (socket says 172.21.15.62:55458) 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668ffff640 1 -- 172.21.15.62:0/1081621696 learned_addr learned my addr 172.21.15.62:0/1081621696 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:15:57.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6687fff640 1 --2- 172.21.15.62:0/1081621696 >> v2:172.21.15.62:3300/0 conn(0x7f6690111890 0x7f6690132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668f7fe640 1 -- 172.21.15.62:0/1081621696 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909215969 0 0) 0x7f6690073a90 con 0x7f6690110da0 2024-09-12T17:15:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668f7fe640 1 -- 172.21.15.62:0/1081621696 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f667c003530 con 0x7f6690110da0 2024-09-12T17:15:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6687fff640 1 -- 172.21.15.62:0/1081621696 >> v1:172.21.15.62:6789/0 conn(0x7f6690110da0 legacy=0x7f6690111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:57.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6687fff640 1 -- 172.21.15.62:0/1081621696 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669006dd50 con 0x7f6690111890 2024-09-12T17:15:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f6687fff640 1 --2- 172.21.15.62:0/1081621696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690111890 0x7f6690132450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6678009740 tx=0x7f667801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a1d885aa96a3e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668f7fe640 1 -- 172.21.15.62:0/1081621696 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66780b0070 con 0x7f6690111890 2024-09-12T17:15:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668f7fe640 1 -- 172.21.15.62:0/1081621696 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66780ab530 con 0x7f6690111890 2024-09-12T17:15:57.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.518+0000 7f668f7fe640 1 -- 172.21.15.62:0/1081621696 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66780ab810 con 0x7f6690111890 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/1081621696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690111890 msgr2=0x7f6690132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 --2- 172.21.15.62:0/1081621696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690111890 0x7f6690132450 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6678009740 tx=0x7f667801c370 comp rx=0 tx=0).stop 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/1081621696 shutdown_connections 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 --2- 172.21.15.62:0/1081621696 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690111890 0x7f6690132450 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/1081621696 >> 172.21.15.62:0/1081621696 conn(0x7f6690070900 msgr2=0x7f6690072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/1081621696 shutdown_connections 2024-09-12T17:15:57.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/1081621696 wait complete. 2024-09-12T17:15:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 Processor -- start 2024-09-12T17:15:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- start start 2024-09-12T17:15:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6690135330 con 0x7f6690110da0 2024-09-12T17:15:57.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59870/0 (socket says 172.21.15.62:59870) 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668ffff640 1 -- 172.21.15.62:0/3945895231 learned_addr learned my addr 172.21.15.62:0/3945895231 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668ffff640 1 -- 172.21.15.62:0/3945895231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66901314c0 con 0x7f6690110da0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668ffff640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f668000c450 tx=0x7f668000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6680017070 con 0x7f6690110da0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680005ce0 con 0x7f6690110da0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6690131da0 con 0x7f6690110da0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6680007200 con 0x7f6690110da0 2024-09-12T17:15:57.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901221f0 con 0x7f6690110da0 2024-09-12T17:15:57.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66901320e0 con 0x7f6690110da0 2024-09-12T17:15:57.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f668001a070 con 0x7f6690110da0 2024-09-12T17:15:57.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.522+0000 7f668d7fa640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 0x7f667003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:15:57.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.526+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f668004eaa0 con 0x7f6690110da0 2024-09-12T17:15:57.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.526+0000 7f6687fff640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 0x7f667003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:15:57.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.526+0000 7f6687fff640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 0x7f667003d6c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66780ad000 tx=0x7f6678008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:15:57.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.530+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f66901320e0 con 0x7f6690110da0 2024-09-12T17:15:57.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.694+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6690115540 con 0x7f667003b200 2024-09-12T17:15:57.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.722+0000 7f668d7fa640 1 -- 172.21.15.62:0/3945895231 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665421 (secure 0 0 0) 0x7f6690115540 con 0x7f667003b200 2024-09-12T17:15:57.733 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:15:57.738 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 msgr2=0x7f667003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 0x7f667003d6c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66780ad000 tx=0x7f6678008040 comp rx=0 tx=0).stop 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 msgr2=0x7f6690121ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f668000c450 tx=0x7f668000c910 comp rx=0 tx=0).stop 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 shutdown_connections 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f667003b200 0x7f667003d6c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 --2- 172.21.15.62:0/3945895231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6690110da0 0x7f6690121ae0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 >> 172.21.15.62:0/3945895231 conn(0x7f6690070900 msgr2=0x7f6690129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 shutdown_connections 2024-09-12T17:15:57.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:15:57.730+0000 7f6696961640 1 -- 172.21.15.62:0/3945895231 wait complete. 2024-09-12T17:15:57.750 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-12T17:15:56.813484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5148,"num_read_kb":4734,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4747,"ondisk_log_size":4747,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165088,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322272,"statfs":{"total":386547056640,"available":386378006528,"internally_reserved":0,"allocated":2981888,"data_stored":1783504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006561"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.201214+0000","last_change":"2024-09-12T17:15:10.201061+0000","last_active":"2024-09-12T17:15:10.201214+0000","last_peered":"2024-09-12T17:15:10.201214+0000","last_clean":"2024-09-12T17:15:10.201214+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:15:10.201214+0000","last_undegraded":"2024-09-12T17:15:10.201214+0000","last_fullsized":"2024-09-12T17:15:10.201214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.200874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:33.595229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.829156+0000","last_change":"2024-09-12T17:15:26.829156+0000","last_active":"2024-09-12T17:15:26.829156+0000","last_peered":"2024-09-12T17:15:26.829156+0000","last_clean":"2024-09-12T17:15:26.829156+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:15:26.829156+0000","last_undegraded":"2024-09-12T17:15:26.829156+0000","last_fullsized":"2024-09-12T17:15:26.829156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.828983+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:58.923967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.622651+0000","last_change":"2024-09-12T17:15:10.622455+0000","last_active":"2024-09-12T17:15:10.622651+0000","last_peered":"2024-09-12T17:15:10.622651+0000","last_clean":"2024-09-12T17:15:10.622651+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:15:10.622651+0000","last_undegraded":"2024-09-12T17:15:10.622651+0000","last_fullsized":"2024-09-12T17:15:10.622651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.622272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:24.192408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.375409+0000","last_change":"2024-09-12T17:15:38.375409+0000","last_active":"2024-09-12T17:15:38.375409+0000","last_peered":"2024-09-12T17:15:38.375409+0000","last_clean":"2024-09-12T17:15:38.375409+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:15:38.375409+0000","last_undegraded":"2024-09-12T17:15:38.375409+0000","last_fullsized":"2024-09-12T17:15:38.375409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.375231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:29.887495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.322131+0000","last_change":"2024-09-12T17:15:24.322131+0000","last_active":"2024-09-12T17:15:24.322131+0000","last_peered":"2024-09-12T17:15:24.322131+0000","last_clean":"2024-09-12T17:15:24.322131+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:15:24.322131+0000","last_undegraded":"2024-09-12T17:15:24.322131+0000","last_fullsized":"2024-09-12T17:15:24.322131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.321949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:20.438915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.435046+0000","last_change":"2024-09-12T17:15:48.435046+0000","last_active":"2024-09-12T17:15:48.435046+0000","last_peered":"2024-09-12T17:15:48.435046+0000","last_clean":"2024-09-12T17:15:48.435046+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:15:48.435046+0000","last_undegraded":"2024-09-12T17:15:48.435046+0000","last_fullsized":"2024-09-12T17:15:48.435046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.434851+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:16.242984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.169692+0000","last_change":"2024-09-12T17:15:09.169692+0000","last_active":"2024-09-12T17:15:09.169692+0000","last_peered":"2024-09-12T17:15:09.169692+0000","last_clean":"2024-09-12T17:15:09.169692+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:15:09.169692+0000","last_undegraded":"2024-09-12T17:15:09.169692+0000","last_fullsized":"2024-09-12T17:15:09.169692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.169513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:40.605000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.167353+0000","last_change":"2024-09-12T17:15:21.167353+0000","last_active":"2024-09-12T17:15:21.167353+0000","last_peered":"2024-09-12T17:15:21.167353+0000","last_clean":"2024-09-12T17:15:21.167353+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:15:21.167353+0000","last_undegraded":"2024-09-12T17:15:21.167353+0000","last_fullsized":"2024-09-12T17:15:21.167353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.167170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:52.575705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.283073+0000","last_change":"2024-09-12T17:15:22.283073+0000","last_active":"2024-09-12T17:15:22.283073+0000","last_peered":"2024-09-12T17:15:22.283073+0000","last_clean":"2024-09-12T17:15:22.283073+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:15:22.283073+0000","last_undegraded":"2024-09-12T17:15:22.283073+0000","last_fullsized":"2024-09-12T17:15:22.283073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.282894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.208753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.854962+0000","last_change":"2024-09-12T17:15:27.854962+0000","last_active":"2024-09-12T17:15:27.854962+0000","last_peered":"2024-09-12T17:15:27.854962+0000","last_clean":"2024-09-12T17:15:27.854962+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:15:27.854962+0000","last_undegraded":"2024-09-12T17:15:27.854962+0000","last_fullsized":"2024-09-12T17:15:27.854962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.854752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:50.593286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.164616+0000","last_change":"2024-09-12T17:15:07.164616+0000","last_active":"2024-09-12T17:15:07.164616+0000","last_peered":"2024-09-12T17:15:07.164616+0000","last_clean":"2024-09-12T17:15:07.164616+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:15:07.164616+0000","last_undegraded":"2024-09-12T17:15:07.164616+0000","last_fullsized":"2024-09-12T17:15:07.164616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.164431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:00.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.381876+0000","last_change":"2024-09-12T17:15:39.381876+0000","last_active":"2024-09-12T17:15:39.381876+0000","last_peered":"2024-09-12T17:15:39.381876+0000","last_clean":"2024-09-12T17:15:39.381876+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:15:39.381876+0000","last_undegraded":"2024-09-12T17:15:39.381876+0000","last_fullsized":"2024-09-12T17:15:39.381876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.381696+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.508456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.293319+0000","last_change":"2024-09-12T17:15:23.293319+0000","last_active":"2024-09-12T17:15:23.293319+0000","last_peered":"2024-09-12T17:15:23.293319+0000","last_clean":"2024-09-12T17:15:23.293319+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:15:23.293319+0000","last_undegraded":"2024-09-12T17:15:23.293319+0000","last_fullsized":"2024-09-12T17:15:23.293319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.293137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:49.114945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.127964+0000","last_change":"2024-09-12T17:15:23.127964+0000","last_active":"2024-09-12T17:15:23.127964+0000","last_peered":"2024-09-12T17:15:23.127964+0000","last_clean":"2024-09-12T17:15:23.127964+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:15:23.127964+0000","last_undegraded":"2024-09-12T17:15:23.127964+0000","last_fullsized":"2024-09-12T17:15:23.127964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.127781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:57.207825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.599330+0000","last_change":"2024-09-12T17:15:09.599330+0000","last_active":"2024-09-12T17:15:09.599330+0000","last_peered":"2024-09-12T17:15:09.599330+0000","last_clean":"2024-09-12T17:15:09.599330+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:15:09.599330+0000","last_undegraded":"2024-09-12T17:15:09.599330+0000","last_fullsized":"2024-09-12T17:15:09.599330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.599149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:05.569735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.044367+0000","last_change":"2024-09-12T17:15:25.044367+0000","last_active":"2024-09-12T17:15:25.044367+0000","last_peered":"2024-09-12T17:15:25.044367+0000","last_clean":"2024-09-12T17:15:25.044367+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:15:25.044367+0000","last_undegraded":"2024-09-12T17:15:25.044367+0000","last_fullsized":"2024-09-12T17:15:25.044367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.044184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.581742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.401201+0000","last_change":"2024-09-12T17:15:37.401065+0000","last_active":"2024-09-12T17:15:37.401201+0000","last_peered":"2024-09-12T17:15:37.401201+0000","last_clean":"2024-09-12T17:15:37.401201+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:15:37.401201+0000","last_undegraded":"2024-09-12T17:15:37.401201+0000","last_fullsized":"2024-09-12T17:15:37.401201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.400885+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:38.552754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.870421+0000","last_change":"2024-09-12T17:15:08.870146+0000","last_active":"2024-09-12T17:15:08.870421+0000","last_peered":"2024-09-12T17:15:08.870421+0000","last_clean":"2024-09-12T17:15:08.870421+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:15:08.870421+0000","last_undegraded":"2024-09-12T17:15:08.870421+0000","last_fullsized":"2024-09-12T17:15:08.870421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.869833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:16.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.845610+0000","last_change":"2024-09-12T17:15:23.845462+0000","last_active":"2024-09-12T17:15:23.845610+0000","last_peered":"2024-09-12T17:15:23.845610+0000","last_clean":"2024-09-12T17:15:23.845610+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:15:23.845610+0000","last_undegraded":"2024-09-12T17:15:23.845610+0000","last_fullsized":"2024-09-12T17:15:23.845610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.845288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.261304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.197517+0000","last_change":"2024-09-12T17:15:08.197517+0000","last_active":"2024-09-12T17:15:08.197517+0000","last_peered":"2024-09-12T17:15:08.197517+0000","last_clean":"2024-09-12T17:15:08.197517+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:15:08.197517+0000","last_undegraded":"2024-09-12T17:15:08.197517+0000","last_fullsized":"2024-09-12T17:15:08.197517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.197226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.048616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.879965+0000","last_change":"2024-09-12T17:15:24.879802+0000","last_active":"2024-09-12T17:15:24.879965+0000","last_peered":"2024-09-12T17:15:24.879965+0000","last_clean":"2024-09-12T17:15:24.879965+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:15:24.879965+0000","last_undegraded":"2024-09-12T17:15:24.879965+0000","last_fullsized":"2024-09-12T17:15:24.879965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.879626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:47.997644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.892682+0000","last_change":"2024-09-12T17:15:07.892541+0000","last_active":"2024-09-12T17:15:07.892682+0000","last_peered":"2024-09-12T17:15:07.892682+0000","last_clean":"2024-09-12T17:15:07.892682+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:15:07.892682+0000","last_undegraded":"2024-09-12T17:15:07.892682+0000","last_fullsized":"2024-09-12T17:15:07.892682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.892360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:31.964096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.648776+0000","last_change":"2024-09-12T17:15:23.648776+0000","last_active":"2024-09-12T17:15:23.648776+0000","last_peered":"2024-09-12T17:15:23.648776+0000","last_clean":"2024-09-12T17:15:23.648776+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:23.648776+0000","last_undegraded":"2024-09-12T17:15:23.648776+0000","last_fullsized":"2024-09-12T17:15:23.648776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.648589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:28.617881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.918542+0000","last_change":"2024-09-12T17:15:06.918374+0000","last_active":"2024-09-12T17:15:06.918542+0000","last_peered":"2024-09-12T17:15:06.918542+0000","last_clean":"2024-09-12T17:15:06.918542+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:15:06.918542+0000","last_undegraded":"2024-09-12T17:15:06.918542+0000","last_fullsized":"2024-09-12T17:15:06.918542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.918133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:39.266087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.163926+0000","last_change":"2024-09-12T17:15:22.163926+0000","last_active":"2024-09-12T17:15:22.163926+0000","last_peered":"2024-09-12T17:15:22.163926+0000","last_clean":"2024-09-12T17:15:22.163926+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:15:22.163926+0000","last_undegraded":"2024-09-12T17:15:22.163926+0000","last_fullsized":"2024-09-12T17:15:22.163926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.163684+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:25.007706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.559377+0000","last_change":"2024-09-12T17:15:08.559195+0000","last_active":"2024-09-12T17:15:08.559377+0000","last_peered":"2024-09-12T17:15:08.559377+0000","last_clean":"2024-09-12T17:15:08.559377+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:15:08.559377+0000","last_undegraded":"2024-09-12T17:15:08.559377+0000","last_fullsized":"2024-09-12T17:15:08.559377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.558975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.680852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.841423+0000","last_change":"2024-09-12T17:15:25.841423+0000","last_active":"2024-09-12T17:15:25.841423+0000","last_peered":"2024-09-12T17:15:25.841423+0000","last_clean":"2024-09-12T17:15:25.841423+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:25.841423+0000","last_undegraded":"2024-09-12T17:15:25.841423+0000","last_fullsized":"2024-09-12T17:15:25.841423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.841247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.853720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.330124+0000","last_change":"2024-09-12T17:15:19.329873+0000","last_active":"2024-09-12T17:15:19.330124+0000","last_peered":"2024-09-12T17:15:19.330124+0000","last_clean":"2024-09-12T17:15:19.330124+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:15:19.330124+0000","last_undegraded":"2024-09-12T17:15:19.330124+0000","last_fullsized":"2024-09-12T17:15:19.330124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.329648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:26.468038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'39","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.744750+0000","last_change":"2024-09-12T17:11:14.773600+0000","last_active":"2024-09-12T17:14:19.744750+0000","last_peered":"2024-09-12T17:14:19.744750+0000","last_clean":"2024-09-12T17:14:19.744750+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:14:19.744750+0000","last_undegraded":"2024-09-12T17:14:19.744750+0000","last_fullsized":"2024-09-12T17:14:19.744750+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:40:30.775031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.310849+0000","last_change":"2024-09-12T17:15:31.310675+0000","last_active":"2024-09-12T17:15:31.310849+0000","last_peered":"2024-09-12T17:15:31.310849+0000","last_clean":"2024-09-12T17:15:31.310849+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:15:31.310849+0000","last_undegraded":"2024-09-12T17:15:31.310849+0000","last_fullsized":"2024-09-12T17:15:31.310849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.310493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:52.984419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.263490+0000","last_change":"2024-09-12T17:15:08.263324+0000","last_active":"2024-09-12T17:15:08.263490+0000","last_peered":"2024-09-12T17:15:08.263490+0000","last_clean":"2024-09-12T17:15:08.263490+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:15:08.263490+0000","last_undegraded":"2024-09-12T17:15:08.263490+0000","last_fullsized":"2024-09-12T17:15:08.263490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.263141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:50.866547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.402317+0000","last_change":"2024-09-12T17:15:47.402317+0000","last_active":"2024-09-12T17:15:47.402317+0000","last_peered":"2024-09-12T17:15:47.402317+0000","last_clean":"2024-09-12T17:15:47.402317+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:15:47.402317+0000","last_undegraded":"2024-09-12T17:15:47.402317+0000","last_fullsized":"2024-09-12T17:15:47.402317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.402138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:47.917779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'33","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.119433+0000","last_change":"2024-09-12T17:11:10.746327+0000","last_active":"2024-09-12T17:14:51.119433+0000","last_peered":"2024-09-12T17:14:51.119433+0000","last_clean":"2024-09-12T17:14:51.119433+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:14:51.119433+0000","last_undegraded":"2024-09-12T17:14:51.119433+0000","last_fullsized":"2024-09-12T17:14:51.119433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:23.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.865702+0000","last_change":"2024-09-12T17:15:49.865702+0000","last_active":"2024-09-12T17:15:49.865702+0000","last_peered":"2024-09-12T17:15:49.865702+0000","last_clean":"2024-09-12T17:15:49.865702+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:15:49.865702+0000","last_undegraded":"2024-09-12T17:15:49.865702+0000","last_fullsized":"2024-09-12T17:15:49.865702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.865463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:43.752559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.696496+0000","last_change":"2024-09-12T17:11:14.766301+0000","last_active":"2024-09-12T17:12:33.696496+0000","last_peered":"2024-09-12T17:12:33.696496+0000","last_clean":"2024-09-12T17:12:33.696496+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:12:33.696496+0000","last_undegraded":"2024-09-12T17:12:33.696496+0000","last_fullsized":"2024-09-12T17:12:33.696496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:25:11.438481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.328446+0000","last_change":"2024-09-12T17:15:30.328446+0000","last_active":"2024-09-12T17:15:30.328446+0000","last_peered":"2024-09-12T17:15:30.328446+0000","last_clean":"2024-09-12T17:15:30.328446+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:15:30.328446+0000","last_undegraded":"2024-09-12T17:15:30.328446+0000","last_fullsized":"2024-09-12T17:15:30.328446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.328228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.601658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.272407+0000","last_change":"2024-09-12T17:15:01.272260+0000","last_active":"2024-09-12T17:15:01.272407+0000","last_peered":"2024-09-12T17:15:01.272407+0000","last_clean":"2024-09-12T17:15:01.272407+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:15:01.272407+0000","last_undegraded":"2024-09-12T17:15:01.272407+0000","last_fullsized":"2024-09-12T17:15:01.272407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.272070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:11.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.670280+0000","last_change":"2024-09-12T17:15:30.670135+0000","last_active":"2024-09-12T17:15:30.670280+0000","last_peered":"2024-09-12T17:15:30.670280+0000","last_clean":"2024-09-12T17:15:30.670280+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:15:30.670280+0000","last_undegraded":"2024-09-12T17:15:30.670280+0000","last_fullsized":"2024-09-12T17:15:30.670280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.669946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:54.167361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.887582+0000","last_change":"2024-09-12T17:15:41.887582+0000","last_active":"2024-09-12T17:15:41.887582+0000","last_peered":"2024-09-12T17:15:41.887582+0000","last_clean":"2024-09-12T17:15:41.887582+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:15:41.887582+0000","last_undegraded":"2024-09-12T17:15:41.887582+0000","last_fullsized":"2024-09-12T17:15:41.887582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.887381+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:40.760250+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.795609+0000","last_change":"2024-09-12T17:15:46.795609+0000","last_active":"2024-09-12T17:15:46.795609+0000","last_peered":"2024-09-12T17:15:46.795609+0000","last_clean":"2024-09-12T17:15:46.795609+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:15:46.795609+0000","last_undegraded":"2024-09-12T17:15:46.795609+0000","last_fullsized":"2024-09-12T17:15:46.795609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.795426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:26.633699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:12:33.993273+0000","last_change":"2024-09-12T17:11:14.779049+0000","last_active":"2024-09-12T17:12:33.993273+0000","last_peered":"2024-09-12T17:12:33.993273+0000","last_clean":"2024-09-12T17:12:33.993273+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:12:33.993273+0000","last_undegraded":"2024-09-12T17:12:33.993273+0000","last_fullsized":"2024-09-12T17:12:33.993273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:35:41.340589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.331908+0000","last_change":"2024-09-12T17:15:32.331908+0000","last_active":"2024-09-12T17:15:32.331908+0000","last_peered":"2024-09-12T17:15:32.331908+0000","last_clean":"2024-09-12T17:15:32.331908+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:15:32.331908+0000","last_undegraded":"2024-09-12T17:15:32.331908+0000","last_fullsized":"2024-09-12T17:15:32.331908+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.331702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.106105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.310265+0000","last_change":"2024-09-12T17:15:07.310022+0000","last_active":"2024-09-12T17:15:07.310265+0000","last_peered":"2024-09-12T17:15:07.310265+0000","last_clean":"2024-09-12T17:15:07.310265+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:15:07.310265+0000","last_undegraded":"2024-09-12T17:15:07.310265+0000","last_fullsized":"2024-09-12T17:15:07.310265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.309797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:17.281335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.656874+0000","last_change":"2024-09-12T17:15:31.656874+0000","last_active":"2024-09-12T17:15:31.656874+0000","last_peered":"2024-09-12T17:15:31.656874+0000","last_clean":"2024-09-12T17:15:31.656874+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:15:31.656874+0000","last_undegraded":"2024-09-12T17:15:31.656874+0000","last_fullsized":"2024-09-12T17:15:31.656874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.656700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:53.215267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.996303+0000","last_change":"2024-09-12T17:15:35.996162+0000","last_active":"2024-09-12T17:15:35.996303+0000","last_peered":"2024-09-12T17:15:35.996303+0000","last_clean":"2024-09-12T17:15:35.996303+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:15:35.996303+0000","last_undegraded":"2024-09-12T17:15:35.996303+0000","last_fullsized":"2024-09-12T17:15:35.996303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.995960+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.485115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":386,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.861195+0000","last_change":"2024-09-12T17:11:12.745549+0000","last_active":"2024-09-12T17:14:50.861195+0000","last_peered":"2024-09-12T17:14:50.861195+0000","last_clean":"2024-09-12T17:14:50.861195+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:14:50.861195+0000","last_undegraded":"2024-09-12T17:14:50.861195+0000","last_fullsized":"2024-09-12T17:14:50.861195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:11.358421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.957435+0000","last_change":"2024-09-12T17:15:48.957435+0000","last_active":"2024-09-12T17:15:48.957435+0000","last_peered":"2024-09-12T17:15:48.957435+0000","last_clean":"2024-09-12T17:15:48.957435+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:15:48.957435+0000","last_undegraded":"2024-09-12T17:15:48.957435+0000","last_fullsized":"2024-09-12T17:15:48.957435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.957213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:34.560093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.646081+0000","last_change":"2024-09-12T17:15:13.646081+0000","last_active":"2024-09-12T17:15:13.646081+0000","last_peered":"2024-09-12T17:15:13.646081+0000","last_clean":"2024-09-12T17:15:13.646081+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:15:13.646081+0000","last_undegraded":"2024-09-12T17:15:13.646081+0000","last_fullsized":"2024-09-12T17:15:13.646081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.645895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.911092+0000","last_change":"2024-09-12T17:14:57.910932+0000","last_active":"2024-09-12T17:14:57.911092+0000","last_peered":"2024-09-12T17:14:57.911092+0000","last_clean":"2024-09-12T17:14:57.911092+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:14:57.911092+0000","last_undegraded":"2024-09-12T17:14:57.911092+0000","last_fullsized":"2024-09-12T17:14:57.911092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.910723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:55.914281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.357811+0000","last_change":"2024-09-12T17:15:46.357811+0000","last_active":"2024-09-12T17:15:46.357811+0000","last_peered":"2024-09-12T17:15:46.357811+0000","last_clean":"2024-09-12T17:15:46.357811+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:15:46.357811+0000","last_undegraded":"2024-09-12T17:15:46.357811+0000","last_fullsized":"2024-09-12T17:15:46.357811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.357635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:16.965443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.978732+0000","last_change":"2024-09-12T17:15:36.978732+0000","last_active":"2024-09-12T17:15:36.978732+0000","last_peered":"2024-09-12T17:15:36.978732+0000","last_clean":"2024-09-12T17:15:36.978732+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.978732+0000","last_undegraded":"2024-09-12T17:15:36.978732+0000","last_fullsized":"2024-09-12T17:15:36.978732+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.978491+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:46.317803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.644683+0000","last_change":"2024-09-12T17:15:48.644518+0000","last_active":"2024-09-12T17:15:48.644683+0000","last_peered":"2024-09-12T17:15:48.644683+0000","last_clean":"2024-09-12T17:15:48.644683+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:15:48.644683+0000","last_undegraded":"2024-09-12T17:15:48.644683+0000","last_fullsized":"2024-09-12T17:15:48.644683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.644337+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:12.300130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.270515+0000","last_change":"2024-09-12T17:15:27.270380+0000","last_active":"2024-09-12T17:15:27.270515+0000","last_peered":"2024-09-12T17:15:27.270515+0000","last_clean":"2024-09-12T17:15:27.270515+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:15:27.270515+0000","last_undegraded":"2024-09-12T17:15:27.270515+0000","last_fullsized":"2024-09-12T17:15:27.270515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.270201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.252770+0000","last_change":"2024-09-12T17:15:00.252598+0000","last_active":"2024-09-12T17:15:00.252770+0000","last_peered":"2024-09-12T17:15:00.252770+0000","last_clean":"2024-09-12T17:15:00.252770+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:15:00.252770+0000","last_undegraded":"2024-09-12T17:15:00.252770+0000","last_fullsized":"2024-09-12T17:15:00.252770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.252406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:21.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.845483+0000","last_change":"2024-09-12T17:15:28.845304+0000","last_active":"2024-09-12T17:15:28.845483+0000","last_peered":"2024-09-12T17:15:28.845483+0000","last_clean":"2024-09-12T17:15:28.845483+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:15:28.845483+0000","last_undegraded":"2024-09-12T17:15:28.845483+0000","last_fullsized":"2024-09-12T17:15:28.845483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.845128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:39.718369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.096929+0000","last_change":"2024-09-12T17:15:33.096929+0000","last_active":"2024-09-12T17:15:33.096929+0000","last_peered":"2024-09-12T17:15:33.096929+0000","last_clean":"2024-09-12T17:15:33.096929+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:15:33.096929+0000","last_undegraded":"2024-09-12T17:15:33.096929+0000","last_fullsized":"2024-09-12T17:15:33.096929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.096724+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.936243+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.659187+0000","last_change":"2024-09-12T17:15:46.659187+0000","last_active":"2024-09-12T17:15:46.659187+0000","last_peered":"2024-09-12T17:15:46.659187+0000","last_clean":"2024-09-12T17:15:46.659187+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:15:46.659187+0000","last_undegraded":"2024-09-12T17:15:46.659187+0000","last_fullsized":"2024-09-12T17:15:46.659187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.659004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.104711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.953689+0000","last_change":"2024-09-12T17:15:44.953689+0000","last_active":"2024-09-12T17:15:44.953689+0000","last_peered":"2024-09-12T17:15:44.953689+0000","last_clean":"2024-09-12T17:15:44.953689+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:15:44.953689+0000","last_undegraded":"2024-09-12T17:15:44.953689+0000","last_fullsized":"2024-09-12T17:15:44.953689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.953466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.780448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.886220+0000","last_change":"2024-09-12T17:15:11.886035+0000","last_active":"2024-09-12T17:15:11.886220+0000","last_peered":"2024-09-12T17:15:11.886220+0000","last_clean":"2024-09-12T17:15:11.886220+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:15:11.886220+0000","last_undegraded":"2024-09-12T17:15:11.886220+0000","last_fullsized":"2024-09-12T17:15:11.886220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.885853+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.230761+0000","last_change":"2024-09-12T17:14:58.230528+0000","last_active":"2024-09-12T17:14:58.230761+0000","last_peered":"2024-09-12T17:14:58.230761+0000","last_clean":"2024-09-12T17:14:58.230761+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:58.230761+0000","last_undegraded":"2024-09-12T17:14:58.230761+0000","last_fullsized":"2024-09-12T17:14:58.230761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.230294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:55.690708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.679025+0000","last_change":"2024-09-12T17:15:26.678715+0000","last_active":"2024-09-12T17:15:26.679025+0000","last_peered":"2024-09-12T17:15:26.679025+0000","last_clean":"2024-09-12T17:15:26.679025+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:15:26.679025+0000","last_undegraded":"2024-09-12T17:15:26.679025+0000","last_fullsized":"2024-09-12T17:15:26.679025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.678505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:32.805993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'33","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.013416+0000","last_change":"2024-09-12T17:11:10.744971+0000","last_active":"2024-09-12T17:14:51.013416+0000","last_peered":"2024-09-12T17:14:51.013416+0000","last_clean":"2024-09-12T17:14:51.013416+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:14:51.013416+0000","last_undegraded":"2024-09-12T17:14:51.013416+0000","last_fullsized":"2024-09-12T17:14:51.013416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.632043+0000","last_change":"2024-09-12T17:15:45.632043+0000","last_active":"2024-09-12T17:15:45.632043+0000","last_peered":"2024-09-12T17:15:45.632043+0000","last_clean":"2024-09-12T17:15:45.632043+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:15:45.632043+0000","last_undegraded":"2024-09-12T17:15:45.632043+0000","last_fullsized":"2024-09-12T17:15:45.632043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.631841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:33.615088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.860807+0000","last_change":"2024-09-12T17:15:52.860807+0000","last_active":"2024-09-12T17:15:52.860807+0000","last_peered":"2024-09-12T17:15:52.860807+0000","last_clean":"2024-09-12T17:15:52.860807+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:15:52.860807+0000","last_undegraded":"2024-09-12T17:15:52.860807+0000","last_fullsized":"2024-09-12T17:15:52.860807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.860623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:37.942810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.156810+0000","last_change":"2024-09-12T17:15:12.156505+0000","last_active":"2024-09-12T17:15:12.156810+0000","last_peered":"2024-09-12T17:15:12.156810+0000","last_clean":"2024-09-12T17:15:12.156810+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:15:12.156810+0000","last_undegraded":"2024-09-12T17:15:12.156810+0000","last_fullsized":"2024-09-12T17:15:12.156810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.156239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:25.415656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.347019+0000","last_change":"2024-09-12T17:15:06.346855+0000","last_active":"2024-09-12T17:15:06.347019+0000","last_peered":"2024-09-12T17:15:06.347019+0000","last_clean":"2024-09-12T17:15:06.347019+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:15:06.347019+0000","last_undegraded":"2024-09-12T17:15:06.347019+0000","last_fullsized":"2024-09-12T17:15:06.347019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.346636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:51.428823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.667241+0000","last_change":"2024-09-12T17:15:29.667097+0000","last_active":"2024-09-12T17:15:29.667241+0000","last_peered":"2024-09-12T17:15:29.667241+0000","last_clean":"2024-09-12T17:15:29.667241+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:15:29.667241+0000","last_undegraded":"2024-09-12T17:15:29.667241+0000","last_fullsized":"2024-09-12T17:15:29.667241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.666868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:49.783995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.337208+0000","last_change":"2024-09-12T17:15:53.337208+0000","last_active":"2024-09-12T17:15:53.337208+0000","last_peered":"2024-09-12T17:15:53.337208+0000","last_clean":"2024-09-12T17:15:53.337208+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:15:53.337208+0000","last_undegraded":"2024-09-12T17:15:53.337208+0000","last_fullsized":"2024-09-12T17:15:53.337208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.337017+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:23.840226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.678644+0000","last_change":"2024-09-12T17:15:44.678644+0000","last_active":"2024-09-12T17:15:44.678644+0000","last_peered":"2024-09-12T17:15:44.678644+0000","last_clean":"2024-09-12T17:15:44.678644+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:15:44.678644+0000","last_undegraded":"2024-09-12T17:15:44.678644+0000","last_fullsized":"2024-09-12T17:15:44.678644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.678458+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:12.551543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.559131+0000","last_change":"2024-09-12T17:15:52.559131+0000","last_active":"2024-09-12T17:15:52.559131+0000","last_peered":"2024-09-12T17:15:52.559131+0000","last_clean":"2024-09-12T17:15:52.559131+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:15:52.559131+0000","last_undegraded":"2024-09-12T17:15:52.559131+0000","last_fullsized":"2024-09-12T17:15:52.559131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.558952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:37.731208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.111733+0000","last_change":"2024-09-12T17:15:13.111502+0000","last_active":"2024-09-12T17:15:13.111733+0000","last_peered":"2024-09-12T17:15:13.111733+0000","last_clean":"2024-09-12T17:15:13.111733+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:15:13.111733+0000","last_undegraded":"2024-09-12T17:15:13.111733+0000","last_fullsized":"2024-09-12T17:15:13.111733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.111208+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.802604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.322359+0000","last_change":"2024-09-12T17:15:15.322215+0000","last_active":"2024-09-12T17:15:15.322359+0000","last_peered":"2024-09-12T17:15:15.322359+0000","last_clean":"2024-09-12T17:15:15.322359+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:15:15.322359+0000","last_undegraded":"2024-09-12T17:15:15.322359+0000","last_fullsized":"2024-09-12T17:15:15.322359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.322029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:41.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.655138+0000","last_change":"2024-09-12T17:15:27.654987+0000","last_active":"2024-09-12T17:15:27.655138+0000","last_peered":"2024-09-12T17:15:27.655138+0000","last_clean":"2024-09-12T17:15:27.655138+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:15:27.655138+0000","last_undegraded":"2024-09-12T17:15:27.655138+0000","last_fullsized":"2024-09-12T17:15:27.655138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.654755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:35.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.323386+0000","last_change":"2024-09-12T17:15:54.323386+0000","last_active":"2024-09-12T17:15:54.323386+0000","last_peered":"2024-09-12T17:15:54.323386+0000","last_clean":"2024-09-12T17:15:54.323386+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:15:54.323386+0000","last_undegraded":"2024-09-12T17:15:54.323386+0000","last_fullsized":"2024-09-12T17:15:54.323386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.323183+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:10.081001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.651288+0000","last_change":"2024-09-12T17:15:43.651288+0000","last_active":"2024-09-12T17:15:43.651288+0000","last_peered":"2024-09-12T17:15:43.651288+0000","last_clean":"2024-09-12T17:15:43.651288+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:15:43.651288+0000","last_undegraded":"2024-09-12T17:15:43.651288+0000","last_fullsized":"2024-09-12T17:15:43.651288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.651107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:32.997974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.519537+0000","last_change":"2024-09-12T17:15:53.519537+0000","last_active":"2024-09-12T17:15:53.519537+0000","last_peered":"2024-09-12T17:15:53.519537+0000","last_clean":"2024-09-12T17:15:53.519537+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:15:53.519537+0000","last_undegraded":"2024-09-12T17:15:53.519537+0000","last_fullsized":"2024-09-12T17:15:53.519537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.519363+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:29.687392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.848775+0000","last_change":"2024-09-12T17:15:12.848522+0000","last_active":"2024-09-12T17:15:12.848775+0000","last_peered":"2024-09-12T17:15:12.848775+0000","last_clean":"2024-09-12T17:15:12.848775+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:15:12.848775+0000","last_undegraded":"2024-09-12T17:15:12.848775+0000","last_fullsized":"2024-09-12T17:15:12.848775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.848285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.476233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.570224+0000","last_change":"2024-09-12T17:15:01.570059+0000","last_active":"2024-09-12T17:15:01.570224+0000","last_peered":"2024-09-12T17:15:01.570224+0000","last_clean":"2024-09-12T17:15:01.570224+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:15:01.570224+0000","last_undegraded":"2024-09-12T17:15:01.570224+0000","last_fullsized":"2024-09-12T17:15:01.570224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.569882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:12.460985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.079843+0000","last_change":"2024-09-12T17:15:26.079585+0000","last_active":"2024-09-12T17:15:26.079843+0000","last_peered":"2024-09-12T17:15:26.079843+0000","last_clean":"2024-09-12T17:15:26.079843+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:15:26.079843+0000","last_undegraded":"2024-09-12T17:15:26.079843+0000","last_fullsized":"2024-09-12T17:15:26.079843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.079373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:00.776520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.855018+0000","last_change":"2024-09-12T17:15:39.855018+0000","last_active":"2024-09-12T17:15:39.855018+0000","last_peered":"2024-09-12T17:15:39.855018+0000","last_clean":"2024-09-12T17:15:39.855018+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:15:39.855018+0000","last_undegraded":"2024-09-12T17:15:39.855018+0000","last_fullsized":"2024-09-12T17:15:39.855018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.854818+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.768653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796800+0000","last_change":"2024-09-12T17:11:12.746300+0000","last_active":"2024-09-12T17:13:29.796800+0000","last_peered":"2024-09-12T17:13:29.796800+0000","last_clean":"2024-09-12T17:13:29.796800+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:13:29.796800+0000","last_undegraded":"2024-09-12T17:13:29.796800+0000","last_fullsized":"2024-09-12T17:13:29.796800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.970318+0000","last_change":"2024-09-12T17:11:14.759559+0000","last_active":"2024-09-12T17:14:19.970318+0000","last_peered":"2024-09-12T17:14:19.970318+0000","last_clean":"2024-09-12T17:14:19.970318+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:14:19.970318+0000","last_undegraded":"2024-09-12T17:14:19.970318+0000","last_fullsized":"2024-09-12T17:14:19.970318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.307466+0000","last_change":"2024-09-12T17:15:28.307333+0000","last_active":"2024-09-12T17:15:28.307466+0000","last_peered":"2024-09-12T17:15:28.307466+0000","last_clean":"2024-09-12T17:15:28.307466+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:15:28.307466+0000","last_undegraded":"2024-09-12T17:15:28.307466+0000","last_fullsized":"2024-09-12T17:15:28.307466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.307157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:43.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.407052+0000","last_change":"2024-09-12T17:15:04.406881+0000","last_active":"2024-09-12T17:15:04.407052+0000","last_peered":"2024-09-12T17:15:04.407052+0000","last_clean":"2024-09-12T17:15:04.407052+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:15:04.407052+0000","last_undegraded":"2024-09-12T17:15:04.407052+0000","last_fullsized":"2024-09-12T17:15:04.407052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.406686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:45.243217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.658405+0000","last_change":"2024-09-12T17:15:28.658287+0000","last_active":"2024-09-12T17:15:28.658405+0000","last_peered":"2024-09-12T17:15:28.658405+0000","last_clean":"2024-09-12T17:15:28.658405+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:15:28.658405+0000","last_undegraded":"2024-09-12T17:15:28.658405+0000","last_fullsized":"2024-09-12T17:15:28.658405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.658107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:41.190010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.062564+0000","last_change":"2024-09-12T17:15:34.062414+0000","last_active":"2024-09-12T17:15:34.062564+0000","last_peered":"2024-09-12T17:15:34.062564+0000","last_clean":"2024-09-12T17:15:34.062564+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:15:34.062564+0000","last_undegraded":"2024-09-12T17:15:34.062564+0000","last_fullsized":"2024-09-12T17:15:34.062564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.062221+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.175698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.958125+0000","last_change":"2024-09-12T17:15:39.957861+0000","last_active":"2024-09-12T17:15:39.958125+0000","last_peered":"2024-09-12T17:15:39.958125+0000","last_clean":"2024-09-12T17:15:39.958125+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:15:39.958125+0000","last_undegraded":"2024-09-12T17:15:39.958125+0000","last_fullsized":"2024-09-12T17:15:39.958125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.957627+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:08.558995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'17","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.569132+0000","last_change":"2024-09-12T17:15:51.569132+0000","last_active":"2024-09-12T17:15:51.569132+0000","last_peered":"2024-09-12T17:15:51.569132+0000","last_clean":"2024-09-12T17:15:51.569132+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:15:51.569132+0000","last_undegraded":"2024-09-12T17:15:51.569132+0000","last_fullsized":"2024-09-12T17:15:51.569132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.568910+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:05.866665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.119406+0000","last_change":"2024-09-12T17:15:14.119259+0000","last_active":"2024-09-12T17:15:14.119406+0000","last_peered":"2024-09-12T17:15:14.119406+0000","last_clean":"2024-09-12T17:15:14.119406+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:15:14.119406+0000","last_undegraded":"2024-09-12T17:15:14.119406+0000","last_fullsized":"2024-09-12T17:15:14.119406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.119067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:19.587103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.369479+0000","last_change":"2024-09-12T17:15:05.369239+0000","last_active":"2024-09-12T17:15:05.369479+0000","last_peered":"2024-09-12T17:15:05.369479+0000","last_clean":"2024-09-12T17:15:05.369479+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:15:05.369479+0000","last_undegraded":"2024-09-12T17:15:05.369479+0000","last_fullsized":"2024-09-12T17:15:05.369479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.369026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:56.089945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.846378+0000","last_change":"2024-09-12T17:15:30.846241+0000","last_active":"2024-09-12T17:15:30.846378+0000","last_peered":"2024-09-12T17:15:30.846378+0000","last_clean":"2024-09-12T17:15:30.846378+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:15:30.846378+0000","last_undegraded":"2024-09-12T17:15:30.846378+0000","last_fullsized":"2024-09-12T17:15:30.846378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.846040+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:03.566242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795187+0000","last_change":"2024-09-12T17:11:10.746840+0000","last_active":"2024-09-12T17:13:24.795187+0000","last_peered":"2024-09-12T17:13:24.795187+0000","last_clean":"2024-09-12T17:13:24.795187+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:13:24.795187+0000","last_undegraded":"2024-09-12T17:13:24.795187+0000","last_fullsized":"2024-09-12T17:13:24.795187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.827707+0000","last_change":"2024-09-12T17:15:44.827707+0000","last_active":"2024-09-12T17:15:44.827707+0000","last_peered":"2024-09-12T17:15:44.827707+0000","last_clean":"2024-09-12T17:15:44.827707+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:15:44.827707+0000","last_undegraded":"2024-09-12T17:15:44.827707+0000","last_fullsized":"2024-09-12T17:15:44.827707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.827528+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:09.301008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.985948+0000","last_change":"2024-09-12T17:15:46.985948+0000","last_active":"2024-09-12T17:15:46.985948+0000","last_peered":"2024-09-12T17:15:46.985948+0000","last_clean":"2024-09-12T17:15:46.985948+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:15:46.985948+0000","last_undegraded":"2024-09-12T17:15:46.985948+0000","last_fullsized":"2024-09-12T17:15:46.985948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.985735+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:07.901157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.876539+0000","last_change":"2024-09-12T17:15:13.876344+0000","last_active":"2024-09-12T17:15:13.876539+0000","last_peered":"2024-09-12T17:15:13.876539+0000","last_clean":"2024-09-12T17:15:13.876539+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:15:13.876539+0000","last_undegraded":"2024-09-12T17:15:13.876539+0000","last_fullsized":"2024-09-12T17:15:13.876539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.876174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:45.655514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.392362+0000","last_change":"2024-09-12T17:15:03.392219+0000","last_active":"2024-09-12T17:15:03.392362+0000","last_peered":"2024-09-12T17:15:03.392362+0000","last_clean":"2024-09-12T17:15:03.392362+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:15:03.392362+0000","last_undegraded":"2024-09-12T17:15:03.392362+0000","last_fullsized":"2024-09-12T17:15:03.392362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.392030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:57.279126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.366222+0000","last_change":"2024-09-12T17:15:43.366222+0000","last_active":"2024-09-12T17:15:43.366222+0000","last_peered":"2024-09-12T17:15:43.366222+0000","last_clean":"2024-09-12T17:15:43.366222+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:15:43.366222+0000","last_undegraded":"2024-09-12T17:15:43.366222+0000","last_fullsized":"2024-09-12T17:15:43.366222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.366005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:25.345493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.865578+0000","last_change":"2024-09-12T17:15:38.865438+0000","last_active":"2024-09-12T17:15:38.865578+0000","last_peered":"2024-09-12T17:15:38.865578+0000","last_clean":"2024-09-12T17:15:38.865578+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:15:38.865578+0000","last_undegraded":"2024-09-12T17:15:38.865578+0000","last_fullsized":"2024-09-12T17:15:38.865578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.865244+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:53.633604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.969358+0000","last_change":"2024-09-12T17:15:37.969238+0000","last_active":"2024-09-12T17:15:37.969358+0000","last_peered":"2024-09-12T17:15:37.969358+0000","last_clean":"2024-09-12T17:15:37.969358+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:15:37.969358+0000","last_undegraded":"2024-09-12T17:15:37.969358+0000","last_fullsized":"2024-09-12T17:15:37.969358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.969052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:48.170639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.867058+0000","last_change":"2024-09-12T17:15:48.867058+0000","last_active":"2024-09-12T17:15:48.867058+0000","last_peered":"2024-09-12T17:15:48.867058+0000","last_clean":"2024-09-12T17:15:48.867058+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:15:48.867058+0000","last_undegraded":"2024-09-12T17:15:48.867058+0000","last_fullsized":"2024-09-12T17:15:48.867058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.866885+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:08.256752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.275587+0000","last_change":"2024-09-12T17:15:25.275587+0000","last_active":"2024-09-12T17:15:25.275587+0000","last_peered":"2024-09-12T17:15:25.275587+0000","last_clean":"2024-09-12T17:15:25.275587+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:15:25.275587+0000","last_undegraded":"2024-09-12T17:15:25.275587+0000","last_fullsized":"2024-09-12T17:15:25.275587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.275402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:48.030414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.911446+0000","last_change":"2024-09-12T17:14:55.911446+0000","last_active":"2024-09-12T17:14:55.911446+0000","last_peered":"2024-09-12T17:14:55.911446+0000","last_clean":"2024-09-12T17:14:55.911446+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:14:55.911446+0000","last_undegraded":"2024-09-12T17:14:55.911446+0000","last_fullsized":"2024-09-12T17:14:55.911446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.911203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:43.813828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.344255+0000","last_change":"2024-09-12T17:14:58.344110+0000","last_active":"2024-09-12T17:14:58.344255+0000","last_peered":"2024-09-12T17:14:58.344255+0000","last_clean":"2024-09-12T17:14:58.344255+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:14:58.344255+0000","last_undegraded":"2024-09-12T17:14:58.344255+0000","last_fullsized":"2024-09-12T17:14:58.344255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.343916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:58.763095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.363397+0000","last_change":"2024-09-12T17:15:00.363177+0000","last_active":"2024-09-12T17:15:00.363397+0000","last_peered":"2024-09-12T17:15:00.363397+0000","last_clean":"2024-09-12T17:15:00.363397+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:15:00.363397+0000","last_undegraded":"2024-09-12T17:15:00.363397+0000","last_fullsized":"2024-09-12T17:15:00.363397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.362898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:40.201170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.860319+0000","last_change":"2024-09-12T17:15:33.860319+0000","last_active":"2024-09-12T17:15:33.860319+0000","last_peered":"2024-09-12T17:15:33.860319+0000","last_clean":"2024-09-12T17:15:33.860319+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:15:33.860319+0000","last_undegraded":"2024-09-12T17:15:33.860319+0000","last_fullsized":"2024-09-12T17:15:33.860319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.860118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:13.485835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.298497+0000","last_change":"2024-09-12T17:15:52.298497+0000","last_active":"2024-09-12T17:15:52.298497+0000","last_peered":"2024-09-12T17:15:52.298497+0000","last_clean":"2024-09-12T17:15:52.298497+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:15:52.298497+0000","last_undegraded":"2024-09-12T17:15:52.298497+0000","last_fullsized":"2024-09-12T17:15:52.298497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.298319+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:46.248966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.630425+0000","last_change":"2024-09-12T17:15:42.630425+0000","last_active":"2024-09-12T17:15:42.630425+0000","last_peered":"2024-09-12T17:15:42.630425+0000","last_clean":"2024-09-12T17:15:42.630425+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:15:42.630425+0000","last_undegraded":"2024-09-12T17:15:42.630425+0000","last_fullsized":"2024-09-12T17:15:42.630425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.630245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.028995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.933215+0000","last_change":"2024-09-12T17:15:45.933215+0000","last_active":"2024-09-12T17:15:45.933215+0000","last_peered":"2024-09-12T17:15:45.933215+0000","last_clean":"2024-09-12T17:15:45.933215+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:15:45.933215+0000","last_undegraded":"2024-09-12T17:15:45.933215+0000","last_fullsized":"2024-09-12T17:15:45.933215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.933032+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:31.635022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.251384+0000","last_change":"2024-09-12T17:15:26.251257+0000","last_active":"2024-09-12T17:15:26.251384+0000","last_peered":"2024-09-12T17:15:26.251384+0000","last_clean":"2024-09-12T17:15:26.251384+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:15:26.251384+0000","last_undegraded":"2024-09-12T17:15:26.251384+0000","last_fullsized":"2024-09-12T17:15:26.251384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.251080+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:57.034203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.355017+0000","last_change":"2024-09-12T17:14:56.355017+0000","last_active":"2024-09-12T17:14:56.355017+0000","last_peered":"2024-09-12T17:14:56.355017+0000","last_clean":"2024-09-12T17:14:56.355017+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:14:56.355017+0000","last_undegraded":"2024-09-12T17:14:56.355017+0000","last_fullsized":"2024-09-12T17:14:56.355017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.354829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:11.179727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.554007+0000","last_change":"2024-09-12T17:15:00.553874+0000","last_active":"2024-09-12T17:15:00.554007+0000","last_peered":"2024-09-12T17:15:00.554007+0000","last_clean":"2024-09-12T17:15:00.554007+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:15:00.554007+0000","last_undegraded":"2024-09-12T17:15:00.554007+0000","last_fullsized":"2024-09-12T17:15:00.554007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.553655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:28.442790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.377696+0000","last_change":"2024-09-12T17:15:42.377696+0000","last_active":"2024-09-12T17:15:42.377696+0000","last_peered":"2024-09-12T17:15:42.377696+0000","last_clean":"2024-09-12T17:15:42.377696+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:15:42.377696+0000","last_undegraded":"2024-09-12T17:15:42.377696+0000","last_fullsized":"2024-09-12T17:15:42.377696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.377456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:01.503677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.860338+0000","last_change":"2024-09-12T17:15:37.860338+0000","last_active":"2024-09-12T17:15:37.860338+0000","last_peered":"2024-09-12T17:15:37.860338+0000","last_clean":"2024-09-12T17:15:37.860338+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:15:37.860338+0000","last_undegraded":"2024-09-12T17:15:37.860338+0000","last_fullsized":"2024-09-12T17:15:37.860338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.860130+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.881587+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:19.793588+0000","last_change":"2024-09-12T17:11:12.743537+0000","last_active":"2024-09-12T17:13:19.793588+0000","last_peered":"2024-09-12T17:13:19.793588+0000","last_clean":"2024-09-12T17:13:19.793588+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:13:19.793588+0000","last_undegraded":"2024-09-12T17:13:19.793588+0000","last_fullsized":"2024-09-12T17:13:19.793588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.915714+0000","last_change":"2024-09-12T17:15:50.915714+0000","last_active":"2024-09-12T17:15:50.915714+0000","last_peered":"2024-09-12T17:15:50.915714+0000","last_clean":"2024-09-12T17:15:50.915714+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:15:50.915714+0000","last_undegraded":"2024-09-12T17:15:50.915714+0000","last_fullsized":"2024-09-12T17:15:50.915714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.915527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.752058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'26","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.649839+0000","last_change":"2024-09-12T17:15:14.649699+0000","last_active":"2024-09-12T17:15:14.649839+0000","last_peered":"2024-09-12T17:15:14.649839+0000","last_clean":"2024-09-12T17:15:14.649839+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:15:14.649839+0000","last_undegraded":"2024-09-12T17:15:14.649839+0000","last_fullsized":"2024-09-12T17:15:14.649839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.649518+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:27.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.253023+0000","last_change":"2024-09-12T17:14:56.252899+0000","last_active":"2024-09-12T17:14:56.253023+0000","last_peered":"2024-09-12T17:14:56.253023+0000","last_clean":"2024-09-12T17:14:56.253023+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:14:56.253023+0000","last_undegraded":"2024-09-12T17:14:56.253023+0000","last_fullsized":"2024-09-12T17:14:56.253023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.252710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:23.672480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.622944+0000","last_change":"2024-09-12T17:14:57.622760+0000","last_active":"2024-09-12T17:14:57.622944+0000","last_peered":"2024-09-12T17:14:57.622944+0000","last_clean":"2024-09-12T17:14:57.622944+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:14:57.622944+0000","last_undegraded":"2024-09-12T17:14:57.622944+0000","last_fullsized":"2024-09-12T17:14:57.622944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.622572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.441681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.094456+0000","last_change":"2024-09-12T17:15:24.094317+0000","last_active":"2024-09-12T17:15:24.094456+0000","last_peered":"2024-09-12T17:15:24.094456+0000","last_clean":"2024-09-12T17:15:24.094456+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:15:24.094456+0000","last_undegraded":"2024-09-12T17:15:24.094456+0000","last_fullsized":"2024-09-12T17:15:24.094456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.094126+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:04.533467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.032736+0000","last_change":"2024-09-12T17:15:31.032736+0000","last_active":"2024-09-12T17:15:31.032736+0000","last_peered":"2024-09-12T17:15:31.032736+0000","last_clean":"2024-09-12T17:15:31.032736+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:15:31.032736+0000","last_undegraded":"2024-09-12T17:15:31.032736+0000","last_fullsized":"2024-09-12T17:15:31.032736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.032542+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.819963+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.591841+0000","last_change":"2024-09-12T17:15:41.591841+0000","last_active":"2024-09-12T17:15:41.591841+0000","last_peered":"2024-09-12T17:15:41.591841+0000","last_clean":"2024-09-12T17:15:41.591841+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:15:41.591841+0000","last_undegraded":"2024-09-12T17:15:41.591841+0000","last_fullsized":"2024-09-12T17:15:41.591841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.591665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.603528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796560+0000","last_change":"2024-09-12T17:11:14.764538+0000","last_active":"2024-09-12T17:13:29.796560+0000","last_peered":"2024-09-12T17:13:29.796560+0000","last_clean":"2024-09-12T17:13:29.796560+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:13:29.796560+0000","last_undegraded":"2024-09-12T17:13:29.796560+0000","last_fullsized":"2024-09-12T17:13:29.796560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.619454+0000","last_change":"2024-09-12T17:15:12.619313+0000","last_active":"2024-09-12T17:15:12.619454+0000","last_peered":"2024-09-12T17:15:12.619454+0000","last_clean":"2024-09-12T17:15:12.619454+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:15:12.619454+0000","last_undegraded":"2024-09-12T17:15:12.619454+0000","last_fullsized":"2024-09-12T17:15:12.619454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.619133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.401095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.349942+0000","last_change":"2024-09-12T17:14:57.349792+0000","last_active":"2024-09-12T17:14:57.349942+0000","last_peered":"2024-09-12T17:14:57.349942+0000","last_clean":"2024-09-12T17:14:57.349942+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:14:57.349942+0000","last_undegraded":"2024-09-12T17:14:57.349942+0000","last_fullsized":"2024-09-12T17:14:57.349942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.349607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:49.102885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.265774+0000","last_change":"2024-09-12T17:14:57.265630+0000","last_active":"2024-09-12T17:14:57.265774+0000","last_peered":"2024-09-12T17:14:57.265774+0000","last_clean":"2024-09-12T17:14:57.265774+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:14:57.265774+0000","last_undegraded":"2024-09-12T17:14:57.265774+0000","last_fullsized":"2024-09-12T17:14:57.265774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.265430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:07.327769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.650742+0000","last_change":"2024-09-12T17:15:25.650742+0000","last_active":"2024-09-12T17:15:25.650742+0000","last_peered":"2024-09-12T17:15:25.650742+0000","last_clean":"2024-09-12T17:15:25.650742+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:15:25.650742+0000","last_undegraded":"2024-09-12T17:15:25.650742+0000","last_fullsized":"2024-09-12T17:15:25.650742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.650567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:13.066845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.346298+0000","last_change":"2024-09-12T17:15:51.346298+0000","last_active":"2024-09-12T17:15:51.346298+0000","last_peered":"2024-09-12T17:15:51.346298+0000","last_clean":"2024-09-12T17:15:51.346298+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:15:51.346298+0000","last_undegraded":"2024-09-12T17:15:51.346298+0000","last_fullsized":"2024-09-12T17:15:51.346298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.346098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:33.524411+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:24.795407+0000","last_change":"2024-09-12T17:11:12.746983+0000","last_active":"2024-09-12T17:13:24.795407+0000","last_peered":"2024-09-12T17:13:24.795407+0000","last_clean":"2024-09-12T17:13:24.795407+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:13:24.795407+0000","last_undegraded":"2024-09-12T17:13:24.795407+0000","last_fullsized":"2024-09-12T17:13:24.795407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.870101+0000","last_change":"2024-09-12T17:15:51.870101+0000","last_active":"2024-09-12T17:15:51.870101+0000","last_peered":"2024-09-12T17:15:51.870101+0000","last_clean":"2024-09-12T17:15:51.870101+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:15:51.870101+0000","last_undegraded":"2024-09-12T17:15:51.870101+0000","last_fullsized":"2024-09-12T17:15:51.870101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.869905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.607819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.824007+0000","last_change":"2024-09-12T17:15:09.823868+0000","last_active":"2024-09-12T17:15:09.824007+0000","last_peered":"2024-09-12T17:15:09.824007+0000","last_clean":"2024-09-12T17:15:09.824007+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:15:09.824007+0000","last_undegraded":"2024-09-12T17:15:09.824007+0000","last_fullsized":"2024-09-12T17:15:09.824007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.823660+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.276097+0000","last_change":"2024-09-12T17:14:59.275856+0000","last_active":"2024-09-12T17:14:59.276097+0000","last_peered":"2024-09-12T17:14:59.276097+0000","last_clean":"2024-09-12T17:14:59.276097+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:59.276097+0000","last_undegraded":"2024-09-12T17:14:59.276097+0000","last_fullsized":"2024-09-12T17:14:59.276097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.275635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:08.199637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.609810+0000","last_change":"2024-09-12T17:14:55.609658+0000","last_active":"2024-09-12T17:14:55.609810+0000","last_peered":"2024-09-12T17:14:55.609810+0000","last_clean":"2024-09-12T17:14:55.609810+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:14:55.609810+0000","last_undegraded":"2024-09-12T17:14:55.609810+0000","last_fullsized":"2024-09-12T17:14:55.609810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.609474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:43.527501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.687586+0000","last_change":"2024-09-12T17:15:24.687586+0000","last_active":"2024-09-12T17:15:24.687586+0000","last_peered":"2024-09-12T17:15:24.687586+0000","last_clean":"2024-09-12T17:15:24.687586+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:15:24.687586+0000","last_undegraded":"2024-09-12T17:15:24.687586+0000","last_fullsized":"2024-09-12T17:15:24.687586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.687400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:45.771402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.685630+0000","last_change":"2024-09-12T17:15:32.685630+0000","last_active":"2024-09-12T17:15:32.685630+0000","last_peered":"2024-09-12T17:15:32.685630+0000","last_clean":"2024-09-12T17:15:32.685630+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:15:32.685630+0000","last_undegraded":"2024-09-12T17:15:32.685630+0000","last_fullsized":"2024-09-12T17:15:32.685630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.685518+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.484233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.953964+0000","last_change":"2024-09-12T17:15:38.953964+0000","last_active":"2024-09-12T17:15:38.953964+0000","last_peered":"2024-09-12T17:15:38.953964+0000","last_clean":"2024-09-12T17:15:38.953964+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:15:38.953964+0000","last_undegraded":"2024-09-12T17:15:38.953964+0000","last_fullsized":"2024-09-12T17:15:38.953964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.953775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:36.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.809837+0000","last_change":"2024-09-12T17:11:14.751677+0000","last_active":"2024-09-12T17:14:19.809837+0000","last_peered":"2024-09-12T17:14:19.809837+0000","last_clean":"2024-09-12T17:14:19.809837+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:14:19.809837+0000","last_undegraded":"2024-09-12T17:14:19.809837+0000","last_fullsized":"2024-09-12T17:14:19.809837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.842566+0000","last_change":"2024-09-12T17:15:10.842397+0000","last_active":"2024-09-12T17:15:10.842566+0000","last_peered":"2024-09-12T17:15:10.842566+0000","last_clean":"2024-09-12T17:15:10.842566+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:15:10.842566+0000","last_undegraded":"2024-09-12T17:15:10.842566+0000","last_fullsized":"2024-09-12T17:15:10.842566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.842219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:45.585105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.546848+0000","last_change":"2024-09-12T17:14:59.546720+0000","last_active":"2024-09-12T17:14:59.546848+0000","last_peered":"2024-09-12T17:14:59.546848+0000","last_clean":"2024-09-12T17:14:59.546848+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:14:59.546848+0000","last_undegraded":"2024-09-12T17:14:59.546848+0000","last_fullsized":"2024-09-12T17:14:59.546848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.546539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:06.551999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.384965+0000","last_change":"2024-09-12T17:15:02.384841+0000","last_active":"2024-09-12T17:15:02.384965+0000","last_peered":"2024-09-12T17:15:02.384965+0000","last_clean":"2024-09-12T17:15:02.384965+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:15:02.384965+0000","last_undegraded":"2024-09-12T17:15:02.384965+0000","last_fullsized":"2024-09-12T17:15:02.384965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.384664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:21.774531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.385448+0000","last_change":"2024-09-12T17:15:49.385448+0000","last_active":"2024-09-12T17:15:49.385448+0000","last_peered":"2024-09-12T17:15:49.385448+0000","last_clean":"2024-09-12T17:15:49.385448+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:15:49.385448+0000","last_undegraded":"2024-09-12T17:15:49.385448+0000","last_fullsized":"2024-09-12T17:15:49.385448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.385273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:07.869553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.883962+0000","last_change":"2024-09-12T17:15:40.883962+0000","last_active":"2024-09-12T17:15:40.883962+0000","last_peered":"2024-09-12T17:15:40.883962+0000","last_clean":"2024-09-12T17:15:40.883962+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:15:40.883962+0000","last_undegraded":"2024-09-12T17:15:40.883962+0000","last_fullsized":"2024-09-12T17:15:40.883962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.883767+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:44.835444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.855770+0000","last_change":"2024-09-12T17:15:43.855770+0000","last_active":"2024-09-12T17:15:43.855770+0000","last_peered":"2024-09-12T17:15:43.855770+0000","last_clean":"2024-09-12T17:15:43.855770+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:15:43.855770+0000","last_undegraded":"2024-09-12T17:15:43.855770+0000","last_fullsized":"2024-09-12T17:15:43.855770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.855585+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.436369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796779+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:13:29.796779+0000","last_peered":"2024-09-12T17:13:29.796779+0000","last_clean":"2024-09-12T17:13:29.796779+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:13:29.796779+0000","last_undegraded":"2024-09-12T17:13:29.796779+0000","last_fullsized":"2024-09-12T17:13:29.796779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.324685+0000","last_change":"2024-09-12T17:15:21.324685+0000","last_active":"2024-09-12T17:15:21.324685+0000","last_peered":"2024-09-12T17:15:21.324685+0000","last_clean":"2024-09-12T17:15:21.324685+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:15:21.324685+0000","last_undegraded":"2024-09-12T17:15:21.324685+0000","last_fullsized":"2024-09-12T17:15:21.324685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.324508+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:04.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.370073+0000","last_change":"2024-09-12T17:15:01.369815+0000","last_active":"2024-09-12T17:15:01.370073+0000","last_peered":"2024-09-12T17:15:01.370073+0000","last_clean":"2024-09-12T17:15:01.370073+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:15:01.370073+0000","last_undegraded":"2024-09-12T17:15:01.370073+0000","last_fullsized":"2024-09-12T17:15:01.370073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.369538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.619390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.592043+0000","last_change":"2024-09-12T17:14:56.591887+0000","last_active":"2024-09-12T17:14:56.592043+0000","last_peered":"2024-09-12T17:14:56.592043+0000","last_clean":"2024-09-12T17:14:56.592043+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:14:56.592043+0000","last_undegraded":"2024-09-12T17:14:56.592043+0000","last_fullsized":"2024-09-12T17:14:56.592043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.591696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:05.758061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.424706+0000","last_change":"2024-09-12T17:15:41.424706+0000","last_active":"2024-09-12T17:15:41.424706+0000","last_peered":"2024-09-12T17:15:41.424706+0000","last_clean":"2024-09-12T17:15:41.424706+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:15:41.424706+0000","last_undegraded":"2024-09-12T17:15:41.424706+0000","last_fullsized":"2024-09-12T17:15:41.424706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.424524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.841300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.366997+0000","last_change":"2024-09-12T17:15:50.366997+0000","last_active":"2024-09-12T17:15:50.366997+0000","last_peered":"2024-09-12T17:15:50.366997+0000","last_clean":"2024-09-12T17:15:50.366997+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:15:50.366997+0000","last_undegraded":"2024-09-12T17:15:50.366997+0000","last_fullsized":"2024-09-12T17:15:50.366997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.366844+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:11.340218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.659082+0000","last_change":"2024-09-12T17:15:39.659082+0000","last_active":"2024-09-12T17:15:39.659082+0000","last_peered":"2024-09-12T17:15:39.659082+0000","last_clean":"2024-09-12T17:15:39.659082+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:15:39.659082+0000","last_undegraded":"2024-09-12T17:15:39.659082+0000","last_fullsized":"2024-09-12T17:15:39.659082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.658876+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:39.698721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.761402+0000","last_change":"2024-09-12T17:11:14.774117+0000","last_active":"2024-09-12T17:13:29.761402+0000","last_peered":"2024-09-12T17:13:29.761402+0000","last_clean":"2024-09-12T17:13:29.761402+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:13:29.761402+0000","last_undegraded":"2024-09-12T17:13:29.761402+0000","last_fullsized":"2024-09-12T17:13:29.761402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.153122+0000","last_change":"2024-09-12T17:15:11.152858+0000","last_active":"2024-09-12T17:15:11.153122+0000","last_peered":"2024-09-12T17:15:11.153122+0000","last_clean":"2024-09-12T17:15:11.153122+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:15:11.153122+0000","last_undegraded":"2024-09-12T17:15:11.153122+0000","last_fullsized":"2024-09-12T17:15:11.153122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.152634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:17.511951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.954866+0000","last_change":"2024-09-12T17:14:56.954698+0000","last_active":"2024-09-12T17:14:56.954866+0000","last_peered":"2024-09-12T17:14:56.954866+0000","last_clean":"2024-09-12T17:14:56.954866+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:56.954866+0000","last_undegraded":"2024-09-12T17:14:56.954866+0000","last_fullsized":"2024-09-12T17:14:56.954866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.954518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:01.720351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.386536+0000","last_change":"2024-09-12T17:14:59.386412+0000","last_active":"2024-09-12T17:14:59.386536+0000","last_peered":"2024-09-12T17:14:59.386536+0000","last_clean":"2024-09-12T17:14:59.386536+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:14:59.386536+0000","last_undegraded":"2024-09-12T17:14:59.386536+0000","last_fullsized":"2024-09-12T17:14:59.386536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.386232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:09.105379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.432260+0000","last_change":"2024-09-12T17:15:40.432260+0000","last_active":"2024-09-12T17:15:40.432260+0000","last_peered":"2024-09-12T17:15:40.432260+0000","last_clean":"2024-09-12T17:15:40.432260+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:15:40.432260+0000","last_undegraded":"2024-09-12T17:15:40.432260+0000","last_fullsized":"2024-09-12T17:15:40.432260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.432083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:25.686692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'101","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.074417+0000","last_change":"2024-09-12T17:15:32.074417+0000","last_active":"2024-09-12T17:15:32.074417+0000","last_peered":"2024-09-12T17:15:32.074417+0000","last_clean":"2024-09-12T17:15:32.074417+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:15:32.074417+0000","last_undegraded":"2024-09-12T17:15:32.074417+0000","last_fullsized":"2024-09-12T17:15:32.074417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'101","last_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_deep_scrub":"34'101","last_deep_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.074146+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.161569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.634033+0000","last_change":"2024-09-12T17:15:40.634033+0000","last_active":"2024-09-12T17:15:40.634033+0000","last_peered":"2024-09-12T17:15:40.634033+0000","last_clean":"2024-09-12T17:15:40.634033+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:15:40.634033+0000","last_undegraded":"2024-09-12T17:15:40.634033+0000","last_fullsized":"2024-09-12T17:15:40.634033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.633855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:24.161604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.006178+0000","last_change":"2024-09-12T17:15:48.006178+0000","last_active":"2024-09-12T17:15:48.006178+0000","last_peered":"2024-09-12T17:15:48.006178+0000","last_clean":"2024-09-12T17:15:48.006178+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:15:48.006178+0000","last_undegraded":"2024-09-12T17:15:48.006178+0000","last_fullsized":"2024-09-12T17:15:48.006178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.006000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:11.503416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.921995+0000","last_change":"2024-09-12T17:15:49.921995+0000","last_active":"2024-09-12T17:15:49.921995+0000","last_peered":"2024-09-12T17:15:49.921995+0000","last_clean":"2024-09-12T17:15:49.921995+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:15:49.921995+0000","last_undegraded":"2024-09-12T17:15:49.921995+0000","last_fullsized":"2024-09-12T17:15:49.921995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.921812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:20.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.152040+0000","last_change":"2024-09-12T17:15:15.151829+0000","last_active":"2024-09-12T17:15:15.152040+0000","last_peered":"2024-09-12T17:15:15.152040+0000","last_clean":"2024-09-12T17:15:15.152040+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:15:15.152040+0000","last_undegraded":"2024-09-12T17:15:15.152040+0000","last_fullsized":"2024-09-12T17:15:15.152040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.151618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:24.317983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.299393+0000","last_change":"2024-09-12T17:15:12.299261+0000","last_active":"2024-09-12T17:15:12.299393+0000","last_peered":"2024-09-12T17:15:12.299393+0000","last_clean":"2024-09-12T17:15:12.299393+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:15:12.299393+0000","last_undegraded":"2024-09-12T17:15:12.299393+0000","last_fullsized":"2024-09-12T17:15:12.299393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.299076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:16.946359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.890725+0000","last_change":"2024-09-12T17:15:31.890554+0000","last_active":"2024-09-12T17:15:31.890725+0000","last_peered":"2024-09-12T17:15:31.890725+0000","last_clean":"2024-09-12T17:15:31.890725+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:15:31.890725+0000","last_undegraded":"2024-09-12T17:15:31.890725+0000","last_fullsized":"2024-09-12T17:15:31.890725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.890371+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:17.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'35","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.161548+0000","last_change":"2024-09-12T17:11:10.738669+0000","last_active":"2024-09-12T17:14:51.161548+0000","last_peered":"2024-09-12T17:14:51.161548+0000","last_clean":"2024-09-12T17:14:51.161548+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:14:51.161548+0000","last_undegraded":"2024-09-12T17:14:51.161548+0000","last_fullsized":"2024-09-12T17:14:51.161548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:34.797830+0000","last_change":"2024-09-12T17:11:12.743766+0000","last_active":"2024-09-12T17:13:34.797830+0000","last_peered":"2024-09-12T17:13:34.797830+0000","last_clean":"2024-09-12T17:13:34.797830+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:13:34.797830+0000","last_undegraded":"2024-09-12T17:13:34.797830+0000","last_fullsized":"2024-09-12T17:13:34.797830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:16.386759+0000","last_change":"2024-09-12T17:11:14.752918+0000","last_active":"2024-09-12T17:13:16.386759+0000","last_peered":"2024-09-12T17:13:16.386759+0000","last_clean":"2024-09-12T17:13:16.386759+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:13:16.386759+0000","last_undegraded":"2024-09-12T17:13:16.386759+0000","last_fullsized":"2024-09-12T17:13:16.386759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.850424+0000","last_change":"2024-09-12T17:15:14.850267+0000","last_active":"2024-09-12T17:15:14.850424+0000","last_peered":"2024-09-12T17:15:14.850424+0000","last_clean":"2024-09-12T17:15:14.850424+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:15:14.850424+0000","last_undegraded":"2024-09-12T17:15:14.850424+0000","last_fullsized":"2024-09-12T17:15:14.850424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.850076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:10.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.314071+0000","last_change":"2024-09-12T17:15:02.314071+0000","last_active":"2024-09-12T17:15:02.314071+0000","last_peered":"2024-09-12T17:15:02.314071+0000","last_clean":"2024-09-12T17:15:02.314071+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:15:02.314071+0000","last_undegraded":"2024-09-12T17:15:02.314071+0000","last_fullsized":"2024-09-12T17:15:02.314071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.313786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:05.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.369588+0000","last_change":"2024-09-12T17:15:45.369445+0000","last_active":"2024-09-12T17:15:45.369588+0000","last_peered":"2024-09-12T17:15:45.369588+0000","last_clean":"2024-09-12T17:15:45.369588+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:15:45.369588+0000","last_undegraded":"2024-09-12T17:15:45.369588+0000","last_fullsized":"2024-09-12T17:15:45.369588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.369237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.442814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.650928+0000","last_change":"2024-09-12T17:15:34.650775+0000","last_active":"2024-09-12T17:15:34.650928+0000","last_peered":"2024-09-12T17:15:34.650928+0000","last_clean":"2024-09-12T17:15:34.650928+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:15:34.650928+0000","last_undegraded":"2024-09-12T17:15:34.650928+0000","last_fullsized":"2024-09-12T17:15:34.650928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.650585+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:36.625397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.955970+0000","last_change":"2024-09-12T17:15:42.955676+0000","last_active":"2024-09-12T17:15:42.955970+0000","last_peered":"2024-09-12T17:15:42.955970+0000","last_clean":"2024-09-12T17:15:42.955970+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:15:42.955970+0000","last_undegraded":"2024-09-12T17:15:42.955970+0000","last_fullsized":"2024-09-12T17:15:42.955970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.955456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:31.849550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.799129+0000","last_change":"2024-09-12T17:11:14.779042+0000","last_active":"2024-09-12T17:11:43.799129+0000","last_peered":"2024-09-12T17:11:43.799129+0000","last_clean":"2024-09-12T17:11:43.799129+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:11:43.799129+0000","last_undegraded":"2024-09-12T17:11:43.799129+0000","last_fullsized":"2024-09-12T17:11:43.799129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:32.890417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.591015+0000","last_change":"2024-09-12T17:15:11.590855+0000","last_active":"2024-09-12T17:15:11.591015+0000","last_peered":"2024-09-12T17:15:11.591015+0000","last_clean":"2024-09-12T17:15:11.591015+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:15:11.591015+0000","last_undegraded":"2024-09-12T17:15:11.591015+0000","last_fullsized":"2024-09-12T17:15:11.591015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.590645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:52.146542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.289858+0000","last_change":"2024-09-12T17:15:03.289858+0000","last_active":"2024-09-12T17:15:03.289858+0000","last_peered":"2024-09-12T17:15:03.289858+0000","last_clean":"2024-09-12T17:15:03.289858+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:15:03.289858+0000","last_undegraded":"2024-09-12T17:15:03.289858+0000","last_fullsized":"2024-09-12T17:15:03.289858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.289669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.942393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.086863+0000","last_change":"2024-09-12T17:15:27.086675+0000","last_active":"2024-09-12T17:15:27.086863+0000","last_peered":"2024-09-12T17:15:27.086863+0000","last_clean":"2024-09-12T17:15:27.086863+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:15:27.086863+0000","last_undegraded":"2024-09-12T17:15:27.086863+0000","last_fullsized":"2024-09-12T17:15:27.086863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.086490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:57.656954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.673143+0000","last_change":"2024-09-12T17:15:35.672973+0000","last_active":"2024-09-12T17:15:35.673143+0000","last_peered":"2024-09-12T17:15:35.673143+0000","last_clean":"2024-09-12T17:15:35.673143+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:15:35.673143+0000","last_undegraded":"2024-09-12T17:15:35.673143+0000","last_fullsized":"2024-09-12T17:15:35.673143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.672790+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:49.446223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.784101+0000","last_change":"2024-09-12T17:15:45.783931+0000","last_active":"2024-09-12T17:15:45.784101+0000","last_peered":"2024-09-12T17:15:45.784101+0000","last_clean":"2024-09-12T17:15:45.784101+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:15:45.784101+0000","last_undegraded":"2024-09-12T17:15:45.784101+0000","last_fullsized":"2024-09-12T17:15:45.784101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.783750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:55.502897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.805919+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:11:43.805919+0000","last_peered":"2024-09-12T17:11:43.805919+0000","last_clean":"2024-09-12T17:11:43.805919+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:11:43.805919+0000","last_undegraded":"2024-09-12T17:11:43.805919+0000","last_fullsized":"2024-09-12T17:11:43.805919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:30.707783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.353435+0000","last_change":"2024-09-12T17:15:29.353247+0000","last_active":"2024-09-12T17:15:29.353435+0000","last_peered":"2024-09-12T17:15:29.353435+0000","last_clean":"2024-09-12T17:15:29.353435+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:15:29.353435+0000","last_undegraded":"2024-09-12T17:15:29.353435+0000","last_fullsized":"2024-09-12T17:15:29.353435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.353071+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:11.062516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.890737+0000","last_change":"2024-09-12T17:14:58.890548+0000","last_active":"2024-09-12T17:14:58.890737+0000","last_peered":"2024-09-12T17:14:58.890737+0000","last_clean":"2024-09-12T17:14:58.890737+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:14:58.890737+0000","last_undegraded":"2024-09-12T17:14:58.890737+0000","last_fullsized":"2024-09-12T17:14:58.890737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.890365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:09.596280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.349063+0000","last_change":"2024-09-12T17:15:44.348933+0000","last_active":"2024-09-12T17:15:44.349063+0000","last_peered":"2024-09-12T17:15:44.349063+0000","last_clean":"2024-09-12T17:15:44.349063+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:15:44.349063+0000","last_undegraded":"2024-09-12T17:15:44.349063+0000","last_fullsized":"2024-09-12T17:15:44.349063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.348761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:50.958089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.032930+0000","last_change":"2024-09-12T17:15:35.032692+0000","last_active":"2024-09-12T17:15:35.032930+0000","last_peered":"2024-09-12T17:15:35.032930+0000","last_clean":"2024-09-12T17:15:35.032930+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:15:35.032930+0000","last_undegraded":"2024-09-12T17:15:35.032930+0000","last_fullsized":"2024-09-12T17:15:35.032930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.032454+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:53.441585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.949640+0000","last_change":"2024-09-12T17:15:41.949494+0000","last_active":"2024-09-12T17:15:41.949640+0000","last_peered":"2024-09-12T17:15:41.949640+0000","last_clean":"2024-09-12T17:15:41.949640+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:15:41.949640+0000","last_undegraded":"2024-09-12T17:15:41.949640+0000","last_fullsized":"2024-09-12T17:15:41.949640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.949314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:03.033316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.390800+0000","last_change":"2024-09-12T17:15:36.390800+0000","last_active":"2024-09-12T17:15:36.390800+0000","last_peered":"2024-09-12T17:15:36.390800+0000","last_clean":"2024-09-12T17:15:36.390800+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:15:36.390800+0000","last_undegraded":"2024-09-12T17:15:36.390800+0000","last_fullsized":"2024-09-12T17:15:36.390800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.390596+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:49.608907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.279391+0000","last_change":"2024-09-12T17:15:09.279239+0000","last_active":"2024-09-12T17:15:09.279391+0000","last_peered":"2024-09-12T17:15:09.279391+0000","last_clean":"2024-09-12T17:15:09.279391+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:15:09.279391+0000","last_undegraded":"2024-09-12T17:15:09.279391+0000","last_fullsized":"2024-09-12T17:15:09.279391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.279045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:06.707329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.686351+0000","last_change":"2024-09-12T17:15:33.686351+0000","last_active":"2024-09-12T17:15:33.686351+0000","last_peered":"2024-09-12T17:15:33.686351+0000","last_clean":"2024-09-12T17:15:33.686351+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:15:33.686351+0000","last_undegraded":"2024-09-12T17:15:33.686351+0000","last_fullsized":"2024-09-12T17:15:33.686351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.686171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:43.686493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.656278+0000","last_change":"2024-09-12T17:15:37.656278+0000","last_active":"2024-09-12T17:15:37.656278+0000","last_peered":"2024-09-12T17:15:37.656278+0000","last_clean":"2024-09-12T17:15:37.656278+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:15:37.656278+0000","last_undegraded":"2024-09-12T17:15:37.656278+0000","last_fullsized":"2024-09-12T17:15:37.656278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.656070+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:16.570468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.941979+0000","last_change":"2024-09-12T17:15:40.941979+0000","last_active":"2024-09-12T17:15:40.941979+0000","last_peered":"2024-09-12T17:15:40.941979+0000","last_clean":"2024-09-12T17:15:40.941979+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:15:40.941979+0000","last_undegraded":"2024-09-12T17:15:40.941979+0000","last_fullsized":"2024-09-12T17:15:40.941979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.941800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.911092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:33.763768+0000","last_change":"2024-09-12T17:11:14.778245+0000","last_active":"2024-09-12T17:13:33.763768+0000","last_peered":"2024-09-12T17:13:33.763768+0000","last_clean":"2024-09-12T17:13:33.763768+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:13:33.763768+0000","last_undegraded":"2024-09-12T17:13:33.763768+0000","last_fullsized":"2024-09-12T17:13:33.763768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.679383+0000","last_change":"2024-09-12T17:15:16.679383+0000","last_active":"2024-09-12T17:15:16.679383+0000","last_peered":"2024-09-12T17:15:16.679383+0000","last_clean":"2024-09-12T17:15:16.679383+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:15:16.679383+0000","last_undegraded":"2024-09-12T17:15:16.679383+0000","last_fullsized":"2024-09-12T17:15:16.679383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.679191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:01.792668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.892102+0000","last_change":"2024-09-12T17:14:59.891960+0000","last_active":"2024-09-12T17:14:59.892102+0000","last_peered":"2024-09-12T17:14:59.892102+0000","last_clean":"2024-09-12T17:14:59.892102+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:14:59.892102+0000","last_undegraded":"2024-09-12T17:14:59.892102+0000","last_fullsized":"2024-09-12T17:14:59.892102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.891778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:26.957401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.044894+0000","last_change":"2024-09-12T17:15:30.044894+0000","last_active":"2024-09-12T17:15:30.044894+0000","last_peered":"2024-09-12T17:15:30.044894+0000","last_clean":"2024-09-12T17:15:30.044894+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:15:30.044894+0000","last_undegraded":"2024-09-12T17:15:30.044894+0000","last_fullsized":"2024-09-12T17:15:30.044894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.044721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:10.826683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.055782+0000","last_change":"2024-09-12T17:11:10.747435+0000","last_active":"2024-09-12T17:14:51.055782+0000","last_peered":"2024-09-12T17:14:51.055782+0000","last_clean":"2024-09-12T17:14:51.055782+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:14:51.055782+0000","last_undegraded":"2024-09-12T17:14:51.055782+0000","last_fullsized":"2024-09-12T17:14:51.055782+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:41.518360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.825453+0000","last_change":"2024-09-12T17:15:47.825453+0000","last_active":"2024-09-12T17:15:47.825453+0000","last_peered":"2024-09-12T17:15:47.825453+0000","last_clean":"2024-09-12T17:15:47.825453+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:15:47.825453+0000","last_undegraded":"2024-09-12T17:15:47.825453+0000","last_fullsized":"2024-09-12T17:15:47.825453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.825272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:30.075123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:34.798000+0000","last_change":"2024-09-12T17:11:14.766167+0000","last_active":"2024-09-12T17:13:34.798000+0000","last_peered":"2024-09-12T17:13:34.798000+0000","last_clean":"2024-09-12T17:13:34.798000+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:13:34.798000+0000","last_undegraded":"2024-09-12T17:13:34.798000+0000","last_fullsized":"2024-09-12T17:13:34.798000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.347117+0000","last_change":"2024-09-12T17:15:33.347117+0000","last_active":"2024-09-12T17:15:33.347117+0000","last_peered":"2024-09-12T17:15:33.347117+0000","last_clean":"2024-09-12T17:15:33.347117+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:15:33.347117+0000","last_undegraded":"2024-09-12T17:15:33.347117+0000","last_fullsized":"2024-09-12T17:15:33.347117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.346944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:57.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.858355+0000","last_change":"2024-09-12T17:15:02.858355+0000","last_active":"2024-09-12T17:15:02.858355+0000","last_peered":"2024-09-12T17:15:02.858355+0000","last_clean":"2024-09-12T17:15:02.858355+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:15:02.858355+0000","last_undegraded":"2024-09-12T17:15:02.858355+0000","last_fullsized":"2024-09-12T17:15:02.858355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.858176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:23.000373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.068082+0000","last_change":"2024-09-12T17:15:28.068082+0000","last_active":"2024-09-12T17:15:28.068082+0000","last_peered":"2024-09-12T17:15:28.068082+0000","last_clean":"2024-09-12T17:15:28.068082+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:15:28.068082+0000","last_undegraded":"2024-09-12T17:15:28.068082+0000","last_fullsized":"2024-09-12T17:15:28.068082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.067903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:07.804712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.706808+0000","last_change":"2024-09-12T17:15:38.706808+0000","last_active":"2024-09-12T17:15:38.706808+0000","last_peered":"2024-09-12T17:15:38.706808+0000","last_clean":"2024-09-12T17:15:38.706808+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:15:38.706808+0000","last_undegraded":"2024-09-12T17:15:38.706808+0000","last_fullsized":"2024-09-12T17:15:38.706808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.706615+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:06.515086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.610985+0000","last_change":"2024-09-12T17:15:50.610985+0000","last_active":"2024-09-12T17:15:50.610985+0000","last_peered":"2024-09-12T17:15:50.610985+0000","last_clean":"2024-09-12T17:15:50.610985+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:15:50.610985+0000","last_undegraded":"2024-09-12T17:15:50.610985+0000","last_fullsized":"2024-09-12T17:15:50.610985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.610873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:34.797939+0000","last_change":"2024-09-12T17:11:14.772549+0000","last_active":"2024-09-12T17:13:34.797939+0000","last_peered":"2024-09-12T17:13:34.797939+0000","last_clean":"2024-09-12T17:13:34.797939+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:13:34.797939+0000","last_undegraded":"2024-09-12T17:13:34.797939+0000","last_fullsized":"2024-09-12T17:13:34.797939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.694857+0000","last_change":"2024-09-12T17:15:15.694857+0000","last_active":"2024-09-12T17:15:15.694857+0000","last_peered":"2024-09-12T17:15:15.694857+0000","last_clean":"2024-09-12T17:15:15.694857+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:15:15.694857+0000","last_undegraded":"2024-09-12T17:15:15.694857+0000","last_fullsized":"2024-09-12T17:15:15.694857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.694614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:28.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.275775+0000","last_change":"2024-09-12T17:15:11.275775+0000","last_active":"2024-09-12T17:15:11.275775+0000","last_peered":"2024-09-12T17:15:11.275775+0000","last_clean":"2024-09-12T17:15:11.275775+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:15:11.275775+0000","last_undegraded":"2024-09-12T17:15:11.275775+0000","last_fullsized":"2024-09-12T17:15:11.275775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.275550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.702407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.841473+0000","last_change":"2024-09-12T17:15:35.841473+0000","last_active":"2024-09-12T17:15:35.841473+0000","last_peered":"2024-09-12T17:15:35.841473+0000","last_clean":"2024-09-12T17:15:35.841473+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:15:35.841473+0000","last_undegraded":"2024-09-12T17:15:35.841473+0000","last_fullsized":"2024-09-12T17:15:35.841473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.841290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.567347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:09.791268+0000","last_change":"2024-09-12T17:11:10.749578+0000","last_active":"2024-09-12T17:13:09.791268+0000","last_peered":"2024-09-12T17:13:09.791268+0000","last_clean":"2024-09-12T17:13:09.791268+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:13:09.791268+0000","last_undegraded":"2024-09-12T17:13:09.791268+0000","last_fullsized":"2024-09-12T17:13:09.791268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.942026+0000","last_change":"2024-09-12T17:15:43.942026+0000","last_active":"2024-09-12T17:15:43.942026+0000","last_peered":"2024-09-12T17:15:43.942026+0000","last_clean":"2024-09-12T17:15:43.942026+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:15:43.942026+0000","last_undegraded":"2024-09-12T17:15:43.942026+0000","last_fullsized":"2024-09-12T17:15:43.942026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.941828+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:54.981369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.868798+0000","last_change":"2024-09-12T17:11:14.759588+0000","last_active":"2024-09-12T17:14:19.868798+0000","last_peered":"2024-09-12T17:14:19.868798+0000","last_clean":"2024-09-12T17:14:19.868798+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:14:19.868798+0000","last_undegraded":"2024-09-12T17:14:19.868798+0000","last_fullsized":"2024-09-12T17:14:19.868798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.160440+0000","last_change":"2024-09-12T17:15:19.160440+0000","last_active":"2024-09-12T17:15:19.160440+0000","last_peered":"2024-09-12T17:15:19.160440+0000","last_clean":"2024-09-12T17:15:19.160440+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:15:19.160440+0000","last_undegraded":"2024-09-12T17:15:19.160440+0000","last_fullsized":"2024-09-12T17:15:19.160440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.160245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:47.049379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.864639+0000","last_change":"2024-09-12T17:15:00.864639+0000","last_active":"2024-09-12T17:15:00.864639+0000","last_peered":"2024-09-12T17:15:00.864639+0000","last_clean":"2024-09-12T17:15:00.864639+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:15:00.864639+0000","last_undegraded":"2024-09-12T17:15:00.864639+0000","last_fullsized":"2024-09-12T17:15:00.864639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.864442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:24.991687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.833150+0000","last_change":"2024-09-12T17:15:34.833150+0000","last_active":"2024-09-12T17:15:34.833150+0000","last_peered":"2024-09-12T17:15:34.833150+0000","last_clean":"2024-09-12T17:15:34.833150+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:15:34.833150+0000","last_undegraded":"2024-09-12T17:15:34.833150+0000","last_fullsized":"2024-09-12T17:15:34.833150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.832966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:52.647443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.861499+0000","last_change":"2024-09-12T17:15:42.861499+0000","last_active":"2024-09-12T17:15:42.861499+0000","last_peered":"2024-09-12T17:15:42.861499+0000","last_clean":"2024-09-12T17:15:42.861499+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:15:42.861499+0000","last_undegraded":"2024-09-12T17:15:42.861499+0000","last_fullsized":"2024-09-12T17:15:42.861499+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.861281+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:02.493188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.625209+0000","last_change":"2024-09-12T17:15:47.625209+0000","last_active":"2024-09-12T17:15:47.625209+0000","last_peered":"2024-09-12T17:15:47.625209+0000","last_clean":"2024-09-12T17:15:47.625209+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:15:47.625209+0000","last_undegraded":"2024-09-12T17:15:47.625209+0000","last_fullsized":"2024-09-12T17:15:47.625209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.625030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:50.457416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.844522+0000","last_change":"2024-09-12T17:15:53.844522+0000","last_active":"2024-09-12T17:15:53.844522+0000","last_peered":"2024-09-12T17:15:53.844522+0000","last_clean":"2024-09-12T17:15:53.844522+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:15:53.844522+0000","last_undegraded":"2024-09-12T17:15:53.844522+0000","last_fullsized":"2024-09-12T17:15:53.844522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.844338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:03.815876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.127348+0000","last_change":"2024-09-12T17:15:18.127348+0000","last_active":"2024-09-12T17:15:18.127348+0000","last_peered":"2024-09-12T17:15:18.127348+0000","last_clean":"2024-09-12T17:15:18.127348+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:15:18.127348+0000","last_undegraded":"2024-09-12T17:15:18.127348+0000","last_fullsized":"2024-09-12T17:15:18.127348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.127110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:36.993142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.285556+0000","last_change":"2024-09-12T17:15:10.285556+0000","last_active":"2024-09-12T17:15:10.285556+0000","last_peered":"2024-09-12T17:15:10.285556+0000","last_clean":"2024-09-12T17:15:10.285556+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:15:10.285556+0000","last_undegraded":"2024-09-12T17:15:10.285556+0000","last_fullsized":"2024-09-12T17:15:10.285556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.285362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:12.449928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.037671+0000","last_change":"2024-09-12T17:15:29.037671+0000","last_active":"2024-09-12T17:15:29.037671+0000","last_peered":"2024-09-12T17:15:29.037671+0000","last_clean":"2024-09-12T17:15:29.037671+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:15:29.037671+0000","last_undegraded":"2024-09-12T17:15:29.037671+0000","last_fullsized":"2024-09-12T17:15:29.037671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.037477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:54.325784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.646833+0000","last_change":"2024-09-12T17:15:36.646833+0000","last_active":"2024-09-12T17:15:36.646833+0000","last_peered":"2024-09-12T17:15:36.646833+0000","last_clean":"2024-09-12T17:15:36.646833+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.646833+0000","last_undegraded":"2024-09-12T17:15:36.646833+0000","last_fullsized":"2024-09-12T17:15:36.646833+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.646641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:39.059542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.797086+0000","last_change":"2024-09-12T17:11:12.745948+0000","last_active":"2024-09-12T17:11:43.797086+0000","last_peered":"2024-09-12T17:11:43.797086+0000","last_clean":"2024-09-12T17:11:43.797086+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:11:43.797086+0000","last_undegraded":"2024-09-12T17:11:43.797086+0000","last_fullsized":"2024-09-12T17:11:43.797086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:52.135372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:50.724842+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:11:50.724842+0000","last_peered":"2024-09-12T17:11:50.724842+0000","last_clean":"2024-09-12T17:11:50.724842+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:11:50.724842+0000","last_undegraded":"2024-09-12T17:11:50.724842+0000","last_fullsized":"2024-09-12T17:11:50.724842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:43.688709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.119280+0000","last_change":"2024-09-12T17:15:17.119280+0000","last_active":"2024-09-12T17:15:17.119280+0000","last_peered":"2024-09-12T17:15:17.119280+0000","last_clean":"2024-09-12T17:15:17.119280+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:15:17.119280+0000","last_undegraded":"2024-09-12T17:15:17.119280+0000","last_fullsized":"2024-09-12T17:15:17.119280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.119084+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:32.612758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.581681+0000","last_change":"2024-09-12T17:14:58.581536+0000","last_active":"2024-09-12T17:14:58.581681+0000","last_peered":"2024-09-12T17:14:58.581681+0000","last_clean":"2024-09-12T17:14:58.581681+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:14:58.581681+0000","last_undegraded":"2024-09-12T17:14:58.581681+0000","last_fullsized":"2024-09-12T17:14:58.581681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.581351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:14.075025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.898232+0000","last_change":"2024-09-12T17:15:32.898232+0000","last_active":"2024-09-12T17:15:32.898232+0000","last_peered":"2024-09-12T17:15:32.898232+0000","last_clean":"2024-09-12T17:15:32.898232+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:15:32.898232+0000","last_undegraded":"2024-09-12T17:15:32.898232+0000","last_fullsized":"2024-09-12T17:15:32.898232+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.898046+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:58.817691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'29","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:51.173634+0000","last_change":"2024-09-12T17:11:10.738686+0000","last_active":"2024-09-12T17:14:51.173634+0000","last_peered":"2024-09-12T17:14:51.173634+0000","last_clean":"2024-09-12T17:14:51.173634+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:14:51.173634+0000","last_undegraded":"2024-09-12T17:14:51.173634+0000","last_fullsized":"2024-09-12T17:14:51.173634+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:41.698004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:11:43.798275+0000","last_change":"2024-09-12T17:11:12.756449+0000","last_active":"2024-09-12T17:11:43.798275+0000","last_peered":"2024-09-12T17:11:43.798275+0000","last_clean":"2024-09-12T17:11:43.798275+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:11:43.798275+0000","last_undegraded":"2024-09-12T17:11:43.798275+0000","last_fullsized":"2024-09-12T17:11:43.798275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:11.696158+0000","last_clean_scrub_stamp":"2024-09-12T17:11:11.696158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:25:12.282305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.498013+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.498013+0000","last_peered":"2024-09-12T17:14:19.498013+0000","last_clean":"2024-09-12T17:14:19.498013+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.498013+0000","last_undegraded":"2024-09-12T17:14:19.498013+0000","last_fullsized":"2024-09-12T17:14:19.498013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:24:16.533609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.132949+0000","last_change":"2024-09-12T17:15:16.132949+0000","last_active":"2024-09-12T17:15:16.132949+0000","last_peered":"2024-09-12T17:15:16.132949+0000","last_clean":"2024-09-12T17:15:16.132949+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:15:16.132949+0000","last_undegraded":"2024-09-12T17:15:16.132949+0000","last_fullsized":"2024-09-12T17:15:16.132949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.132765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:16.951874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.868010+0000","last_change":"2024-09-12T17:15:01.867847+0000","last_active":"2024-09-12T17:15:01.868010+0000","last_peered":"2024-09-12T17:15:01.868010+0000","last_clean":"2024-09-12T17:15:01.868010+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:15:01.868010+0000","last_undegraded":"2024-09-12T17:15:01.868010+0000","last_fullsized":"2024-09-12T17:15:01.868010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.867668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.434128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.887755+0000","last_change":"2024-09-12T17:15:36.887755+0000","last_active":"2024-09-12T17:15:36.887755+0000","last_peered":"2024-09-12T17:15:36.887755+0000","last_clean":"2024-09-12T17:15:36.887755+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:15:36.887755+0000","last_undegraded":"2024-09-12T17:15:36.887755+0000","last_fullsized":"2024-09-12T17:15:36.887755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.887464+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:14.748108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'36","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:50.945459+0000","last_change":"2024-09-12T17:11:10.742741+0000","last_active":"2024-09-12T17:14:50.945459+0000","last_peered":"2024-09-12T17:14:50.945459+0000","last_clean":"2024-09-12T17:14:50.945459+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:14:50.945459+0000","last_undegraded":"2024-09-12T17:14:50.945459+0000","last_fullsized":"2024-09-12T17:14:50.945459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:09.681998+0000","last_clean_scrub_stamp":"2024-09-12T17:11:09.681998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:13.450423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.652254+0000","last_change":"2024-09-12T17:15:49.652254+0000","last_active":"2024-09-12T17:15:49.652254+0000","last_peered":"2024-09-12T17:15:49.652254+0000","last_clean":"2024-09-12T17:15:49.652254+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:15:49.652254+0000","last_undegraded":"2024-09-12T17:15:49.652254+0000","last_fullsized":"2024-09-12T17:15:49.652254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.652077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:48.997120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:34.798183+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:34.798183+0000","last_peered":"2024-09-12T17:13:34.798183+0000","last_clean":"2024-09-12T17:13:34.798183+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:34.798183+0000","last_undegraded":"2024-09-12T17:13:34.798183+0000","last_fullsized":"2024-09-12T17:13:34.798183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.889371+0000","last_change":"2024-09-12T17:15:17.889200+0000","last_active":"2024-09-12T17:15:17.889371+0000","last_peered":"2024-09-12T17:15:17.889371+0000","last_clean":"2024-09-12T17:15:17.889371+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:15:17.889371+0000","last_undegraded":"2024-09-12T17:15:17.889371+0000","last_fullsized":"2024-09-12T17:15:17.889371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.889016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:57.728810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.238720+0000","last_change":"2024-09-12T17:15:05.238547+0000","last_active":"2024-09-12T17:15:05.238720+0000","last_peered":"2024-09-12T17:15:05.238720+0000","last_clean":"2024-09-12T17:15:05.238720+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:15:05.238720+0000","last_undegraded":"2024-09-12T17:15:05.238720+0000","last_fullsized":"2024-09-12T17:15:05.238720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.238353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:56.750159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.671276+0000","last_change":"2024-09-12T17:15:20.671042+0000","last_active":"2024-09-12T17:15:20.671276+0000","last_peered":"2024-09-12T17:15:20.671276+0000","last_clean":"2024-09-12T17:15:20.671276+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:15:20.671276+0000","last_undegraded":"2024-09-12T17:15:20.671276+0000","last_fullsized":"2024-09-12T17:15:20.671276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.670806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:30.872392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.616378+0000","last_change":"2024-09-12T17:15:02.616092+0000","last_active":"2024-09-12T17:15:02.616378+0000","last_peered":"2024-09-12T17:15:02.616378+0000","last_clean":"2024-09-12T17:15:02.616378+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:15:02.616378+0000","last_undegraded":"2024-09-12T17:15:02.616378+0000","last_fullsized":"2024-09-12T17:15:02.616378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.615816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.024352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.322903+0000","last_change":"2024-09-12T17:15:34.322903+0000","last_active":"2024-09-12T17:15:34.322903+0000","last_peered":"2024-09-12T17:15:34.322903+0000","last_clean":"2024-09-12T17:15:34.322903+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:15:34.322903+0000","last_undegraded":"2024-09-12T17:15:34.322903+0000","last_fullsized":"2024-09-12T17:15:34.322903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.322694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:48.925147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.284536+0000","last_change":"2024-09-12T17:15:13.284400+0000","last_active":"2024-09-12T17:15:13.284536+0000","last_peered":"2024-09-12T17:15:13.284536+0000","last_clean":"2024-09-12T17:15:13.284536+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:15:13.284536+0000","last_undegraded":"2024-09-12T17:15:13.284536+0000","last_fullsized":"2024-09-12T17:15:13.284536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.284187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:57.850098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.670504+0000","last_change":"2024-09-12T17:15:19.670350+0000","last_active":"2024-09-12T17:15:19.670504+0000","last_peered":"2024-09-12T17:15:19.670504+0000","last_clean":"2024-09-12T17:15:19.670504+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:15:19.670504+0000","last_undegraded":"2024-09-12T17:15:19.670504+0000","last_fullsized":"2024-09-12T17:15:19.670504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.670162+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:29.009474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.567132+0000","last_change":"2024-09-12T17:15:03.566984+0000","last_active":"2024-09-12T17:15:03.567132+0000","last_peered":"2024-09-12T17:15:03.567132+0000","last_clean":"2024-09-12T17:15:03.567132+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:15:03.567132+0000","last_undegraded":"2024-09-12T17:15:03.567132+0000","last_fullsized":"2024-09-12T17:15:03.567132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.566768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:47.560762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.649801+0000","last_change":"2024-09-12T17:15:17.649633+0000","last_active":"2024-09-12T17:15:17.649801+0000","last_peered":"2024-09-12T17:15:17.649801+0000","last_clean":"2024-09-12T17:15:17.649801+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:15:17.649801+0000","last_undegraded":"2024-09-12T17:15:17.649801+0000","last_fullsized":"2024-09-12T17:15:17.649801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.649454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:05.606953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.571576+0000","last_change":"2024-09-12T17:15:04.571415+0000","last_active":"2024-09-12T17:15:04.571576+0000","last_peered":"2024-09-12T17:15:04.571576+0000","last_clean":"2024-09-12T17:15:04.571576+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:15:04.571576+0000","last_undegraded":"2024-09-12T17:15:04.571576+0000","last_fullsized":"2024-09-12T17:15:04.571576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.571227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:38.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.873095+0000","last_change":"2024-09-12T17:15:16.872841+0000","last_active":"2024-09-12T17:15:16.873095+0000","last_peered":"2024-09-12T17:15:16.873095+0000","last_clean":"2024-09-12T17:15:16.873095+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:15:16.873095+0000","last_undegraded":"2024-09-12T17:15:16.873095+0000","last_fullsized":"2024-09-12T17:15:16.873095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.872542+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:45.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.875249+0000","last_change":"2024-09-12T17:15:03.875105+0000","last_active":"2024-09-12T17:15:03.875249+0000","last_peered":"2024-09-12T17:15:03.875249+0000","last_clean":"2024-09-12T17:15:03.875249+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:15:03.875249+0000","last_undegraded":"2024-09-12T17:15:03.875249+0000","last_fullsized":"2024-09-12T17:15:03.875249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.874897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:32.945371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.700030+0000","last_change":"2024-09-12T17:15:18.699771+0000","last_active":"2024-09-12T17:15:18.700030+0000","last_peered":"2024-09-12T17:15:18.700030+0000","last_clean":"2024-09-12T17:15:18.700030+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:15:18.700030+0000","last_undegraded":"2024-09-12T17:15:18.700030+0000","last_fullsized":"2024-09-12T17:15:18.700030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.699553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:11.188707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.247386+0000","last_change":"2024-09-12T17:15:04.247188+0000","last_active":"2024-09-12T17:15:04.247386+0000","last_peered":"2024-09-12T17:15:04.247386+0000","last_clean":"2024-09-12T17:15:04.247386+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:15:04.247386+0000","last_undegraded":"2024-09-12T17:15:04.247386+0000","last_fullsized":"2024-09-12T17:15:04.247386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.247001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:40.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.861612+0000","last_change":"2024-09-12T17:15:15.861444+0000","last_active":"2024-09-12T17:15:15.861612+0000","last_peered":"2024-09-12T17:15:15.861612+0000","last_clean":"2024-09-12T17:15:15.861612+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:15:15.861612+0000","last_undegraded":"2024-09-12T17:15:15.861612+0000","last_fullsized":"2024-09-12T17:15:15.861612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.861265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.696684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.597439+0000","last_change":"2024-09-12T17:15:05.597274+0000","last_active":"2024-09-12T17:15:05.597439+0000","last_peered":"2024-09-12T17:15:05.597439+0000","last_clean":"2024-09-12T17:15:05.597439+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:15:05.597439+0000","last_undegraded":"2024-09-12T17:15:05.597439+0000","last_fullsized":"2024-09-12T17:15:05.597439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.597076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.894915+0000","last_change":"2024-09-12T17:15:21.894740+0000","last_active":"2024-09-12T17:15:21.894915+0000","last_peered":"2024-09-12T17:15:21.894915+0000","last_clean":"2024-09-12T17:15:21.894915+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:15:21.894915+0000","last_undegraded":"2024-09-12T17:15:21.894915+0000","last_fullsized":"2024-09-12T17:15:21.894915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.894560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:42.114364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.277700+0000","last_change":"2024-09-12T17:15:14.277545+0000","last_active":"2024-09-12T17:15:14.277700+0000","last_peered":"2024-09-12T17:15:14.277700+0000","last_clean":"2024-09-12T17:15:14.277700+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:15:14.277700+0000","last_undegraded":"2024-09-12T17:15:14.277700+0000","last_fullsized":"2024-09-12T17:15:14.277700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.277335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.472821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.355322+0000","last_change":"2024-09-12T17:15:35.355049+0000","last_active":"2024-09-12T17:15:35.355322+0000","last_peered":"2024-09-12T17:15:35.355322+0000","last_clean":"2024-09-12T17:15:35.355322+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:15:35.355322+0000","last_undegraded":"2024-09-12T17:15:35.355322+0000","last_fullsized":"2024-09-12T17:15:35.355322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.354816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:08.672902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.549503+0000","last_change":"2024-09-12T17:15:06.549362+0000","last_active":"2024-09-12T17:15:06.549503+0000","last_peered":"2024-09-12T17:15:06.549503+0000","last_clean":"2024-09-12T17:15:06.549503+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:15:06.549503+0000","last_undegraded":"2024-09-12T17:15:06.549503+0000","last_fullsized":"2024-09-12T17:15:06.549503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.549179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:02.554930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.628694+0000","last_change":"2024-09-12T17:15:21.628515+0000","last_active":"2024-09-12T17:15:21.628694+0000","last_peered":"2024-09-12T17:15:21.628694+0000","last_clean":"2024-09-12T17:15:21.628694+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:15:21.628694+0000","last_undegraded":"2024-09-12T17:15:21.628694+0000","last_fullsized":"2024-09-12T17:15:21.628694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.628332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:19.659256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.916560+0000","last_change":"2024-09-12T17:15:04.916380+0000","last_active":"2024-09-12T17:15:04.916560+0000","last_peered":"2024-09-12T17:15:04.916560+0000","last_clean":"2024-09-12T17:15:04.916560+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:15:04.916560+0000","last_undegraded":"2024-09-12T17:15:04.916560+0000","last_fullsized":"2024-09-12T17:15:04.916560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.916186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:14.335123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'20","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.882899+0000","last_change":"2024-09-12T17:15:22.882754+0000","last_active":"2024-09-12T17:15:22.882899+0000","last_peered":"2024-09-12T17:15:22.882899+0000","last_clean":"2024-09-12T17:15:22.882899+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:15:22.882899+0000","last_undegraded":"2024-09-12T17:15:22.882899+0000","last_fullsized":"2024-09-12T17:15:22.882899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.882573+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:01.302462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.892920+0000","last_change":"2024-09-12T17:15:05.892750+0000","last_active":"2024-09-12T17:15:05.892920+0000","last_peered":"2024-09-12T17:15:05.892920+0000","last_clean":"2024-09-12T17:15:05.892920+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:15:05.892920+0000","last_undegraded":"2024-09-12T17:15:05.892920+0000","last_fullsized":"2024-09-12T17:15:05.892920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.892542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.813883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.916868+0000","last_change":"2024-09-12T17:15:19.916708+0000","last_active":"2024-09-12T17:15:19.916868+0000","last_peered":"2024-09-12T17:15:19.916868+0000","last_clean":"2024-09-12T17:15:19.916868+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:15:19.916868+0000","last_undegraded":"2024-09-12T17:15:19.916868+0000","last_fullsized":"2024-09-12T17:15:19.916868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.916525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.259459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.324327+0000","last_change":"2024-09-12T17:15:20.324077+0000","last_active":"2024-09-12T17:15:20.324327+0000","last_peered":"2024-09-12T17:15:20.324327+0000","last_clean":"2024-09-12T17:15:20.324327+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:15:20.324327+0000","last_undegraded":"2024-09-12T17:15:20.324327+0000","last_fullsized":"2024-09-12T17:15:20.324327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.323778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:06.113896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.882796+0000","last_change":"2024-09-12T17:15:20.882625+0000","last_active":"2024-09-12T17:15:20.882796+0000","last_peered":"2024-09-12T17:15:20.882796+0000","last_clean":"2024-09-12T17:15:20.882796+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:15:20.882796+0000","last_undegraded":"2024-09-12T17:15:20.882796+0000","last_fullsized":"2024-09-12T17:15:20.882796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.882443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.227785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.295924+0000","last_change":"2024-09-12T17:15:16.295674+0000","last_active":"2024-09-12T17:15:16.295924+0000","last_peered":"2024-09-12T17:15:16.295924+0000","last_clean":"2024-09-12T17:15:16.295924+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:15:16.295924+0000","last_undegraded":"2024-09-12T17:15:16.295924+0000","last_fullsized":"2024-09-12T17:15:16.295924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.295447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:39.795551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.138893+0000","last_change":"2024-09-12T17:15:20.138893+0000","last_active":"2024-09-12T17:15:20.138893+0000","last_peered":"2024-09-12T17:15:20.138893+0000","last_clean":"2024-09-12T17:15:20.138893+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:15:20.138893+0000","last_undegraded":"2024-09-12T17:15:20.138893+0000","last_fullsized":"2024-09-12T17:15:20.138893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.138667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.029770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.206544+0000","last_change":"2024-09-12T17:15:06.206386+0000","last_active":"2024-09-12T17:15:06.206544+0000","last_peered":"2024-09-12T17:15:06.206544+0000","last_clean":"2024-09-12T17:15:06.206544+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:15:06.206544+0000","last_undegraded":"2024-09-12T17:15:06.206544+0000","last_fullsized":"2024-09-12T17:15:06.206544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.206190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:25.118231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.926993+0000","last_change":"2024-09-12T17:15:18.926822+0000","last_active":"2024-09-12T17:15:18.926993+0000","last_peered":"2024-09-12T17:15:18.926993+0000","last_clean":"2024-09-12T17:15:18.926993+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:15:18.926993+0000","last_undegraded":"2024-09-12T17:15:18.926993+0000","last_fullsized":"2024-09-12T17:15:18.926993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.926612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.452117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.317435+0000","last_change":"2024-09-12T17:15:17.317282+0000","last_active":"2024-09-12T17:15:17.317435+0000","last_peered":"2024-09-12T17:15:17.317435+0000","last_clean":"2024-09-12T17:15:17.317435+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:15:17.317435+0000","last_undegraded":"2024-09-12T17:15:17.317435+0000","last_fullsized":"2024-09-12T17:15:17.317435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.317078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:13.516624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.338988+0000","last_change":"2024-09-12T17:15:18.338825+0000","last_active":"2024-09-12T17:15:18.338988+0000","last_peered":"2024-09-12T17:15:18.338988+0000","last_clean":"2024-09-12T17:15:18.338988+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:15:18.338988+0000","last_undegraded":"2024-09-12T17:15:18.338988+0000","last_fullsized":"2024-09-12T17:15:18.338988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.338612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:11.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.612356+0000","last_change":"2024-09-12T17:15:22.612356+0000","last_active":"2024-09-12T17:15:22.612356+0000","last_peered":"2024-09-12T17:15:22.612356+0000","last_clean":"2024-09-12T17:15:22.612356+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:15:22.612356+0000","last_undegraded":"2024-09-12T17:15:22.612356+0000","last_fullsized":"2024-09-12T17:15:22.612356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.612179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:31.610905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.598211+0000","last_change":"2024-09-12T17:15:07.598077+0000","last_active":"2024-09-12T17:15:07.598211+0000","last_peered":"2024-09-12T17:15:07.598211+0000","last_clean":"2024-09-12T17:15:07.598211+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:15:07.598211+0000","last_undegraded":"2024-09-12T17:15:07.598211+0000","last_fullsized":"2024-09-12T17:15:07.598211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.597893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:32.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.854853+0000","last_change":"2024-09-12T17:15:29.854853+0000","last_active":"2024-09-12T17:15:29.854853+0000","last_peered":"2024-09-12T17:15:29.854853+0000","last_clean":"2024-09-12T17:15:29.854853+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:15:29.854853+0000","last_undegraded":"2024-09-12T17:15:29.854853+0000","last_fullsized":"2024-09-12T17:15:29.854853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.854616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:22.735044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640322,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640322,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673026,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:15:57.761 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.761 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.761 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.761 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.761 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.762 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.762 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.762 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.762 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.763 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.763 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.763 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.763 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.764 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.765 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:11:11.696158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.766 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:11:09.681998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.767 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:15:57.767 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:16:17.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:16:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.898+0000 7f83f44f2640 1 Processor -- start 2024-09-12T17:16:17.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f44f2640 1 -- start start 2024-09-12T17:16:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f44f2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83ec111890 0x7f83ec132450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f44f2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ec073a90 con 0x7f83ec110da0 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f44f2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f83ec0696e0 con 0x7f83ec111890 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f228e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f83ec110da0 0x7f83ec111180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:43260/0 (socket says 172.21.15.62:43260) 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f1a8d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f83ec111890 0x7f83ec132450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f228e640 1 -- 172.21.15.62:0/626670227 learned_addr learned my addr 172.21.15.62:0/626670227 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f1a8d640 1 -- 172.21.15.62:0/626670227 >> v1:172.21.15.62:6789/0 conn(0x7f83ec110da0 legacy=0x7f83ec111180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f1a8d640 1 -- 172.21.15.62:0/626670227 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec06dd50 con 0x7f83ec111890 2024-09-12T17:16:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f128c640 1 -- 172.21.15.62:0/626670227 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891189981 0 0) 0x7f83ec073a90 con 0x7f83ec110da0 2024-09-12T17:16:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f1a8d640 1 --2- 172.21.15.62:0/626670227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec111890 0x7f83ec132450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009d90 tx=0x7f83e801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff11260b81afd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f128c640 1 -- 172.21.15.62:0/626670227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e80b2070 con 0x7f83ec111890 2024-09-12T17:16:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f128c640 1 -- 172.21.15.62:0/626670227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e80a5740 con 0x7f83ec111890 2024-09-12T17:16:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.902+0000 7f83f128c640 1 -- 172.21.15.62:0/626670227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e80a5a40 con 0x7f83ec111890 2024-09-12T17:16:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/626670227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec111890 msgr2=0x7f83ec132450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 --2- 172.21.15.62:0/626670227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec111890 0x7f83ec132450 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009d90 tx=0x7f83e801c8c0 comp rx=0 tx=0).stop 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/626670227 shutdown_connections 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 --2- 172.21.15.62:0/626670227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec111890 0x7f83ec132450 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/626670227 >> 172.21.15.62:0/626670227 conn(0x7f83ec070900 msgr2=0x7f83ec072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/626670227 shutdown_connections 2024-09-12T17:16:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/626670227 wait complete. 2024-09-12T17:16:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 Processor -- start 2024-09-12T17:16:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- start start 2024-09-12T17:16:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec135330 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f228e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f228e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41624/0 (socket says 172.21.15.62:41624) 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f228e640 1 -- 172.21.15.62:0/437861408 learned_addr learned my addr 172.21.15.62:0/437861408 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f228e640 1 -- 172.21.15.62:0/437861408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec1140d0 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f228e640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c3d0 tx=0x7f83e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0007410 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e00075d0 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec12f7b0 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0004960 con 0x7f83ec110da0 2024-09-12T17:16:17.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec12fca0 con 0x7f83ec110da0 2024-09-12T17:16:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec111180 con 0x7f83ec110da0 2024-09-12T17:16:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f83e0011070 con 0x7f83ec110da0 2024-09-12T17:16:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 0x7f83d003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.906+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f83e004f360 con 0x7f83ec110da0 2024-09-12T17:16:17.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.910+0000 7f83f1a8d640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 0x7f83d003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:17.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.910+0000 7f83f1a8d640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 0x7f83d003d6c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f83e80af000 tx=0x7f83e80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:17.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:17.914+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f83e0010d50 con 0x7f83ec110da0 2024-09-12T17:16:18.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.078+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83ec1275f0 con 0x7f83d003b200 2024-09-12T17:16:18.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.106+0000 7f83deffd640 1 -- 172.21.15.62:0/437861408 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666012 (secure 0 0 0) 0x7f83ec1275f0 con 0x7f83d003b200 2024-09-12T17:16:18.117 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:16:18.122 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 msgr2=0x7f83d003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 0x7f83d003d6c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f83e80af000 tx=0x7f83e80a7070 comp rx=0 tx=0).stop 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 msgr2=0x7f83ec1226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c3d0 tx=0x7f83e000c890 comp rx=0 tx=0).stop 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 shutdown_connections 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f83d003b200 0x7f83d003d6c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 --2- 172.21.15.62:0/437861408 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f83ec110da0 0x7f83ec1226b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 >> 172.21.15.62:0/437861408 conn(0x7f83ec070900 msgr2=0x7f83ec129830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 shutdown_connections 2024-09-12T17:16:18.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:18.114+0000 7f83f44f2640 1 -- 172.21.15.62:0/437861408 wait complete. 2024-09-12T17:16:18.133 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-12T17:16:16.824354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5148,"num_read_kb":4734,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165088,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322272,"statfs":{"total":386547056640,"available":386378006528,"internally_reserved":0,"allocated":2981888,"data_stored":1783504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006702"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.201214+0000","last_change":"2024-09-12T17:15:10.201061+0000","last_active":"2024-09-12T17:15:10.201214+0000","last_peered":"2024-09-12T17:15:10.201214+0000","last_clean":"2024-09-12T17:15:10.201214+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:15:10.201214+0000","last_undegraded":"2024-09-12T17:15:10.201214+0000","last_fullsized":"2024-09-12T17:15:10.201214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.200874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:33.595229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.829332+0000","last_change":"2024-09-12T17:15:26.829156+0000","last_active":"2024-09-12T17:15:26.829332+0000","last_peered":"2024-09-12T17:15:26.829332+0000","last_clean":"2024-09-12T17:15:26.829332+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:15:26.829332+0000","last_undegraded":"2024-09-12T17:15:26.829332+0000","last_fullsized":"2024-09-12T17:15:26.829332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.828983+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:58.923967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.622651+0000","last_change":"2024-09-12T17:15:10.622455+0000","last_active":"2024-09-12T17:15:10.622651+0000","last_peered":"2024-09-12T17:15:10.622651+0000","last_clean":"2024-09-12T17:15:10.622651+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:15:10.622651+0000","last_undegraded":"2024-09-12T17:15:10.622651+0000","last_fullsized":"2024-09-12T17:15:10.622651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.622272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:24.192408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.375554+0000","last_change":"2024-09-12T17:15:38.375409+0000","last_active":"2024-09-12T17:15:38.375554+0000","last_peered":"2024-09-12T17:15:38.375554+0000","last_clean":"2024-09-12T17:15:38.375554+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:15:38.375554+0000","last_undegraded":"2024-09-12T17:15:38.375554+0000","last_fullsized":"2024-09-12T17:15:38.375554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.375231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:29.887495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.322131+0000","last_change":"2024-09-12T17:15:24.322131+0000","last_active":"2024-09-12T17:15:24.322131+0000","last_peered":"2024-09-12T17:15:24.322131+0000","last_clean":"2024-09-12T17:15:24.322131+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:15:24.322131+0000","last_undegraded":"2024-09-12T17:15:24.322131+0000","last_fullsized":"2024-09-12T17:15:24.322131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.321949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:20.438915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.435179+0000","last_change":"2024-09-12T17:15:48.435046+0000","last_active":"2024-09-12T17:15:48.435179+0000","last_peered":"2024-09-12T17:15:48.435179+0000","last_clean":"2024-09-12T17:15:48.435179+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:15:48.435179+0000","last_undegraded":"2024-09-12T17:15:48.435179+0000","last_fullsized":"2024-09-12T17:15:48.435179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.434851+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:16.242984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.169692+0000","last_change":"2024-09-12T17:15:09.169692+0000","last_active":"2024-09-12T17:15:09.169692+0000","last_peered":"2024-09-12T17:15:09.169692+0000","last_clean":"2024-09-12T17:15:09.169692+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:15:09.169692+0000","last_undegraded":"2024-09-12T17:15:09.169692+0000","last_fullsized":"2024-09-12T17:15:09.169692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.169513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:40.605000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.167353+0000","last_change":"2024-09-12T17:15:21.167353+0000","last_active":"2024-09-12T17:15:21.167353+0000","last_peered":"2024-09-12T17:15:21.167353+0000","last_clean":"2024-09-12T17:15:21.167353+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:15:21.167353+0000","last_undegraded":"2024-09-12T17:15:21.167353+0000","last_fullsized":"2024-09-12T17:15:21.167353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.167170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:52.575705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.283210+0000","last_change":"2024-09-12T17:15:22.283073+0000","last_active":"2024-09-12T17:15:22.283210+0000","last_peered":"2024-09-12T17:15:22.283210+0000","last_clean":"2024-09-12T17:15:22.283210+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:15:22.283210+0000","last_undegraded":"2024-09-12T17:15:22.283210+0000","last_fullsized":"2024-09-12T17:15:22.283210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.282894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.208753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.854962+0000","last_change":"2024-09-12T17:15:27.854962+0000","last_active":"2024-09-12T17:15:27.854962+0000","last_peered":"2024-09-12T17:15:27.854962+0000","last_clean":"2024-09-12T17:15:27.854962+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:15:27.854962+0000","last_undegraded":"2024-09-12T17:15:27.854962+0000","last_fullsized":"2024-09-12T17:15:27.854962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.854752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:50.593286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.164774+0000","last_change":"2024-09-12T17:15:07.164616+0000","last_active":"2024-09-12T17:15:07.164774+0000","last_peered":"2024-09-12T17:15:07.164774+0000","last_clean":"2024-09-12T17:15:07.164774+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:15:07.164774+0000","last_undegraded":"2024-09-12T17:15:07.164774+0000","last_fullsized":"2024-09-12T17:15:07.164774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.164431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:00.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.381876+0000","last_change":"2024-09-12T17:15:39.381876+0000","last_active":"2024-09-12T17:15:39.381876+0000","last_peered":"2024-09-12T17:15:39.381876+0000","last_clean":"2024-09-12T17:15:39.381876+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:15:39.381876+0000","last_undegraded":"2024-09-12T17:15:39.381876+0000","last_fullsized":"2024-09-12T17:15:39.381876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.381696+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.508456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.293484+0000","last_change":"2024-09-12T17:15:23.293319+0000","last_active":"2024-09-12T17:15:23.293484+0000","last_peered":"2024-09-12T17:15:23.293484+0000","last_clean":"2024-09-12T17:15:23.293484+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:15:23.293484+0000","last_undegraded":"2024-09-12T17:15:23.293484+0000","last_fullsized":"2024-09-12T17:15:23.293484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.293137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:49.114945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.127964+0000","last_change":"2024-09-12T17:15:23.127964+0000","last_active":"2024-09-12T17:15:23.127964+0000","last_peered":"2024-09-12T17:15:23.127964+0000","last_clean":"2024-09-12T17:15:23.127964+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:15:23.127964+0000","last_undegraded":"2024-09-12T17:15:23.127964+0000","last_fullsized":"2024-09-12T17:15:23.127964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.127781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:57.207825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.599502+0000","last_change":"2024-09-12T17:15:09.599330+0000","last_active":"2024-09-12T17:15:09.599502+0000","last_peered":"2024-09-12T17:15:09.599502+0000","last_clean":"2024-09-12T17:15:09.599502+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:15:09.599502+0000","last_undegraded":"2024-09-12T17:15:09.599502+0000","last_fullsized":"2024-09-12T17:15:09.599502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.599149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:05.569735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.044367+0000","last_change":"2024-09-12T17:15:25.044367+0000","last_active":"2024-09-12T17:15:25.044367+0000","last_peered":"2024-09-12T17:15:25.044367+0000","last_clean":"2024-09-12T17:15:25.044367+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:15:25.044367+0000","last_undegraded":"2024-09-12T17:15:25.044367+0000","last_fullsized":"2024-09-12T17:15:25.044367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.044184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.581742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.401201+0000","last_change":"2024-09-12T17:15:37.401065+0000","last_active":"2024-09-12T17:15:37.401201+0000","last_peered":"2024-09-12T17:15:37.401201+0000","last_clean":"2024-09-12T17:15:37.401201+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:15:37.401201+0000","last_undegraded":"2024-09-12T17:15:37.401201+0000","last_fullsized":"2024-09-12T17:15:37.401201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.400885+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:38.552754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.870421+0000","last_change":"2024-09-12T17:15:08.870146+0000","last_active":"2024-09-12T17:15:08.870421+0000","last_peered":"2024-09-12T17:15:08.870421+0000","last_clean":"2024-09-12T17:15:08.870421+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:15:08.870421+0000","last_undegraded":"2024-09-12T17:15:08.870421+0000","last_fullsized":"2024-09-12T17:15:08.870421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.869833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:16.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.845610+0000","last_change":"2024-09-12T17:15:23.845462+0000","last_active":"2024-09-12T17:15:23.845610+0000","last_peered":"2024-09-12T17:15:23.845610+0000","last_clean":"2024-09-12T17:15:23.845610+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:15:23.845610+0000","last_undegraded":"2024-09-12T17:15:23.845610+0000","last_fullsized":"2024-09-12T17:15:23.845610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.845288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.261304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.197797+0000","last_change":"2024-09-12T17:15:08.197517+0000","last_active":"2024-09-12T17:15:08.197797+0000","last_peered":"2024-09-12T17:15:08.197797+0000","last_clean":"2024-09-12T17:15:08.197797+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:15:08.197797+0000","last_undegraded":"2024-09-12T17:15:08.197797+0000","last_fullsized":"2024-09-12T17:15:08.197797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.197226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.048616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.879965+0000","last_change":"2024-09-12T17:15:24.879802+0000","last_active":"2024-09-12T17:15:24.879965+0000","last_peered":"2024-09-12T17:15:24.879965+0000","last_clean":"2024-09-12T17:15:24.879965+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:15:24.879965+0000","last_undegraded":"2024-09-12T17:15:24.879965+0000","last_fullsized":"2024-09-12T17:15:24.879965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.879626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:47.997644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.892682+0000","last_change":"2024-09-12T17:15:07.892541+0000","last_active":"2024-09-12T17:15:07.892682+0000","last_peered":"2024-09-12T17:15:07.892682+0000","last_clean":"2024-09-12T17:15:07.892682+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:15:07.892682+0000","last_undegraded":"2024-09-12T17:15:07.892682+0000","last_fullsized":"2024-09-12T17:15:07.892682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.892360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:31.964096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.648964+0000","last_change":"2024-09-12T17:15:23.648776+0000","last_active":"2024-09-12T17:15:23.648964+0000","last_peered":"2024-09-12T17:15:23.648964+0000","last_clean":"2024-09-12T17:15:23.648964+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:23.648964+0000","last_undegraded":"2024-09-12T17:15:23.648964+0000","last_fullsized":"2024-09-12T17:15:23.648964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.648589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:28.617881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.918542+0000","last_change":"2024-09-12T17:15:06.918374+0000","last_active":"2024-09-12T17:15:06.918542+0000","last_peered":"2024-09-12T17:15:06.918542+0000","last_clean":"2024-09-12T17:15:06.918542+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:15:06.918542+0000","last_undegraded":"2024-09-12T17:15:06.918542+0000","last_fullsized":"2024-09-12T17:15:06.918542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.918133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:39.266087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.164173+0000","last_change":"2024-09-12T17:15:22.163926+0000","last_active":"2024-09-12T17:15:22.164173+0000","last_peered":"2024-09-12T17:15:22.164173+0000","last_clean":"2024-09-12T17:15:22.164173+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:15:22.164173+0000","last_undegraded":"2024-09-12T17:15:22.164173+0000","last_fullsized":"2024-09-12T17:15:22.164173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.163684+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:25.007706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.559377+0000","last_change":"2024-09-12T17:15:08.559195+0000","last_active":"2024-09-12T17:15:08.559377+0000","last_peered":"2024-09-12T17:15:08.559377+0000","last_clean":"2024-09-12T17:15:08.559377+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:15:08.559377+0000","last_undegraded":"2024-09-12T17:15:08.559377+0000","last_fullsized":"2024-09-12T17:15:08.559377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.558975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.680852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.841596+0000","last_change":"2024-09-12T17:15:25.841423+0000","last_active":"2024-09-12T17:15:25.841596+0000","last_peered":"2024-09-12T17:15:25.841596+0000","last_clean":"2024-09-12T17:15:25.841596+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:25.841596+0000","last_undegraded":"2024-09-12T17:15:25.841596+0000","last_fullsized":"2024-09-12T17:15:25.841596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.841247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.853720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.330124+0000","last_change":"2024-09-12T17:15:19.329873+0000","last_active":"2024-09-12T17:15:19.330124+0000","last_peered":"2024-09-12T17:15:19.330124+0000","last_clean":"2024-09-12T17:15:19.330124+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:15:19.330124+0000","last_undegraded":"2024-09-12T17:15:19.330124+0000","last_fullsized":"2024-09-12T17:15:19.330124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.329648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:26.468038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'40","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.831038+0000","last_change":"2024-09-12T17:15:54.830899+0000","last_active":"2024-09-12T17:15:54.831038+0000","last_peered":"2024-09-12T17:15:54.831038+0000","last_clean":"2024-09-12T17:15:54.831038+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:15:54.831038+0000","last_undegraded":"2024-09-12T17:15:54.831038+0000","last_fullsized":"2024-09-12T17:15:54.831038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T17:15:54.830688+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T17:15:54.830688+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.830688+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:37.434094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.310849+0000","last_change":"2024-09-12T17:15:31.310675+0000","last_active":"2024-09-12T17:15:31.310849+0000","last_peered":"2024-09-12T17:15:31.310849+0000","last_clean":"2024-09-12T17:15:31.310849+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:15:31.310849+0000","last_undegraded":"2024-09-12T17:15:31.310849+0000","last_fullsized":"2024-09-12T17:15:31.310849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.310493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:52.984419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.263490+0000","last_change":"2024-09-12T17:15:08.263324+0000","last_active":"2024-09-12T17:15:08.263490+0000","last_peered":"2024-09-12T17:15:08.263490+0000","last_clean":"2024-09-12T17:15:08.263490+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:15:08.263490+0000","last_undegraded":"2024-09-12T17:15:08.263490+0000","last_fullsized":"2024-09-12T17:15:08.263490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.263141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:50.866547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.402456+0000","last_change":"2024-09-12T17:15:47.402317+0000","last_active":"2024-09-12T17:15:47.402456+0000","last_peered":"2024-09-12T17:15:47.402456+0000","last_clean":"2024-09-12T17:15:47.402456+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:15:47.402456+0000","last_undegraded":"2024-09-12T17:15:47.402456+0000","last_fullsized":"2024-09-12T17:15:47.402456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.402138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:47.917779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:57.253327+0000","last_change":"2024-09-12T17:15:57.253178+0000","last_active":"2024-09-12T17:15:57.253327+0000","last_peered":"2024-09-12T17:15:57.253327+0000","last_clean":"2024-09-12T17:15:57.253327+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:15:57.253327+0000","last_undegraded":"2024-09-12T17:15:57.253327+0000","last_fullsized":"2024-09-12T17:15:57.253327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:57.252992+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:57.252992+0000","last_clean_scrub_stamp":"2024-09-12T17:15:57.252992+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:43.291280+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.865973+0000","last_change":"2024-09-12T17:15:49.865702+0000","last_active":"2024-09-12T17:15:49.865973+0000","last_peered":"2024-09-12T17:15:49.865973+0000","last_clean":"2024-09-12T17:15:49.865973+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:15:49.865973+0000","last_undegraded":"2024-09-12T17:15:49.865973+0000","last_fullsized":"2024-09-12T17:15:49.865973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.865463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:43.752559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.856866+0000","last_change":"2024-09-12T17:15:56.856681+0000","last_active":"2024-09-12T17:15:56.856866+0000","last_peered":"2024-09-12T17:15:56.856866+0000","last_clean":"2024-09-12T17:15:56.856866+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:15:56.856866+0000","last_undegraded":"2024-09-12T17:15:56.856866+0000","last_fullsized":"2024-09-12T17:15:56.856866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:56.856509+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:56.856509+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.856509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:59.021075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.328569+0000","last_change":"2024-09-12T17:15:30.328446+0000","last_active":"2024-09-12T17:15:30.328569+0000","last_peered":"2024-09-12T17:15:30.328569+0000","last_clean":"2024-09-12T17:15:30.328569+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:15:30.328569+0000","last_undegraded":"2024-09-12T17:15:30.328569+0000","last_fullsized":"2024-09-12T17:15:30.328569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.328228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.601658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.272407+0000","last_change":"2024-09-12T17:15:01.272260+0000","last_active":"2024-09-12T17:15:01.272407+0000","last_peered":"2024-09-12T17:15:01.272407+0000","last_clean":"2024-09-12T17:15:01.272407+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:15:01.272407+0000","last_undegraded":"2024-09-12T17:15:01.272407+0000","last_fullsized":"2024-09-12T17:15:01.272407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.272070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:11.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.670280+0000","last_change":"2024-09-12T17:15:30.670135+0000","last_active":"2024-09-12T17:15:30.670280+0000","last_peered":"2024-09-12T17:15:30.670280+0000","last_clean":"2024-09-12T17:15:30.670280+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:15:30.670280+0000","last_undegraded":"2024-09-12T17:15:30.670280+0000","last_fullsized":"2024-09-12T17:15:30.670280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.669946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:54.167361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.887726+0000","last_change":"2024-09-12T17:15:41.887582+0000","last_active":"2024-09-12T17:15:41.887726+0000","last_peered":"2024-09-12T17:15:41.887726+0000","last_clean":"2024-09-12T17:15:41.887726+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:15:41.887726+0000","last_undegraded":"2024-09-12T17:15:41.887726+0000","last_fullsized":"2024-09-12T17:15:41.887726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.887381+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:40.760250+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.795751+0000","last_change":"2024-09-12T17:15:46.795609+0000","last_active":"2024-09-12T17:15:46.795751+0000","last_peered":"2024-09-12T17:15:46.795751+0000","last_clean":"2024-09-12T17:15:46.795751+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:15:46.795751+0000","last_undegraded":"2024-09-12T17:15:46.795751+0000","last_fullsized":"2024-09-12T17:15:46.795751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.795426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:26.633699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.519903+0000","last_change":"2024-09-12T17:15:55.519755+0000","last_active":"2024-09-12T17:15:55.519903+0000","last_peered":"2024-09-12T17:15:55.519903+0000","last_clean":"2024-09-12T17:15:55.519903+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:15:55.519903+0000","last_undegraded":"2024-09-12T17:15:55.519903+0000","last_fullsized":"2024-09-12T17:15:55.519903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:55.519568+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:55.519568+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.519568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.598516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.332161+0000","last_change":"2024-09-12T17:15:32.331908+0000","last_active":"2024-09-12T17:15:32.332161+0000","last_peered":"2024-09-12T17:15:32.332161+0000","last_clean":"2024-09-12T17:15:32.332161+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:15:32.332161+0000","last_undegraded":"2024-09-12T17:15:32.332161+0000","last_fullsized":"2024-09-12T17:15:32.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.331702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.106105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.310265+0000","last_change":"2024-09-12T17:15:07.310022+0000","last_active":"2024-09-12T17:15:07.310265+0000","last_peered":"2024-09-12T17:15:07.310265+0000","last_clean":"2024-09-12T17:15:07.310265+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:15:07.310265+0000","last_undegraded":"2024-09-12T17:15:07.310265+0000","last_fullsized":"2024-09-12T17:15:07.310265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.309797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:17.281335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.657020+0000","last_change":"2024-09-12T17:15:31.656874+0000","last_active":"2024-09-12T17:15:31.657020+0000","last_peered":"2024-09-12T17:15:31.657020+0000","last_clean":"2024-09-12T17:15:31.657020+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:15:31.657020+0000","last_undegraded":"2024-09-12T17:15:31.657020+0000","last_fullsized":"2024-09-12T17:15:31.657020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.656700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:53.215267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.996303+0000","last_change":"2024-09-12T17:15:35.996162+0000","last_active":"2024-09-12T17:15:35.996303+0000","last_peered":"2024-09-12T17:15:35.996303+0000","last_clean":"2024-09-12T17:15:35.996303+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:15:35.996303+0000","last_undegraded":"2024-09-12T17:15:35.996303+0000","last_fullsized":"2024-09-12T17:15:35.996303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.995960+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.485115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:07.322693+0000","last_change":"2024-09-12T17:16:07.322693+0000","last_active":"2024-09-12T17:16:07.322693+0000","last_peered":"2024-09-12T17:16:07.322693+0000","last_clean":"2024-09-12T17:16:07.322693+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:16:07.322693+0000","last_undegraded":"2024-09-12T17:16:07.322693+0000","last_fullsized":"2024-09-12T17:16:07.322693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:16:07.322485+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:16:07.322485+0000","last_clean_scrub_stamp":"2024-09-12T17:16:07.322485+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:41.513150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.957435+0000","last_change":"2024-09-12T17:15:48.957435+0000","last_active":"2024-09-12T17:15:48.957435+0000","last_peered":"2024-09-12T17:15:48.957435+0000","last_clean":"2024-09-12T17:15:48.957435+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:15:48.957435+0000","last_undegraded":"2024-09-12T17:15:48.957435+0000","last_fullsized":"2024-09-12T17:15:48.957435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.957213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:34.560093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.646256+0000","last_change":"2024-09-12T17:15:13.646081+0000","last_active":"2024-09-12T17:15:13.646256+0000","last_peered":"2024-09-12T17:15:13.646256+0000","last_clean":"2024-09-12T17:15:13.646256+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:15:13.646256+0000","last_undegraded":"2024-09-12T17:15:13.646256+0000","last_fullsized":"2024-09-12T17:15:13.646256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.645895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.911092+0000","last_change":"2024-09-12T17:14:57.910932+0000","last_active":"2024-09-12T17:14:57.911092+0000","last_peered":"2024-09-12T17:14:57.911092+0000","last_clean":"2024-09-12T17:14:57.911092+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:14:57.911092+0000","last_undegraded":"2024-09-12T17:14:57.911092+0000","last_fullsized":"2024-09-12T17:14:57.911092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.910723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:55.914281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.357958+0000","last_change":"2024-09-12T17:15:46.357811+0000","last_active":"2024-09-12T17:15:46.357958+0000","last_peered":"2024-09-12T17:15:46.357958+0000","last_clean":"2024-09-12T17:15:46.357958+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:15:46.357958+0000","last_undegraded":"2024-09-12T17:15:46.357958+0000","last_fullsized":"2024-09-12T17:15:46.357958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.357635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:16.965443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.978908+0000","last_change":"2024-09-12T17:15:36.978732+0000","last_active":"2024-09-12T17:15:36.978908+0000","last_peered":"2024-09-12T17:15:36.978908+0000","last_clean":"2024-09-12T17:15:36.978908+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.978908+0000","last_undegraded":"2024-09-12T17:15:36.978908+0000","last_fullsized":"2024-09-12T17:15:36.978908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.978491+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:46.317803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.644683+0000","last_change":"2024-09-12T17:15:48.644518+0000","last_active":"2024-09-12T17:15:48.644683+0000","last_peered":"2024-09-12T17:15:48.644683+0000","last_clean":"2024-09-12T17:15:48.644683+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:15:48.644683+0000","last_undegraded":"2024-09-12T17:15:48.644683+0000","last_fullsized":"2024-09-12T17:15:48.644683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.644337+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:12.300130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.270515+0000","last_change":"2024-09-12T17:15:27.270380+0000","last_active":"2024-09-12T17:15:27.270515+0000","last_peered":"2024-09-12T17:15:27.270515+0000","last_clean":"2024-09-12T17:15:27.270515+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:15:27.270515+0000","last_undegraded":"2024-09-12T17:15:27.270515+0000","last_fullsized":"2024-09-12T17:15:27.270515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.270201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.252770+0000","last_change":"2024-09-12T17:15:00.252598+0000","last_active":"2024-09-12T17:15:00.252770+0000","last_peered":"2024-09-12T17:15:00.252770+0000","last_clean":"2024-09-12T17:15:00.252770+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:15:00.252770+0000","last_undegraded":"2024-09-12T17:15:00.252770+0000","last_fullsized":"2024-09-12T17:15:00.252770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.252406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:21.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.845483+0000","last_change":"2024-09-12T17:15:28.845304+0000","last_active":"2024-09-12T17:15:28.845483+0000","last_peered":"2024-09-12T17:15:28.845483+0000","last_clean":"2024-09-12T17:15:28.845483+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:15:28.845483+0000","last_undegraded":"2024-09-12T17:15:28.845483+0000","last_fullsized":"2024-09-12T17:15:28.845483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.845128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:39.718369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.096929+0000","last_change":"2024-09-12T17:15:33.096929+0000","last_active":"2024-09-12T17:15:33.096929+0000","last_peered":"2024-09-12T17:15:33.096929+0000","last_clean":"2024-09-12T17:15:33.096929+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:15:33.096929+0000","last_undegraded":"2024-09-12T17:15:33.096929+0000","last_fullsized":"2024-09-12T17:15:33.096929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.096724+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.936243+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.659187+0000","last_change":"2024-09-12T17:15:46.659187+0000","last_active":"2024-09-12T17:15:46.659187+0000","last_peered":"2024-09-12T17:15:46.659187+0000","last_clean":"2024-09-12T17:15:46.659187+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:15:46.659187+0000","last_undegraded":"2024-09-12T17:15:46.659187+0000","last_fullsized":"2024-09-12T17:15:46.659187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.659004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.104711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.953689+0000","last_change":"2024-09-12T17:15:44.953689+0000","last_active":"2024-09-12T17:15:44.953689+0000","last_peered":"2024-09-12T17:15:44.953689+0000","last_clean":"2024-09-12T17:15:44.953689+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:15:44.953689+0000","last_undegraded":"2024-09-12T17:15:44.953689+0000","last_fullsized":"2024-09-12T17:15:44.953689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.953466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.780448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.886220+0000","last_change":"2024-09-12T17:15:11.886035+0000","last_active":"2024-09-12T17:15:11.886220+0000","last_peered":"2024-09-12T17:15:11.886220+0000","last_clean":"2024-09-12T17:15:11.886220+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:15:11.886220+0000","last_undegraded":"2024-09-12T17:15:11.886220+0000","last_fullsized":"2024-09-12T17:15:11.886220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.885853+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.230761+0000","last_change":"2024-09-12T17:14:58.230528+0000","last_active":"2024-09-12T17:14:58.230761+0000","last_peered":"2024-09-12T17:14:58.230761+0000","last_clean":"2024-09-12T17:14:58.230761+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:58.230761+0000","last_undegraded":"2024-09-12T17:14:58.230761+0000","last_fullsized":"2024-09-12T17:14:58.230761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.230294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:55.690708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.679025+0000","last_change":"2024-09-12T17:15:26.678715+0000","last_active":"2024-09-12T17:15:26.679025+0000","last_peered":"2024-09-12T17:15:26.679025+0000","last_clean":"2024-09-12T17:15:26.679025+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:15:26.679025+0000","last_undegraded":"2024-09-12T17:15:26.679025+0000","last_fullsized":"2024-09-12T17:15:26.679025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.678505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:32.805993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.325569+0000","last_change":"2024-09-12T17:15:55.325569+0000","last_active":"2024-09-12T17:15:55.325569+0000","last_peered":"2024-09-12T17:15:55.325569+0000","last_clean":"2024-09-12T17:15:55.325569+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:15:55.325569+0000","last_undegraded":"2024-09-12T17:15:55.325569+0000","last_fullsized":"2024-09-12T17:15:55.325569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:55.325481+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:55.325481+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.325481+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:28.728223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.632043+0000","last_change":"2024-09-12T17:15:45.632043+0000","last_active":"2024-09-12T17:15:45.632043+0000","last_peered":"2024-09-12T17:15:45.632043+0000","last_clean":"2024-09-12T17:15:45.632043+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:15:45.632043+0000","last_undegraded":"2024-09-12T17:15:45.632043+0000","last_fullsized":"2024-09-12T17:15:45.632043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.631841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:33.615088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.860807+0000","last_change":"2024-09-12T17:15:52.860807+0000","last_active":"2024-09-12T17:15:52.860807+0000","last_peered":"2024-09-12T17:15:52.860807+0000","last_clean":"2024-09-12T17:15:52.860807+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:15:52.860807+0000","last_undegraded":"2024-09-12T17:15:52.860807+0000","last_fullsized":"2024-09-12T17:15:52.860807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.860623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:37.942810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.156810+0000","last_change":"2024-09-12T17:15:12.156505+0000","last_active":"2024-09-12T17:15:12.156810+0000","last_peered":"2024-09-12T17:15:12.156810+0000","last_clean":"2024-09-12T17:15:12.156810+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:15:12.156810+0000","last_undegraded":"2024-09-12T17:15:12.156810+0000","last_fullsized":"2024-09-12T17:15:12.156810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.156239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:25.415656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.347019+0000","last_change":"2024-09-12T17:15:06.346855+0000","last_active":"2024-09-12T17:15:06.347019+0000","last_peered":"2024-09-12T17:15:06.347019+0000","last_clean":"2024-09-12T17:15:06.347019+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:15:06.347019+0000","last_undegraded":"2024-09-12T17:15:06.347019+0000","last_fullsized":"2024-09-12T17:15:06.347019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.346636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:51.428823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.667241+0000","last_change":"2024-09-12T17:15:29.667097+0000","last_active":"2024-09-12T17:15:29.667241+0000","last_peered":"2024-09-12T17:15:29.667241+0000","last_clean":"2024-09-12T17:15:29.667241+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:15:29.667241+0000","last_undegraded":"2024-09-12T17:15:29.667241+0000","last_fullsized":"2024-09-12T17:15:29.667241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.666868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:49.783995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.337208+0000","last_change":"2024-09-12T17:15:53.337208+0000","last_active":"2024-09-12T17:15:53.337208+0000","last_peered":"2024-09-12T17:15:53.337208+0000","last_clean":"2024-09-12T17:15:53.337208+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:15:53.337208+0000","last_undegraded":"2024-09-12T17:15:53.337208+0000","last_fullsized":"2024-09-12T17:15:53.337208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.337017+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:23.840226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.678644+0000","last_change":"2024-09-12T17:15:44.678644+0000","last_active":"2024-09-12T17:15:44.678644+0000","last_peered":"2024-09-12T17:15:44.678644+0000","last_clean":"2024-09-12T17:15:44.678644+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:15:44.678644+0000","last_undegraded":"2024-09-12T17:15:44.678644+0000","last_fullsized":"2024-09-12T17:15:44.678644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.678458+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:12.551543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.559131+0000","last_change":"2024-09-12T17:15:52.559131+0000","last_active":"2024-09-12T17:15:52.559131+0000","last_peered":"2024-09-12T17:15:52.559131+0000","last_clean":"2024-09-12T17:15:52.559131+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:15:52.559131+0000","last_undegraded":"2024-09-12T17:15:52.559131+0000","last_fullsized":"2024-09-12T17:15:52.559131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.558952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:37.731208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.111733+0000","last_change":"2024-09-12T17:15:13.111502+0000","last_active":"2024-09-12T17:15:13.111733+0000","last_peered":"2024-09-12T17:15:13.111733+0000","last_clean":"2024-09-12T17:15:13.111733+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:15:13.111733+0000","last_undegraded":"2024-09-12T17:15:13.111733+0000","last_fullsized":"2024-09-12T17:15:13.111733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.111208+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.802604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.322359+0000","last_change":"2024-09-12T17:15:15.322215+0000","last_active":"2024-09-12T17:15:15.322359+0000","last_peered":"2024-09-12T17:15:15.322359+0000","last_clean":"2024-09-12T17:15:15.322359+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:15:15.322359+0000","last_undegraded":"2024-09-12T17:15:15.322359+0000","last_fullsized":"2024-09-12T17:15:15.322359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.322029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:41.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.655138+0000","last_change":"2024-09-12T17:15:27.654987+0000","last_active":"2024-09-12T17:15:27.655138+0000","last_peered":"2024-09-12T17:15:27.655138+0000","last_clean":"2024-09-12T17:15:27.655138+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:15:27.655138+0000","last_undegraded":"2024-09-12T17:15:27.655138+0000","last_fullsized":"2024-09-12T17:15:27.655138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.654755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:35.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.323386+0000","last_change":"2024-09-12T17:15:54.323386+0000","last_active":"2024-09-12T17:15:54.323386+0000","last_peered":"2024-09-12T17:15:54.323386+0000","last_clean":"2024-09-12T17:15:54.323386+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:15:54.323386+0000","last_undegraded":"2024-09-12T17:15:54.323386+0000","last_fullsized":"2024-09-12T17:15:54.323386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.323183+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:10.081001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.651288+0000","last_change":"2024-09-12T17:15:43.651288+0000","last_active":"2024-09-12T17:15:43.651288+0000","last_peered":"2024-09-12T17:15:43.651288+0000","last_clean":"2024-09-12T17:15:43.651288+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:15:43.651288+0000","last_undegraded":"2024-09-12T17:15:43.651288+0000","last_fullsized":"2024-09-12T17:15:43.651288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.651107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:32.997974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.519537+0000","last_change":"2024-09-12T17:15:53.519537+0000","last_active":"2024-09-12T17:15:53.519537+0000","last_peered":"2024-09-12T17:15:53.519537+0000","last_clean":"2024-09-12T17:15:53.519537+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:15:53.519537+0000","last_undegraded":"2024-09-12T17:15:53.519537+0000","last_fullsized":"2024-09-12T17:15:53.519537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.519363+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:29.687392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.848775+0000","last_change":"2024-09-12T17:15:12.848522+0000","last_active":"2024-09-12T17:15:12.848775+0000","last_peered":"2024-09-12T17:15:12.848775+0000","last_clean":"2024-09-12T17:15:12.848775+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:15:12.848775+0000","last_undegraded":"2024-09-12T17:15:12.848775+0000","last_fullsized":"2024-09-12T17:15:12.848775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.848285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.476233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.570224+0000","last_change":"2024-09-12T17:15:01.570059+0000","last_active":"2024-09-12T17:15:01.570224+0000","last_peered":"2024-09-12T17:15:01.570224+0000","last_clean":"2024-09-12T17:15:01.570224+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:15:01.570224+0000","last_undegraded":"2024-09-12T17:15:01.570224+0000","last_fullsized":"2024-09-12T17:15:01.570224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.569882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:12.460985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.079843+0000","last_change":"2024-09-12T17:15:26.079585+0000","last_active":"2024-09-12T17:15:26.079843+0000","last_peered":"2024-09-12T17:15:26.079843+0000","last_clean":"2024-09-12T17:15:26.079843+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:15:26.079843+0000","last_undegraded":"2024-09-12T17:15:26.079843+0000","last_fullsized":"2024-09-12T17:15:26.079843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.079373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:00.776520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.855018+0000","last_change":"2024-09-12T17:15:39.855018+0000","last_active":"2024-09-12T17:15:39.855018+0000","last_peered":"2024-09-12T17:15:39.855018+0000","last_clean":"2024-09-12T17:15:39.855018+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:15:39.855018+0000","last_undegraded":"2024-09-12T17:15:39.855018+0000","last_fullsized":"2024-09-12T17:15:39.855018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.854818+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.768653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:05.359412+0000","last_change":"2024-09-12T17:16:05.359412+0000","last_active":"2024-09-12T17:16:05.359412+0000","last_peered":"2024-09-12T17:16:05.359412+0000","last_clean":"2024-09-12T17:16:05.359412+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:16:05.359412+0000","last_undegraded":"2024-09-12T17:16:05.359412+0000","last_fullsized":"2024-09-12T17:16:05.359412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:05.359198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:05.359198+0000","last_clean_scrub_stamp":"2024-09-12T17:16:05.359198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:26.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:10.295290+0000","last_change":"2024-09-12T17:16:10.295290+0000","last_active":"2024-09-12T17:16:10.295290+0000","last_peered":"2024-09-12T17:16:10.295290+0000","last_clean":"2024-09-12T17:16:10.295290+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:16:10.295290+0000","last_undegraded":"2024-09-12T17:16:10.295290+0000","last_fullsized":"2024-09-12T17:16:10.295290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:16:10.295068+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:16:10.295068+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.295068+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:10.307246+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.307466+0000","last_change":"2024-09-12T17:15:28.307333+0000","last_active":"2024-09-12T17:15:28.307466+0000","last_peered":"2024-09-12T17:15:28.307466+0000","last_clean":"2024-09-12T17:15:28.307466+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:15:28.307466+0000","last_undegraded":"2024-09-12T17:15:28.307466+0000","last_fullsized":"2024-09-12T17:15:28.307466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.307157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:43.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.407052+0000","last_change":"2024-09-12T17:15:04.406881+0000","last_active":"2024-09-12T17:15:04.407052+0000","last_peered":"2024-09-12T17:15:04.407052+0000","last_clean":"2024-09-12T17:15:04.407052+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:15:04.407052+0000","last_undegraded":"2024-09-12T17:15:04.407052+0000","last_fullsized":"2024-09-12T17:15:04.407052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.406686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:45.243217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.658405+0000","last_change":"2024-09-12T17:15:28.658287+0000","last_active":"2024-09-12T17:15:28.658405+0000","last_peered":"2024-09-12T17:15:28.658405+0000","last_clean":"2024-09-12T17:15:28.658405+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:15:28.658405+0000","last_undegraded":"2024-09-12T17:15:28.658405+0000","last_fullsized":"2024-09-12T17:15:28.658405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.658107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:41.190010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.062564+0000","last_change":"2024-09-12T17:15:34.062414+0000","last_active":"2024-09-12T17:15:34.062564+0000","last_peered":"2024-09-12T17:15:34.062564+0000","last_clean":"2024-09-12T17:15:34.062564+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:15:34.062564+0000","last_undegraded":"2024-09-12T17:15:34.062564+0000","last_fullsized":"2024-09-12T17:15:34.062564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.062221+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.175698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.958125+0000","last_change":"2024-09-12T17:15:39.957861+0000","last_active":"2024-09-12T17:15:39.958125+0000","last_peered":"2024-09-12T17:15:39.958125+0000","last_clean":"2024-09-12T17:15:39.958125+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:15:39.958125+0000","last_undegraded":"2024-09-12T17:15:39.958125+0000","last_fullsized":"2024-09-12T17:15:39.958125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.957627+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:08.558995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'17","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.569132+0000","last_change":"2024-09-12T17:15:51.569132+0000","last_active":"2024-09-12T17:15:51.569132+0000","last_peered":"2024-09-12T17:15:51.569132+0000","last_clean":"2024-09-12T17:15:51.569132+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:15:51.569132+0000","last_undegraded":"2024-09-12T17:15:51.569132+0000","last_fullsized":"2024-09-12T17:15:51.569132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.568910+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:05.866665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.119406+0000","last_change":"2024-09-12T17:15:14.119259+0000","last_active":"2024-09-12T17:15:14.119406+0000","last_peered":"2024-09-12T17:15:14.119406+0000","last_clean":"2024-09-12T17:15:14.119406+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:15:14.119406+0000","last_undegraded":"2024-09-12T17:15:14.119406+0000","last_fullsized":"2024-09-12T17:15:14.119406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.119067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:19.587103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.369479+0000","last_change":"2024-09-12T17:15:05.369239+0000","last_active":"2024-09-12T17:15:05.369479+0000","last_peered":"2024-09-12T17:15:05.369479+0000","last_clean":"2024-09-12T17:15:05.369479+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:15:05.369479+0000","last_undegraded":"2024-09-12T17:15:05.369479+0000","last_fullsized":"2024-09-12T17:15:05.369479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.369026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:56.089945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.846378+0000","last_change":"2024-09-12T17:15:30.846241+0000","last_active":"2024-09-12T17:15:30.846378+0000","last_peered":"2024-09-12T17:15:30.846378+0000","last_clean":"2024-09-12T17:15:30.846378+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:15:30.846378+0000","last_undegraded":"2024-09-12T17:15:30.846378+0000","last_fullsized":"2024-09-12T17:15:30.846378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.846040+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:03.566242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.283310+0000","last_change":"2024-09-12T17:15:56.283310+0000","last_active":"2024-09-12T17:15:56.283310+0000","last_peered":"2024-09-12T17:15:56.283310+0000","last_clean":"2024-09-12T17:15:56.283310+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:15:56.283310+0000","last_undegraded":"2024-09-12T17:15:56.283310+0000","last_fullsized":"2024-09-12T17:15:56.283310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:15:56.283107+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:15:56.283107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.283107+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:42.856402+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.827707+0000","last_change":"2024-09-12T17:15:44.827707+0000","last_active":"2024-09-12T17:15:44.827707+0000","last_peered":"2024-09-12T17:15:44.827707+0000","last_clean":"2024-09-12T17:15:44.827707+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:15:44.827707+0000","last_undegraded":"2024-09-12T17:15:44.827707+0000","last_fullsized":"2024-09-12T17:15:44.827707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.827528+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:09.301008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.985948+0000","last_change":"2024-09-12T17:15:46.985948+0000","last_active":"2024-09-12T17:15:46.985948+0000","last_peered":"2024-09-12T17:15:46.985948+0000","last_clean":"2024-09-12T17:15:46.985948+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:15:46.985948+0000","last_undegraded":"2024-09-12T17:15:46.985948+0000","last_fullsized":"2024-09-12T17:15:46.985948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.985735+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:07.901157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.876539+0000","last_change":"2024-09-12T17:15:13.876344+0000","last_active":"2024-09-12T17:15:13.876539+0000","last_peered":"2024-09-12T17:15:13.876539+0000","last_clean":"2024-09-12T17:15:13.876539+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:15:13.876539+0000","last_undegraded":"2024-09-12T17:15:13.876539+0000","last_fullsized":"2024-09-12T17:15:13.876539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.876174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:45.655514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.392362+0000","last_change":"2024-09-12T17:15:03.392219+0000","last_active":"2024-09-12T17:15:03.392362+0000","last_peered":"2024-09-12T17:15:03.392362+0000","last_clean":"2024-09-12T17:15:03.392362+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:15:03.392362+0000","last_undegraded":"2024-09-12T17:15:03.392362+0000","last_fullsized":"2024-09-12T17:15:03.392362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.392030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:57.279126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.366222+0000","last_change":"2024-09-12T17:15:43.366222+0000","last_active":"2024-09-12T17:15:43.366222+0000","last_peered":"2024-09-12T17:15:43.366222+0000","last_clean":"2024-09-12T17:15:43.366222+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:15:43.366222+0000","last_undegraded":"2024-09-12T17:15:43.366222+0000","last_fullsized":"2024-09-12T17:15:43.366222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.366005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:25.345493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.865578+0000","last_change":"2024-09-12T17:15:38.865438+0000","last_active":"2024-09-12T17:15:38.865578+0000","last_peered":"2024-09-12T17:15:38.865578+0000","last_clean":"2024-09-12T17:15:38.865578+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:15:38.865578+0000","last_undegraded":"2024-09-12T17:15:38.865578+0000","last_fullsized":"2024-09-12T17:15:38.865578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.865244+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:53.633604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.969358+0000","last_change":"2024-09-12T17:15:37.969238+0000","last_active":"2024-09-12T17:15:37.969358+0000","last_peered":"2024-09-12T17:15:37.969358+0000","last_clean":"2024-09-12T17:15:37.969358+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:15:37.969358+0000","last_undegraded":"2024-09-12T17:15:37.969358+0000","last_fullsized":"2024-09-12T17:15:37.969358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.969052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:48.170639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.867058+0000","last_change":"2024-09-12T17:15:48.867058+0000","last_active":"2024-09-12T17:15:48.867058+0000","last_peered":"2024-09-12T17:15:48.867058+0000","last_clean":"2024-09-12T17:15:48.867058+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:15:48.867058+0000","last_undegraded":"2024-09-12T17:15:48.867058+0000","last_fullsized":"2024-09-12T17:15:48.867058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.866885+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:08.256752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.275587+0000","last_change":"2024-09-12T17:15:25.275587+0000","last_active":"2024-09-12T17:15:25.275587+0000","last_peered":"2024-09-12T17:15:25.275587+0000","last_clean":"2024-09-12T17:15:25.275587+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:15:25.275587+0000","last_undegraded":"2024-09-12T17:15:25.275587+0000","last_fullsized":"2024-09-12T17:15:25.275587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.275402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:48.030414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.911446+0000","last_change":"2024-09-12T17:14:55.911446+0000","last_active":"2024-09-12T17:14:55.911446+0000","last_peered":"2024-09-12T17:14:55.911446+0000","last_clean":"2024-09-12T17:14:55.911446+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:14:55.911446+0000","last_undegraded":"2024-09-12T17:14:55.911446+0000","last_fullsized":"2024-09-12T17:14:55.911446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.911203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:43.813828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.344255+0000","last_change":"2024-09-12T17:14:58.344110+0000","last_active":"2024-09-12T17:14:58.344255+0000","last_peered":"2024-09-12T17:14:58.344255+0000","last_clean":"2024-09-12T17:14:58.344255+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:14:58.344255+0000","last_undegraded":"2024-09-12T17:14:58.344255+0000","last_fullsized":"2024-09-12T17:14:58.344255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.343916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:58.763095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.363397+0000","last_change":"2024-09-12T17:15:00.363177+0000","last_active":"2024-09-12T17:15:00.363397+0000","last_peered":"2024-09-12T17:15:00.363397+0000","last_clean":"2024-09-12T17:15:00.363397+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:15:00.363397+0000","last_undegraded":"2024-09-12T17:15:00.363397+0000","last_fullsized":"2024-09-12T17:15:00.363397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.362898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:40.201170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.860319+0000","last_change":"2024-09-12T17:15:33.860319+0000","last_active":"2024-09-12T17:15:33.860319+0000","last_peered":"2024-09-12T17:15:33.860319+0000","last_clean":"2024-09-12T17:15:33.860319+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:15:33.860319+0000","last_undegraded":"2024-09-12T17:15:33.860319+0000","last_fullsized":"2024-09-12T17:15:33.860319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.860118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:13.485835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.298497+0000","last_change":"2024-09-12T17:15:52.298497+0000","last_active":"2024-09-12T17:15:52.298497+0000","last_peered":"2024-09-12T17:15:52.298497+0000","last_clean":"2024-09-12T17:15:52.298497+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:15:52.298497+0000","last_undegraded":"2024-09-12T17:15:52.298497+0000","last_fullsized":"2024-09-12T17:15:52.298497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.298319+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:46.248966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.630425+0000","last_change":"2024-09-12T17:15:42.630425+0000","last_active":"2024-09-12T17:15:42.630425+0000","last_peered":"2024-09-12T17:15:42.630425+0000","last_clean":"2024-09-12T17:15:42.630425+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:15:42.630425+0000","last_undegraded":"2024-09-12T17:15:42.630425+0000","last_fullsized":"2024-09-12T17:15:42.630425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.630245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.028995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.933215+0000","last_change":"2024-09-12T17:15:45.933215+0000","last_active":"2024-09-12T17:15:45.933215+0000","last_peered":"2024-09-12T17:15:45.933215+0000","last_clean":"2024-09-12T17:15:45.933215+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:15:45.933215+0000","last_undegraded":"2024-09-12T17:15:45.933215+0000","last_fullsized":"2024-09-12T17:15:45.933215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.933032+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:31.635022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.251384+0000","last_change":"2024-09-12T17:15:26.251257+0000","last_active":"2024-09-12T17:15:26.251384+0000","last_peered":"2024-09-12T17:15:26.251384+0000","last_clean":"2024-09-12T17:15:26.251384+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:15:26.251384+0000","last_undegraded":"2024-09-12T17:15:26.251384+0000","last_fullsized":"2024-09-12T17:15:26.251384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.251080+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:57.034203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.355017+0000","last_change":"2024-09-12T17:14:56.355017+0000","last_active":"2024-09-12T17:14:56.355017+0000","last_peered":"2024-09-12T17:14:56.355017+0000","last_clean":"2024-09-12T17:14:56.355017+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:14:56.355017+0000","last_undegraded":"2024-09-12T17:14:56.355017+0000","last_fullsized":"2024-09-12T17:14:56.355017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.354829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:11.179727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.554007+0000","last_change":"2024-09-12T17:15:00.553874+0000","last_active":"2024-09-12T17:15:00.554007+0000","last_peered":"2024-09-12T17:15:00.554007+0000","last_clean":"2024-09-12T17:15:00.554007+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:15:00.554007+0000","last_undegraded":"2024-09-12T17:15:00.554007+0000","last_fullsized":"2024-09-12T17:15:00.554007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.553655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:28.442790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.377696+0000","last_change":"2024-09-12T17:15:42.377696+0000","last_active":"2024-09-12T17:15:42.377696+0000","last_peered":"2024-09-12T17:15:42.377696+0000","last_clean":"2024-09-12T17:15:42.377696+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:15:42.377696+0000","last_undegraded":"2024-09-12T17:15:42.377696+0000","last_fullsized":"2024-09-12T17:15:42.377696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.377456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:01.503677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.860338+0000","last_change":"2024-09-12T17:15:37.860338+0000","last_active":"2024-09-12T17:15:37.860338+0000","last_peered":"2024-09-12T17:15:37.860338+0000","last_clean":"2024-09-12T17:15:37.860338+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:15:37.860338+0000","last_undegraded":"2024-09-12T17:15:37.860338+0000","last_fullsized":"2024-09-12T17:15:37.860338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.860130+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.881587+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:03.344384+0000","last_change":"2024-09-12T17:16:03.344384+0000","last_active":"2024-09-12T17:16:03.344384+0000","last_peered":"2024-09-12T17:16:03.344384+0000","last_clean":"2024-09-12T17:16:03.344384+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:16:03.344384+0000","last_undegraded":"2024-09-12T17:16:03.344384+0000","last_fullsized":"2024-09-12T17:16:03.344384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:03.344204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:03.344204+0000","last_clean_scrub_stamp":"2024-09-12T17:16:03.344204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:33.204789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.915714+0000","last_change":"2024-09-12T17:15:50.915714+0000","last_active":"2024-09-12T17:15:50.915714+0000","last_peered":"2024-09-12T17:15:50.915714+0000","last_clean":"2024-09-12T17:15:50.915714+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:15:50.915714+0000","last_undegraded":"2024-09-12T17:15:50.915714+0000","last_fullsized":"2024-09-12T17:15:50.915714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.915527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.752058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'26","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.649839+0000","last_change":"2024-09-12T17:15:14.649699+0000","last_active":"2024-09-12T17:15:14.649839+0000","last_peered":"2024-09-12T17:15:14.649839+0000","last_clean":"2024-09-12T17:15:14.649839+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:15:14.649839+0000","last_undegraded":"2024-09-12T17:15:14.649839+0000","last_fullsized":"2024-09-12T17:15:14.649839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.649518+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:27.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.253023+0000","last_change":"2024-09-12T17:14:56.252899+0000","last_active":"2024-09-12T17:14:56.253023+0000","last_peered":"2024-09-12T17:14:56.253023+0000","last_clean":"2024-09-12T17:14:56.253023+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:14:56.253023+0000","last_undegraded":"2024-09-12T17:14:56.253023+0000","last_fullsized":"2024-09-12T17:14:56.253023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.252710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:23.672480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.622944+0000","last_change":"2024-09-12T17:14:57.622760+0000","last_active":"2024-09-12T17:14:57.622944+0000","last_peered":"2024-09-12T17:14:57.622944+0000","last_clean":"2024-09-12T17:14:57.622944+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:14:57.622944+0000","last_undegraded":"2024-09-12T17:14:57.622944+0000","last_fullsized":"2024-09-12T17:14:57.622944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.622572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.441681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.094456+0000","last_change":"2024-09-12T17:15:24.094317+0000","last_active":"2024-09-12T17:15:24.094456+0000","last_peered":"2024-09-12T17:15:24.094456+0000","last_clean":"2024-09-12T17:15:24.094456+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:15:24.094456+0000","last_undegraded":"2024-09-12T17:15:24.094456+0000","last_fullsized":"2024-09-12T17:15:24.094456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.094126+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:04.533467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.032736+0000","last_change":"2024-09-12T17:15:31.032736+0000","last_active":"2024-09-12T17:15:31.032736+0000","last_peered":"2024-09-12T17:15:31.032736+0000","last_clean":"2024-09-12T17:15:31.032736+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:15:31.032736+0000","last_undegraded":"2024-09-12T17:15:31.032736+0000","last_fullsized":"2024-09-12T17:15:31.032736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.032542+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.819963+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.591841+0000","last_change":"2024-09-12T17:15:41.591841+0000","last_active":"2024-09-12T17:15:41.591841+0000","last_peered":"2024-09-12T17:15:41.591841+0000","last_clean":"2024-09-12T17:15:41.591841+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:15:41.591841+0000","last_undegraded":"2024-09-12T17:15:41.591841+0000","last_fullsized":"2024-09-12T17:15:41.591841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.591665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.603528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:11.264827+0000","last_change":"2024-09-12T17:16:11.264827+0000","last_active":"2024-09-12T17:16:11.264827+0000","last_peered":"2024-09-12T17:16:11.264827+0000","last_clean":"2024-09-12T17:16:11.264827+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:16:11.264827+0000","last_undegraded":"2024-09-12T17:16:11.264827+0000","last_fullsized":"2024-09-12T17:16:11.264827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:11.264625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:11.264625+0000","last_clean_scrub_stamp":"2024-09-12T17:16:11.264625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:39.829588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.619454+0000","last_change":"2024-09-12T17:15:12.619313+0000","last_active":"2024-09-12T17:15:12.619454+0000","last_peered":"2024-09-12T17:15:12.619454+0000","last_clean":"2024-09-12T17:15:12.619454+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:15:12.619454+0000","last_undegraded":"2024-09-12T17:15:12.619454+0000","last_fullsized":"2024-09-12T17:15:12.619454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.619133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.401095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.349942+0000","last_change":"2024-09-12T17:14:57.349792+0000","last_active":"2024-09-12T17:14:57.349942+0000","last_peered":"2024-09-12T17:14:57.349942+0000","last_clean":"2024-09-12T17:14:57.349942+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:14:57.349942+0000","last_undegraded":"2024-09-12T17:14:57.349942+0000","last_fullsized":"2024-09-12T17:14:57.349942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.349607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:49.102885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.265774+0000","last_change":"2024-09-12T17:14:57.265630+0000","last_active":"2024-09-12T17:14:57.265774+0000","last_peered":"2024-09-12T17:14:57.265774+0000","last_clean":"2024-09-12T17:14:57.265774+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:14:57.265774+0000","last_undegraded":"2024-09-12T17:14:57.265774+0000","last_fullsized":"2024-09-12T17:14:57.265774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.265430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:07.327769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.650742+0000","last_change":"2024-09-12T17:15:25.650742+0000","last_active":"2024-09-12T17:15:25.650742+0000","last_peered":"2024-09-12T17:15:25.650742+0000","last_clean":"2024-09-12T17:15:25.650742+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:15:25.650742+0000","last_undegraded":"2024-09-12T17:15:25.650742+0000","last_fullsized":"2024-09-12T17:15:25.650742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.650567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:13.066845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.346298+0000","last_change":"2024-09-12T17:15:51.346298+0000","last_active":"2024-09-12T17:15:51.346298+0000","last_peered":"2024-09-12T17:15:51.346298+0000","last_clean":"2024-09-12T17:15:51.346298+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:15:51.346298+0000","last_undegraded":"2024-09-12T17:15:51.346298+0000","last_fullsized":"2024-09-12T17:15:51.346298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.346098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:33.524411+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:04.315468+0000","last_change":"2024-09-12T17:16:04.315468+0000","last_active":"2024-09-12T17:16:04.315468+0000","last_peered":"2024-09-12T17:16:04.315468+0000","last_clean":"2024-09-12T17:16:04.315468+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:16:04.315468+0000","last_undegraded":"2024-09-12T17:16:04.315468+0000","last_fullsized":"2024-09-12T17:16:04.315468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:04.315259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:04.315259+0000","last_clean_scrub_stamp":"2024-09-12T17:16:04.315259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:51.370363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.870101+0000","last_change":"2024-09-12T17:15:51.870101+0000","last_active":"2024-09-12T17:15:51.870101+0000","last_peered":"2024-09-12T17:15:51.870101+0000","last_clean":"2024-09-12T17:15:51.870101+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:15:51.870101+0000","last_undegraded":"2024-09-12T17:15:51.870101+0000","last_fullsized":"2024-09-12T17:15:51.870101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.869905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.607819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.824007+0000","last_change":"2024-09-12T17:15:09.823868+0000","last_active":"2024-09-12T17:15:09.824007+0000","last_peered":"2024-09-12T17:15:09.824007+0000","last_clean":"2024-09-12T17:15:09.824007+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:15:09.824007+0000","last_undegraded":"2024-09-12T17:15:09.824007+0000","last_fullsized":"2024-09-12T17:15:09.824007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.823660+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.276097+0000","last_change":"2024-09-12T17:14:59.275856+0000","last_active":"2024-09-12T17:14:59.276097+0000","last_peered":"2024-09-12T17:14:59.276097+0000","last_clean":"2024-09-12T17:14:59.276097+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:59.276097+0000","last_undegraded":"2024-09-12T17:14:59.276097+0000","last_fullsized":"2024-09-12T17:14:59.276097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.275635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:08.199637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.609810+0000","last_change":"2024-09-12T17:14:55.609658+0000","last_active":"2024-09-12T17:14:55.609810+0000","last_peered":"2024-09-12T17:14:55.609810+0000","last_clean":"2024-09-12T17:14:55.609810+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:14:55.609810+0000","last_undegraded":"2024-09-12T17:14:55.609810+0000","last_fullsized":"2024-09-12T17:14:55.609810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.609474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:43.527501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.687586+0000","last_change":"2024-09-12T17:15:24.687586+0000","last_active":"2024-09-12T17:15:24.687586+0000","last_peered":"2024-09-12T17:15:24.687586+0000","last_clean":"2024-09-12T17:15:24.687586+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:15:24.687586+0000","last_undegraded":"2024-09-12T17:15:24.687586+0000","last_fullsized":"2024-09-12T17:15:24.687586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.687400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:45.771402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.685630+0000","last_change":"2024-09-12T17:15:32.685630+0000","last_active":"2024-09-12T17:15:32.685630+0000","last_peered":"2024-09-12T17:15:32.685630+0000","last_clean":"2024-09-12T17:15:32.685630+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:15:32.685630+0000","last_undegraded":"2024-09-12T17:15:32.685630+0000","last_fullsized":"2024-09-12T17:15:32.685630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.685518+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.484233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.953964+0000","last_change":"2024-09-12T17:15:38.953964+0000","last_active":"2024-09-12T17:15:38.953964+0000","last_peered":"2024-09-12T17:15:38.953964+0000","last_clean":"2024-09-12T17:15:38.953964+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:15:38.953964+0000","last_undegraded":"2024-09-12T17:15:38.953964+0000","last_fullsized":"2024-09-12T17:15:38.953964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.953775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:36.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.507245+0000","last_change":"2024-09-12T17:15:54.507245+0000","last_active":"2024-09-12T17:15:54.507245+0000","last_peered":"2024-09-12T17:15:54.507245+0000","last_clean":"2024-09-12T17:15:54.507245+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:15:54.507245+0000","last_undegraded":"2024-09-12T17:15:54.507245+0000","last_fullsized":"2024-09-12T17:15:54.507245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-12T17:15:54.507061+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-12T17:15:54.507061+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.507061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:10.549246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.842566+0000","last_change":"2024-09-12T17:15:10.842397+0000","last_active":"2024-09-12T17:15:10.842566+0000","last_peered":"2024-09-12T17:15:10.842566+0000","last_clean":"2024-09-12T17:15:10.842566+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:15:10.842566+0000","last_undegraded":"2024-09-12T17:15:10.842566+0000","last_fullsized":"2024-09-12T17:15:10.842566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.842219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:45.585105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.546848+0000","last_change":"2024-09-12T17:14:59.546720+0000","last_active":"2024-09-12T17:14:59.546848+0000","last_peered":"2024-09-12T17:14:59.546848+0000","last_clean":"2024-09-12T17:14:59.546848+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:14:59.546848+0000","last_undegraded":"2024-09-12T17:14:59.546848+0000","last_fullsized":"2024-09-12T17:14:59.546848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.546539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:06.551999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.384965+0000","last_change":"2024-09-12T17:15:02.384841+0000","last_active":"2024-09-12T17:15:02.384965+0000","last_peered":"2024-09-12T17:15:02.384965+0000","last_clean":"2024-09-12T17:15:02.384965+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:15:02.384965+0000","last_undegraded":"2024-09-12T17:15:02.384965+0000","last_fullsized":"2024-09-12T17:15:02.384965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.384664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:21.774531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.385448+0000","last_change":"2024-09-12T17:15:49.385448+0000","last_active":"2024-09-12T17:15:49.385448+0000","last_peered":"2024-09-12T17:15:49.385448+0000","last_clean":"2024-09-12T17:15:49.385448+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:15:49.385448+0000","last_undegraded":"2024-09-12T17:15:49.385448+0000","last_fullsized":"2024-09-12T17:15:49.385448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.385273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:07.869553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.883962+0000","last_change":"2024-09-12T17:15:40.883962+0000","last_active":"2024-09-12T17:15:40.883962+0000","last_peered":"2024-09-12T17:15:40.883962+0000","last_clean":"2024-09-12T17:15:40.883962+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:15:40.883962+0000","last_undegraded":"2024-09-12T17:15:40.883962+0000","last_fullsized":"2024-09-12T17:15:40.883962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.883767+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:44.835444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.855770+0000","last_change":"2024-09-12T17:15:43.855770+0000","last_active":"2024-09-12T17:15:43.855770+0000","last_peered":"2024-09-12T17:15:43.855770+0000","last_clean":"2024-09-12T17:15:43.855770+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:15:43.855770+0000","last_undegraded":"2024-09-12T17:15:43.855770+0000","last_fullsized":"2024-09-12T17:15:43.855770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.855585+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.436369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:29.796779+0000","last_change":"2024-09-12T17:11:14.773159+0000","last_active":"2024-09-12T17:13:29.796779+0000","last_peered":"2024-09-12T17:13:29.796779+0000","last_clean":"2024-09-12T17:13:29.796779+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:13:29.796779+0000","last_undegraded":"2024-09-12T17:13:29.796779+0000","last_fullsized":"2024-09-12T17:13:29.796779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.324685+0000","last_change":"2024-09-12T17:15:21.324685+0000","last_active":"2024-09-12T17:15:21.324685+0000","last_peered":"2024-09-12T17:15:21.324685+0000","last_clean":"2024-09-12T17:15:21.324685+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:15:21.324685+0000","last_undegraded":"2024-09-12T17:15:21.324685+0000","last_fullsized":"2024-09-12T17:15:21.324685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.324508+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:04.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.370073+0000","last_change":"2024-09-12T17:15:01.369815+0000","last_active":"2024-09-12T17:15:01.370073+0000","last_peered":"2024-09-12T17:15:01.370073+0000","last_clean":"2024-09-12T17:15:01.370073+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:15:01.370073+0000","last_undegraded":"2024-09-12T17:15:01.370073+0000","last_fullsized":"2024-09-12T17:15:01.370073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.369538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.619390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.592043+0000","last_change":"2024-09-12T17:14:56.591887+0000","last_active":"2024-09-12T17:14:56.592043+0000","last_peered":"2024-09-12T17:14:56.592043+0000","last_clean":"2024-09-12T17:14:56.592043+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:14:56.592043+0000","last_undegraded":"2024-09-12T17:14:56.592043+0000","last_fullsized":"2024-09-12T17:14:56.592043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.591696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:05.758061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.424706+0000","last_change":"2024-09-12T17:15:41.424706+0000","last_active":"2024-09-12T17:15:41.424706+0000","last_peered":"2024-09-12T17:15:41.424706+0000","last_clean":"2024-09-12T17:15:41.424706+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:15:41.424706+0000","last_undegraded":"2024-09-12T17:15:41.424706+0000","last_fullsized":"2024-09-12T17:15:41.424706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.424524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.841300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.366997+0000","last_change":"2024-09-12T17:15:50.366997+0000","last_active":"2024-09-12T17:15:50.366997+0000","last_peered":"2024-09-12T17:15:50.366997+0000","last_clean":"2024-09-12T17:15:50.366997+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:15:50.366997+0000","last_undegraded":"2024-09-12T17:15:50.366997+0000","last_fullsized":"2024-09-12T17:15:50.366997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.366844+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:11.340218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.659082+0000","last_change":"2024-09-12T17:15:39.659082+0000","last_active":"2024-09-12T17:15:39.659082+0000","last_peered":"2024-09-12T17:15:39.659082+0000","last_clean":"2024-09-12T17:15:39.659082+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:15:39.659082+0000","last_undegraded":"2024-09-12T17:15:39.659082+0000","last_fullsized":"2024-09-12T17:15:39.659082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.658876+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:39.698721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.849478+0000","last_change":"2024-09-12T17:15:55.849478+0000","last_active":"2024-09-12T17:15:55.849478+0000","last_peered":"2024-09-12T17:15:55.849478+0000","last_clean":"2024-09-12T17:15:55.849478+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:15:55.849478+0000","last_undegraded":"2024-09-12T17:15:55.849478+0000","last_fullsized":"2024-09-12T17:15:55.849478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-12T17:15:55.849295+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-12T17:15:55.849295+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.849295+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.260603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.153122+0000","last_change":"2024-09-12T17:15:11.152858+0000","last_active":"2024-09-12T17:15:11.153122+0000","last_peered":"2024-09-12T17:15:11.153122+0000","last_clean":"2024-09-12T17:15:11.153122+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:15:11.153122+0000","last_undegraded":"2024-09-12T17:15:11.153122+0000","last_fullsized":"2024-09-12T17:15:11.153122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.152634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:17.511951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.954866+0000","last_change":"2024-09-12T17:14:56.954698+0000","last_active":"2024-09-12T17:14:56.954866+0000","last_peered":"2024-09-12T17:14:56.954866+0000","last_clean":"2024-09-12T17:14:56.954866+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:56.954866+0000","last_undegraded":"2024-09-12T17:14:56.954866+0000","last_fullsized":"2024-09-12T17:14:56.954866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.954518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:01.720351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.386536+0000","last_change":"2024-09-12T17:14:59.386412+0000","last_active":"2024-09-12T17:14:59.386536+0000","last_peered":"2024-09-12T17:14:59.386536+0000","last_clean":"2024-09-12T17:14:59.386536+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:14:59.386536+0000","last_undegraded":"2024-09-12T17:14:59.386536+0000","last_fullsized":"2024-09-12T17:14:59.386536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.386232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:09.105379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.432260+0000","last_change":"2024-09-12T17:15:40.432260+0000","last_active":"2024-09-12T17:15:40.432260+0000","last_peered":"2024-09-12T17:15:40.432260+0000","last_clean":"2024-09-12T17:15:40.432260+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:15:40.432260+0000","last_undegraded":"2024-09-12T17:15:40.432260+0000","last_fullsized":"2024-09-12T17:15:40.432260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.432083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:25.686692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'101","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.074417+0000","last_change":"2024-09-12T17:15:32.074417+0000","last_active":"2024-09-12T17:15:32.074417+0000","last_peered":"2024-09-12T17:15:32.074417+0000","last_clean":"2024-09-12T17:15:32.074417+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:15:32.074417+0000","last_undegraded":"2024-09-12T17:15:32.074417+0000","last_fullsized":"2024-09-12T17:15:32.074417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'101","last_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_deep_scrub":"34'101","last_deep_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.074146+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.161569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.634033+0000","last_change":"2024-09-12T17:15:40.634033+0000","last_active":"2024-09-12T17:15:40.634033+0000","last_peered":"2024-09-12T17:15:40.634033+0000","last_clean":"2024-09-12T17:15:40.634033+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:15:40.634033+0000","last_undegraded":"2024-09-12T17:15:40.634033+0000","last_fullsized":"2024-09-12T17:15:40.634033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.633855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:24.161604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.006178+0000","last_change":"2024-09-12T17:15:48.006178+0000","last_active":"2024-09-12T17:15:48.006178+0000","last_peered":"2024-09-12T17:15:48.006178+0000","last_clean":"2024-09-12T17:15:48.006178+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:15:48.006178+0000","last_undegraded":"2024-09-12T17:15:48.006178+0000","last_fullsized":"2024-09-12T17:15:48.006178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.006000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:11.503416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.921995+0000","last_change":"2024-09-12T17:15:49.921995+0000","last_active":"2024-09-12T17:15:49.921995+0000","last_peered":"2024-09-12T17:15:49.921995+0000","last_clean":"2024-09-12T17:15:49.921995+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:15:49.921995+0000","last_undegraded":"2024-09-12T17:15:49.921995+0000","last_fullsized":"2024-09-12T17:15:49.921995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.921812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:20.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.152040+0000","last_change":"2024-09-12T17:15:15.151829+0000","last_active":"2024-09-12T17:15:15.152040+0000","last_peered":"2024-09-12T17:15:15.152040+0000","last_clean":"2024-09-12T17:15:15.152040+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:15:15.152040+0000","last_undegraded":"2024-09-12T17:15:15.152040+0000","last_fullsized":"2024-09-12T17:15:15.152040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.151618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:24.317983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.299393+0000","last_change":"2024-09-12T17:15:12.299261+0000","last_active":"2024-09-12T17:15:12.299393+0000","last_peered":"2024-09-12T17:15:12.299393+0000","last_clean":"2024-09-12T17:15:12.299393+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:15:12.299393+0000","last_undegraded":"2024-09-12T17:15:12.299393+0000","last_fullsized":"2024-09-12T17:15:12.299393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.299076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:16.946359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.890725+0000","last_change":"2024-09-12T17:15:31.890554+0000","last_active":"2024-09-12T17:15:31.890725+0000","last_peered":"2024-09-12T17:15:31.890725+0000","last_clean":"2024-09-12T17:15:31.890725+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:15:31.890725+0000","last_undegraded":"2024-09-12T17:15:31.890725+0000","last_fullsized":"2024-09-12T17:15:31.890725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.890371+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:17.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:58.233153+0000","last_change":"2024-09-12T17:15:58.233153+0000","last_active":"2024-09-12T17:15:58.233153+0000","last_peered":"2024-09-12T17:15:58.233153+0000","last_clean":"2024-09-12T17:15:58.233153+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:15:58.233153+0000","last_undegraded":"2024-09-12T17:15:58.233153+0000","last_fullsized":"2024-09-12T17:15:58.233153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T17:15:58.232921+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T17:15:58.232921+0000","last_clean_scrub_stamp":"2024-09-12T17:15:58.232921+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:21.161495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:06.356165+0000","last_change":"2024-09-12T17:16:06.356165+0000","last_active":"2024-09-12T17:16:06.356165+0000","last_peered":"2024-09-12T17:16:06.356165+0000","last_clean":"2024-09-12T17:16:06.356165+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:16:06.356165+0000","last_undegraded":"2024-09-12T17:16:06.356165+0000","last_fullsized":"2024-09-12T17:16:06.356165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:06.355872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:06.355872+0000","last_clean_scrub_stamp":"2024-09-12T17:16:06.355872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:00.995836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:58.546810+0000","last_change":"2024-09-12T17:15:58.546810+0000","last_active":"2024-09-12T17:15:58.546810+0000","last_peered":"2024-09-12T17:15:58.546810+0000","last_clean":"2024-09-12T17:15:58.546810+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:15:58.546810+0000","last_undegraded":"2024-09-12T17:15:58.546810+0000","last_fullsized":"2024-09-12T17:15:58.546810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:58.546621+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:58.546621+0000","last_clean_scrub_stamp":"2024-09-12T17:15:58.546621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:25.952637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.850424+0000","last_change":"2024-09-12T17:15:14.850267+0000","last_active":"2024-09-12T17:15:14.850424+0000","last_peered":"2024-09-12T17:15:14.850424+0000","last_clean":"2024-09-12T17:15:14.850424+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:15:14.850424+0000","last_undegraded":"2024-09-12T17:15:14.850424+0000","last_fullsized":"2024-09-12T17:15:14.850424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.850076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:10.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.314335+0000","last_change":"2024-09-12T17:15:02.314071+0000","last_active":"2024-09-12T17:15:02.314335+0000","last_peered":"2024-09-12T17:15:02.314335+0000","last_clean":"2024-09-12T17:15:02.314335+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:15:02.314335+0000","last_undegraded":"2024-09-12T17:15:02.314335+0000","last_fullsized":"2024-09-12T17:15:02.314335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.313786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:05.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.369588+0000","last_change":"2024-09-12T17:15:45.369445+0000","last_active":"2024-09-12T17:15:45.369588+0000","last_peered":"2024-09-12T17:15:45.369588+0000","last_clean":"2024-09-12T17:15:45.369588+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:15:45.369588+0000","last_undegraded":"2024-09-12T17:15:45.369588+0000","last_fullsized":"2024-09-12T17:15:45.369588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.369237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.442814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.650928+0000","last_change":"2024-09-12T17:15:34.650775+0000","last_active":"2024-09-12T17:15:34.650928+0000","last_peered":"2024-09-12T17:15:34.650928+0000","last_clean":"2024-09-12T17:15:34.650928+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:15:34.650928+0000","last_undegraded":"2024-09-12T17:15:34.650928+0000","last_fullsized":"2024-09-12T17:15:34.650928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.650585+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:36.625397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.955970+0000","last_change":"2024-09-12T17:15:42.955676+0000","last_active":"2024-09-12T17:15:42.955970+0000","last_peered":"2024-09-12T17:15:42.955970+0000","last_clean":"2024-09-12T17:15:42.955970+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:15:42.955970+0000","last_undegraded":"2024-09-12T17:15:42.955970+0000","last_fullsized":"2024-09-12T17:15:42.955970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.955456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:31.849550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.556951+0000","last_change":"2024-09-12T17:15:56.556816+0000","last_active":"2024-09-12T17:15:56.556951+0000","last_peered":"2024-09-12T17:15:56.556951+0000","last_clean":"2024-09-12T17:15:56.556951+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:15:56.556951+0000","last_undegraded":"2024-09-12T17:15:56.556951+0000","last_fullsized":"2024-09-12T17:15:56.556951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:56.556639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:56.556639+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.556639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:52.034317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.591015+0000","last_change":"2024-09-12T17:15:11.590855+0000","last_active":"2024-09-12T17:15:11.591015+0000","last_peered":"2024-09-12T17:15:11.591015+0000","last_clean":"2024-09-12T17:15:11.591015+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:15:11.591015+0000","last_undegraded":"2024-09-12T17:15:11.591015+0000","last_fullsized":"2024-09-12T17:15:11.591015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.590645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:52.146542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.289982+0000","last_change":"2024-09-12T17:15:03.289858+0000","last_active":"2024-09-12T17:15:03.289982+0000","last_peered":"2024-09-12T17:15:03.289982+0000","last_clean":"2024-09-12T17:15:03.289982+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:15:03.289982+0000","last_undegraded":"2024-09-12T17:15:03.289982+0000","last_fullsized":"2024-09-12T17:15:03.289982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.289669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.942393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.086863+0000","last_change":"2024-09-12T17:15:27.086675+0000","last_active":"2024-09-12T17:15:27.086863+0000","last_peered":"2024-09-12T17:15:27.086863+0000","last_clean":"2024-09-12T17:15:27.086863+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:15:27.086863+0000","last_undegraded":"2024-09-12T17:15:27.086863+0000","last_fullsized":"2024-09-12T17:15:27.086863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.086490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:57.656954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.673143+0000","last_change":"2024-09-12T17:15:35.672973+0000","last_active":"2024-09-12T17:15:35.673143+0000","last_peered":"2024-09-12T17:15:35.673143+0000","last_clean":"2024-09-12T17:15:35.673143+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:15:35.673143+0000","last_undegraded":"2024-09-12T17:15:35.673143+0000","last_fullsized":"2024-09-12T17:15:35.673143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.672790+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:49.446223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.784101+0000","last_change":"2024-09-12T17:15:45.783931+0000","last_active":"2024-09-12T17:15:45.784101+0000","last_peered":"2024-09-12T17:15:45.784101+0000","last_clean":"2024-09-12T17:15:45.784101+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:15:45.784101+0000","last_undegraded":"2024-09-12T17:15:45.784101+0000","last_fullsized":"2024-09-12T17:15:45.784101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.783750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:55.502897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:44.801345+0000","last_change":"2024-09-12T17:11:14.779108+0000","last_active":"2024-09-12T17:13:44.801345+0000","last_peered":"2024-09-12T17:13:44.801345+0000","last_clean":"2024-09-12T17:13:44.801345+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:13:44.801345+0000","last_undegraded":"2024-09-12T17:13:44.801345+0000","last_fullsized":"2024-09-12T17:13:44.801345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.353435+0000","last_change":"2024-09-12T17:15:29.353247+0000","last_active":"2024-09-12T17:15:29.353435+0000","last_peered":"2024-09-12T17:15:29.353435+0000","last_clean":"2024-09-12T17:15:29.353435+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:15:29.353435+0000","last_undegraded":"2024-09-12T17:15:29.353435+0000","last_fullsized":"2024-09-12T17:15:29.353435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.353071+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:11.062516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.890737+0000","last_change":"2024-09-12T17:14:58.890548+0000","last_active":"2024-09-12T17:14:58.890737+0000","last_peered":"2024-09-12T17:14:58.890737+0000","last_clean":"2024-09-12T17:14:58.890737+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:14:58.890737+0000","last_undegraded":"2024-09-12T17:14:58.890737+0000","last_fullsized":"2024-09-12T17:14:58.890737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.890365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:09.596280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.349063+0000","last_change":"2024-09-12T17:15:44.348933+0000","last_active":"2024-09-12T17:15:44.349063+0000","last_peered":"2024-09-12T17:15:44.349063+0000","last_clean":"2024-09-12T17:15:44.349063+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:15:44.349063+0000","last_undegraded":"2024-09-12T17:15:44.349063+0000","last_fullsized":"2024-09-12T17:15:44.349063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.348761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:50.958089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.032930+0000","last_change":"2024-09-12T17:15:35.032692+0000","last_active":"2024-09-12T17:15:35.032930+0000","last_peered":"2024-09-12T17:15:35.032930+0000","last_clean":"2024-09-12T17:15:35.032930+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:15:35.032930+0000","last_undegraded":"2024-09-12T17:15:35.032930+0000","last_fullsized":"2024-09-12T17:15:35.032930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.032454+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:53.441585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.949640+0000","last_change":"2024-09-12T17:15:41.949494+0000","last_active":"2024-09-12T17:15:41.949640+0000","last_peered":"2024-09-12T17:15:41.949640+0000","last_clean":"2024-09-12T17:15:41.949640+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:15:41.949640+0000","last_undegraded":"2024-09-12T17:15:41.949640+0000","last_fullsized":"2024-09-12T17:15:41.949640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.949314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:03.033316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.390800+0000","last_change":"2024-09-12T17:15:36.390800+0000","last_active":"2024-09-12T17:15:36.390800+0000","last_peered":"2024-09-12T17:15:36.390800+0000","last_clean":"2024-09-12T17:15:36.390800+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:15:36.390800+0000","last_undegraded":"2024-09-12T17:15:36.390800+0000","last_fullsized":"2024-09-12T17:15:36.390800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.390596+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:49.608907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.279391+0000","last_change":"2024-09-12T17:15:09.279239+0000","last_active":"2024-09-12T17:15:09.279391+0000","last_peered":"2024-09-12T17:15:09.279391+0000","last_clean":"2024-09-12T17:15:09.279391+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:15:09.279391+0000","last_undegraded":"2024-09-12T17:15:09.279391+0000","last_fullsized":"2024-09-12T17:15:09.279391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.279045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:06.707329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.686351+0000","last_change":"2024-09-12T17:15:33.686351+0000","last_active":"2024-09-12T17:15:33.686351+0000","last_peered":"2024-09-12T17:15:33.686351+0000","last_clean":"2024-09-12T17:15:33.686351+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:15:33.686351+0000","last_undegraded":"2024-09-12T17:15:33.686351+0000","last_fullsized":"2024-09-12T17:15:33.686351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.686171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:43.686493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.656453+0000","last_change":"2024-09-12T17:15:37.656278+0000","last_active":"2024-09-12T17:15:37.656453+0000","last_peered":"2024-09-12T17:15:37.656453+0000","last_clean":"2024-09-12T17:15:37.656453+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:15:37.656453+0000","last_undegraded":"2024-09-12T17:15:37.656453+0000","last_fullsized":"2024-09-12T17:15:37.656453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.656070+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:16.570468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.942111+0000","last_change":"2024-09-12T17:15:40.941979+0000","last_active":"2024-09-12T17:15:40.942111+0000","last_peered":"2024-09-12T17:15:40.942111+0000","last_clean":"2024-09-12T17:15:40.942111+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:15:40.942111+0000","last_undegraded":"2024-09-12T17:15:40.942111+0000","last_fullsized":"2024-09-12T17:15:40.942111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.941800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.911092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:57.512296+0000","last_change":"2024-09-12T17:15:57.512296+0000","last_active":"2024-09-12T17:15:57.512296+0000","last_peered":"2024-09-12T17:15:57.512296+0000","last_clean":"2024-09-12T17:15:57.512296+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:15:57.512296+0000","last_undegraded":"2024-09-12T17:15:57.512296+0000","last_fullsized":"2024-09-12T17:15:57.512296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:57.512178+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:57.512178+0000","last_clean_scrub_stamp":"2024-09-12T17:15:57.512178+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:35.784521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.679383+0000","last_change":"2024-09-12T17:15:16.679383+0000","last_active":"2024-09-12T17:15:16.679383+0000","last_peered":"2024-09-12T17:15:16.679383+0000","last_clean":"2024-09-12T17:15:16.679383+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:15:16.679383+0000","last_undegraded":"2024-09-12T17:15:16.679383+0000","last_fullsized":"2024-09-12T17:15:16.679383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.679191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:01.792668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.892102+0000","last_change":"2024-09-12T17:14:59.891960+0000","last_active":"2024-09-12T17:14:59.892102+0000","last_peered":"2024-09-12T17:14:59.892102+0000","last_clean":"2024-09-12T17:14:59.892102+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:14:59.892102+0000","last_undegraded":"2024-09-12T17:14:59.892102+0000","last_fullsized":"2024-09-12T17:14:59.892102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.891778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:26.957401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.044894+0000","last_change":"2024-09-12T17:15:30.044894+0000","last_active":"2024-09-12T17:15:30.044894+0000","last_peered":"2024-09-12T17:15:30.044894+0000","last_clean":"2024-09-12T17:15:30.044894+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:15:30.044894+0000","last_undegraded":"2024-09-12T17:15:30.044894+0000","last_fullsized":"2024-09-12T17:15:30.044894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.044721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:10.826683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:01.287836+0000","last_change":"2024-09-12T17:16:01.287693+0000","last_active":"2024-09-12T17:16:01.287836+0000","last_peered":"2024-09-12T17:16:01.287836+0000","last_clean":"2024-09-12T17:16:01.287836+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:16:01.287836+0000","last_undegraded":"2024-09-12T17:16:01.287836+0000","last_fullsized":"2024-09-12T17:16:01.287836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:16:01.287470+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:16:01.287470+0000","last_clean_scrub_stamp":"2024-09-12T17:16:01.287470+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.223965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.825583+0000","last_change":"2024-09-12T17:15:47.825453+0000","last_active":"2024-09-12T17:15:47.825583+0000","last_peered":"2024-09-12T17:15:47.825583+0000","last_clean":"2024-09-12T17:15:47.825583+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:15:47.825583+0000","last_undegraded":"2024-09-12T17:15:47.825583+0000","last_fullsized":"2024-09-12T17:15:47.825583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.825272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:30.075123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:14.270941+0000","last_change":"2024-09-12T17:16:14.270941+0000","last_active":"2024-09-12T17:16:14.270941+0000","last_peered":"2024-09-12T17:16:14.270941+0000","last_clean":"2024-09-12T17:16:14.270941+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:16:14.270941+0000","last_undegraded":"2024-09-12T17:16:14.270941+0000","last_fullsized":"2024-09-12T17:16:14.270941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:16:14.270689+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:16:14.270689+0000","last_clean_scrub_stamp":"2024-09-12T17:16:14.270689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:26.310974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.347265+0000","last_change":"2024-09-12T17:15:33.347117+0000","last_active":"2024-09-12T17:15:33.347265+0000","last_peered":"2024-09-12T17:15:33.347265+0000","last_clean":"2024-09-12T17:15:33.347265+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:15:33.347265+0000","last_undegraded":"2024-09-12T17:15:33.347265+0000","last_fullsized":"2024-09-12T17:15:33.347265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.346944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:57.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.858494+0000","last_change":"2024-09-12T17:15:02.858355+0000","last_active":"2024-09-12T17:15:02.858494+0000","last_peered":"2024-09-12T17:15:02.858494+0000","last_clean":"2024-09-12T17:15:02.858494+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:15:02.858494+0000","last_undegraded":"2024-09-12T17:15:02.858494+0000","last_fullsized":"2024-09-12T17:15:02.858494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.858176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:23.000373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.068214+0000","last_change":"2024-09-12T17:15:28.068082+0000","last_active":"2024-09-12T17:15:28.068214+0000","last_peered":"2024-09-12T17:15:28.068214+0000","last_clean":"2024-09-12T17:15:28.068214+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:15:28.068214+0000","last_undegraded":"2024-09-12T17:15:28.068214+0000","last_fullsized":"2024-09-12T17:15:28.068214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.067903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:07.804712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.706808+0000","last_change":"2024-09-12T17:15:38.706808+0000","last_active":"2024-09-12T17:15:38.706808+0000","last_peered":"2024-09-12T17:15:38.706808+0000","last_clean":"2024-09-12T17:15:38.706808+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:15:38.706808+0000","last_undegraded":"2024-09-12T17:15:38.706808+0000","last_fullsized":"2024-09-12T17:15:38.706808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.706615+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:06.515086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.610985+0000","last_change":"2024-09-12T17:15:50.610985+0000","last_active":"2024-09-12T17:15:50.610985+0000","last_peered":"2024-09-12T17:15:50.610985+0000","last_clean":"2024-09-12T17:15:50.610985+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:15:50.610985+0000","last_undegraded":"2024-09-12T17:15:50.610985+0000","last_fullsized":"2024-09-12T17:15:50.610985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.610873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:13.245535+0000","last_change":"2024-09-12T17:16:13.245535+0000","last_active":"2024-09-12T17:16:13.245535+0000","last_peered":"2024-09-12T17:16:13.245535+0000","last_clean":"2024-09-12T17:16:13.245535+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:16:13.245535+0000","last_undegraded":"2024-09-12T17:16:13.245535+0000","last_fullsized":"2024-09-12T17:16:13.245535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:16:13.245337+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:16:13.245337+0000","last_clean_scrub_stamp":"2024-09-12T17:16:13.245337+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.190507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.695132+0000","last_change":"2024-09-12T17:15:15.694857+0000","last_active":"2024-09-12T17:15:15.695132+0000","last_peered":"2024-09-12T17:15:15.695132+0000","last_clean":"2024-09-12T17:15:15.695132+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:15:15.695132+0000","last_undegraded":"2024-09-12T17:15:15.695132+0000","last_fullsized":"2024-09-12T17:15:15.695132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.694614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:28.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.276016+0000","last_change":"2024-09-12T17:15:11.275775+0000","last_active":"2024-09-12T17:15:11.276016+0000","last_peered":"2024-09-12T17:15:11.276016+0000","last_clean":"2024-09-12T17:15:11.276016+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:15:11.276016+0000","last_undegraded":"2024-09-12T17:15:11.276016+0000","last_fullsized":"2024-09-12T17:15:11.276016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.275550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.702407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.841600+0000","last_change":"2024-09-12T17:15:35.841473+0000","last_active":"2024-09-12T17:15:35.841600+0000","last_peered":"2024-09-12T17:15:35.841600+0000","last_clean":"2024-09-12T17:15:35.841600+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:15:35.841600+0000","last_undegraded":"2024-09-12T17:15:35.841600+0000","last_fullsized":"2024-09-12T17:15:35.841600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.841290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.567347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:02.327511+0000","last_change":"2024-09-12T17:16:02.327511+0000","last_active":"2024-09-12T17:16:02.327511+0000","last_peered":"2024-09-12T17:16:02.327511+0000","last_clean":"2024-09-12T17:16:02.327511+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:16:02.327511+0000","last_undegraded":"2024-09-12T17:16:02.327511+0000","last_fullsized":"2024-09-12T17:16:02.327511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:16:02.327298+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:16:02.327298+0000","last_clean_scrub_stamp":"2024-09-12T17:16:02.327298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:00.071926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.942026+0000","last_change":"2024-09-12T17:15:43.942026+0000","last_active":"2024-09-12T17:15:43.942026+0000","last_peered":"2024-09-12T17:15:43.942026+0000","last_clean":"2024-09-12T17:15:43.942026+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:15:43.942026+0000","last_undegraded":"2024-09-12T17:15:43.942026+0000","last_fullsized":"2024-09-12T17:15:43.942026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.941828+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:54.981369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:12.242904+0000","last_change":"2024-09-12T17:16:12.242904+0000","last_active":"2024-09-12T17:16:12.242904+0000","last_peered":"2024-09-12T17:16:12.242904+0000","last_clean":"2024-09-12T17:16:12.242904+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:16:12.242904+0000","last_undegraded":"2024-09-12T17:16:12.242904+0000","last_fullsized":"2024-09-12T17:16:12.242904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:16:12.242607+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:16:12.242607+0000","last_clean_scrub_stamp":"2024-09-12T17:16:12.242607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:22.193779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.160600+0000","last_change":"2024-09-12T17:15:19.160440+0000","last_active":"2024-09-12T17:15:19.160600+0000","last_peered":"2024-09-12T17:15:19.160600+0000","last_clean":"2024-09-12T17:15:19.160600+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:15:19.160600+0000","last_undegraded":"2024-09-12T17:15:19.160600+0000","last_fullsized":"2024-09-12T17:15:19.160600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.160245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:47.049379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.864791+0000","last_change":"2024-09-12T17:15:00.864639+0000","last_active":"2024-09-12T17:15:00.864791+0000","last_peered":"2024-09-12T17:15:00.864791+0000","last_clean":"2024-09-12T17:15:00.864791+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:15:00.864791+0000","last_undegraded":"2024-09-12T17:15:00.864791+0000","last_fullsized":"2024-09-12T17:15:00.864791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.864442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:24.991687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.833283+0000","last_change":"2024-09-12T17:15:34.833150+0000","last_active":"2024-09-12T17:15:34.833283+0000","last_peered":"2024-09-12T17:15:34.833283+0000","last_clean":"2024-09-12T17:15:34.833283+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:15:34.833283+0000","last_undegraded":"2024-09-12T17:15:34.833283+0000","last_fullsized":"2024-09-12T17:15:34.833283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.832966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:52.647443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.861639+0000","last_change":"2024-09-12T17:15:42.861499+0000","last_active":"2024-09-12T17:15:42.861639+0000","last_peered":"2024-09-12T17:15:42.861639+0000","last_clean":"2024-09-12T17:15:42.861639+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:15:42.861639+0000","last_undegraded":"2024-09-12T17:15:42.861639+0000","last_fullsized":"2024-09-12T17:15:42.861639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.861281+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:02.493188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.625355+0000","last_change":"2024-09-12T17:15:47.625209+0000","last_active":"2024-09-12T17:15:47.625355+0000","last_peered":"2024-09-12T17:15:47.625355+0000","last_clean":"2024-09-12T17:15:47.625355+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:15:47.625355+0000","last_undegraded":"2024-09-12T17:15:47.625355+0000","last_fullsized":"2024-09-12T17:15:47.625355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.625030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:50.457416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.844675+0000","last_change":"2024-09-12T17:15:53.844522+0000","last_active":"2024-09-12T17:15:53.844675+0000","last_peered":"2024-09-12T17:15:53.844675+0000","last_clean":"2024-09-12T17:15:53.844675+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:15:53.844675+0000","last_undegraded":"2024-09-12T17:15:53.844675+0000","last_fullsized":"2024-09-12T17:15:53.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.844338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:03.815876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.127591+0000","last_change":"2024-09-12T17:15:18.127348+0000","last_active":"2024-09-12T17:15:18.127591+0000","last_peered":"2024-09-12T17:15:18.127591+0000","last_clean":"2024-09-12T17:15:18.127591+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:15:18.127591+0000","last_undegraded":"2024-09-12T17:15:18.127591+0000","last_fullsized":"2024-09-12T17:15:18.127591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.127110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:36.993142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.285728+0000","last_change":"2024-09-12T17:15:10.285556+0000","last_active":"2024-09-12T17:15:10.285728+0000","last_peered":"2024-09-12T17:15:10.285728+0000","last_clean":"2024-09-12T17:15:10.285728+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:15:10.285728+0000","last_undegraded":"2024-09-12T17:15:10.285728+0000","last_fullsized":"2024-09-12T17:15:10.285728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.285362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:12.449928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.037796+0000","last_change":"2024-09-12T17:15:29.037671+0000","last_active":"2024-09-12T17:15:29.037796+0000","last_peered":"2024-09-12T17:15:29.037796+0000","last_clean":"2024-09-12T17:15:29.037796+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:15:29.037796+0000","last_undegraded":"2024-09-12T17:15:29.037796+0000","last_fullsized":"2024-09-12T17:15:29.037796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.037477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:54.325784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.646999+0000","last_change":"2024-09-12T17:15:36.646833+0000","last_active":"2024-09-12T17:15:36.646999+0000","last_peered":"2024-09-12T17:15:36.646999+0000","last_clean":"2024-09-12T17:15:36.646999+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.646999+0000","last_undegraded":"2024-09-12T17:15:36.646999+0000","last_fullsized":"2024-09-12T17:15:36.646999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.646641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:39.059542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:08.313576+0000","last_change":"2024-09-12T17:16:08.313576+0000","last_active":"2024-09-12T17:16:08.313576+0000","last_peered":"2024-09-12T17:16:08.313576+0000","last_clean":"2024-09-12T17:16:08.313576+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:16:08.313576+0000","last_undegraded":"2024-09-12T17:16:08.313576+0000","last_fullsized":"2024-09-12T17:16:08.313576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:08.313398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:08.313398+0000","last_clean_scrub_stamp":"2024-09-12T17:16:08.313398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.990313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:39.800113+0000","last_change":"2024-09-12T17:11:14.759053+0000","last_active":"2024-09-12T17:13:39.800113+0000","last_peered":"2024-09-12T17:13:39.800113+0000","last_clean":"2024-09-12T17:13:39.800113+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:13:39.800113+0000","last_undegraded":"2024-09-12T17:13:39.800113+0000","last_fullsized":"2024-09-12T17:13:39.800113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.119280+0000","last_change":"2024-09-12T17:15:17.119280+0000","last_active":"2024-09-12T17:15:17.119280+0000","last_peered":"2024-09-12T17:15:17.119280+0000","last_clean":"2024-09-12T17:15:17.119280+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:15:17.119280+0000","last_undegraded":"2024-09-12T17:15:17.119280+0000","last_fullsized":"2024-09-12T17:15:17.119280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.119084+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:32.612758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.581681+0000","last_change":"2024-09-12T17:14:58.581536+0000","last_active":"2024-09-12T17:14:58.581681+0000","last_peered":"2024-09-12T17:14:58.581681+0000","last_clean":"2024-09-12T17:14:58.581681+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:14:58.581681+0000","last_undegraded":"2024-09-12T17:14:58.581681+0000","last_fullsized":"2024-09-12T17:14:58.581681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.581351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:14.075025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.898390+0000","last_change":"2024-09-12T17:15:32.898232+0000","last_active":"2024-09-12T17:15:32.898390+0000","last_peered":"2024-09-12T17:15:32.898390+0000","last_clean":"2024-09-12T17:15:32.898390+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:15:32.898390+0000","last_undegraded":"2024-09-12T17:15:32.898390+0000","last_fullsized":"2024-09-12T17:15:32.898390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.898046+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:58.817691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:00.246265+0000","last_change":"2024-09-12T17:16:00.246097+0000","last_active":"2024-09-12T17:16:00.246265+0000","last_peered":"2024-09-12T17:16:00.246265+0000","last_clean":"2024-09-12T17:16:00.246265+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:16:00.246265+0000","last_undegraded":"2024-09-12T17:16:00.246265+0000","last_fullsized":"2024-09-12T17:16:00.246265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-12T17:16:00.245908+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-12T17:16:00.245908+0000","last_clean_scrub_stamp":"2024-09-12T17:16:00.245908+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:12.239925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:09.329945+0000","last_change":"2024-09-12T17:16:09.329804+0000","last_active":"2024-09-12T17:16:09.329945+0000","last_peered":"2024-09-12T17:16:09.329945+0000","last_clean":"2024-09-12T17:16:09.329945+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:16:09.329945+0000","last_undegraded":"2024-09-12T17:16:09.329945+0000","last_fullsized":"2024-09-12T17:16:09.329945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:09.329619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:09.329619+0000","last_clean_scrub_stamp":"2024-09-12T17:16:09.329619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:33.358269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:19.518477+0000","last_change":"2024-09-12T17:11:14.779806+0000","last_active":"2024-09-12T17:14:19.518477+0000","last_peered":"2024-09-12T17:14:19.518477+0000","last_clean":"2024-09-12T17:14:19.518477+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:14:19.518477+0000","last_undegraded":"2024-09-12T17:14:19.518477+0000","last_fullsized":"2024-09-12T17:14:19.518477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.133079+0000","last_change":"2024-09-12T17:15:16.132949+0000","last_active":"2024-09-12T17:15:16.133079+0000","last_peered":"2024-09-12T17:15:16.133079+0000","last_clean":"2024-09-12T17:15:16.133079+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:15:16.133079+0000","last_undegraded":"2024-09-12T17:15:16.133079+0000","last_fullsized":"2024-09-12T17:15:16.133079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.132765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:16.951874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.868010+0000","last_change":"2024-09-12T17:15:01.867847+0000","last_active":"2024-09-12T17:15:01.868010+0000","last_peered":"2024-09-12T17:15:01.868010+0000","last_clean":"2024-09-12T17:15:01.868010+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:15:01.868010+0000","last_undegraded":"2024-09-12T17:15:01.868010+0000","last_fullsized":"2024-09-12T17:15:01.868010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.867668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.434128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.888001+0000","last_change":"2024-09-12T17:15:36.887755+0000","last_active":"2024-09-12T17:15:36.888001+0000","last_peered":"2024-09-12T17:15:36.888001+0000","last_clean":"2024-09-12T17:15:36.888001+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:15:36.888001+0000","last_undegraded":"2024-09-12T17:15:36.888001+0000","last_fullsized":"2024-09-12T17:15:36.888001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.887464+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:14.748108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:59.218937+0000","last_change":"2024-09-12T17:15:59.218798+0000","last_active":"2024-09-12T17:15:59.218937+0000","last_peered":"2024-09-12T17:15:59.218937+0000","last_clean":"2024-09-12T17:15:59.218937+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:15:59.218937+0000","last_undegraded":"2024-09-12T17:15:59.218937+0000","last_fullsized":"2024-09-12T17:15:59.218937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:59.218580+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:59.218580+0000","last_clean_scrub_stamp":"2024-09-12T17:15:59.218580+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:40.604790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.652404+0000","last_change":"2024-09-12T17:15:49.652254+0000","last_active":"2024-09-12T17:15:49.652404+0000","last_peered":"2024-09-12T17:15:49.652404+0000","last_clean":"2024-09-12T17:15:49.652404+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:15:49.652404+0000","last_undegraded":"2024-09-12T17:15:49.652404+0000","last_fullsized":"2024-09-12T17:15:49.652404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.652077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:48.997120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:13:34.798183+0000","last_change":"2024-09-12T17:11:14.759801+0000","last_active":"2024-09-12T17:13:34.798183+0000","last_peered":"2024-09-12T17:13:34.798183+0000","last_clean":"2024-09-12T17:13:34.798183+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:13:34.798183+0000","last_undegraded":"2024-09-12T17:13:34.798183+0000","last_fullsized":"2024-09-12T17:13:34.798183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:11:13.711676+0000","last_clean_scrub_stamp":"2024-09-12T17:11:13.711676+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.889371+0000","last_change":"2024-09-12T17:15:17.889200+0000","last_active":"2024-09-12T17:15:17.889371+0000","last_peered":"2024-09-12T17:15:17.889371+0000","last_clean":"2024-09-12T17:15:17.889371+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:15:17.889371+0000","last_undegraded":"2024-09-12T17:15:17.889371+0000","last_fullsized":"2024-09-12T17:15:17.889371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.889016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:57.728810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.238720+0000","last_change":"2024-09-12T17:15:05.238547+0000","last_active":"2024-09-12T17:15:05.238720+0000","last_peered":"2024-09-12T17:15:05.238720+0000","last_clean":"2024-09-12T17:15:05.238720+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:15:05.238720+0000","last_undegraded":"2024-09-12T17:15:05.238720+0000","last_fullsized":"2024-09-12T17:15:05.238720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.238353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:56.750159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.671276+0000","last_change":"2024-09-12T17:15:20.671042+0000","last_active":"2024-09-12T17:15:20.671276+0000","last_peered":"2024-09-12T17:15:20.671276+0000","last_clean":"2024-09-12T17:15:20.671276+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:15:20.671276+0000","last_undegraded":"2024-09-12T17:15:20.671276+0000","last_fullsized":"2024-09-12T17:15:20.671276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.670806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:30.872392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.616378+0000","last_change":"2024-09-12T17:15:02.616092+0000","last_active":"2024-09-12T17:15:02.616378+0000","last_peered":"2024-09-12T17:15:02.616378+0000","last_clean":"2024-09-12T17:15:02.616378+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:15:02.616378+0000","last_undegraded":"2024-09-12T17:15:02.616378+0000","last_fullsized":"2024-09-12T17:15:02.616378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.615816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.024352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.322903+0000","last_change":"2024-09-12T17:15:34.322903+0000","last_active":"2024-09-12T17:15:34.322903+0000","last_peered":"2024-09-12T17:15:34.322903+0000","last_clean":"2024-09-12T17:15:34.322903+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:15:34.322903+0000","last_undegraded":"2024-09-12T17:15:34.322903+0000","last_fullsized":"2024-09-12T17:15:34.322903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.322694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:48.925147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.284536+0000","last_change":"2024-09-12T17:15:13.284400+0000","last_active":"2024-09-12T17:15:13.284536+0000","last_peered":"2024-09-12T17:15:13.284536+0000","last_clean":"2024-09-12T17:15:13.284536+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:15:13.284536+0000","last_undegraded":"2024-09-12T17:15:13.284536+0000","last_fullsized":"2024-09-12T17:15:13.284536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.284187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:57.850098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.670504+0000","last_change":"2024-09-12T17:15:19.670350+0000","last_active":"2024-09-12T17:15:19.670504+0000","last_peered":"2024-09-12T17:15:19.670504+0000","last_clean":"2024-09-12T17:15:19.670504+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:15:19.670504+0000","last_undegraded":"2024-09-12T17:15:19.670504+0000","last_fullsized":"2024-09-12T17:15:19.670504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.670162+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:29.009474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.567132+0000","last_change":"2024-09-12T17:15:03.566984+0000","last_active":"2024-09-12T17:15:03.567132+0000","last_peered":"2024-09-12T17:15:03.567132+0000","last_clean":"2024-09-12T17:15:03.567132+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:15:03.567132+0000","last_undegraded":"2024-09-12T17:15:03.567132+0000","last_fullsized":"2024-09-12T17:15:03.567132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.566768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:47.560762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.649801+0000","last_change":"2024-09-12T17:15:17.649633+0000","last_active":"2024-09-12T17:15:17.649801+0000","last_peered":"2024-09-12T17:15:17.649801+0000","last_clean":"2024-09-12T17:15:17.649801+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:15:17.649801+0000","last_undegraded":"2024-09-12T17:15:17.649801+0000","last_fullsized":"2024-09-12T17:15:17.649801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.649454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:05.606953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.571576+0000","last_change":"2024-09-12T17:15:04.571415+0000","last_active":"2024-09-12T17:15:04.571576+0000","last_peered":"2024-09-12T17:15:04.571576+0000","last_clean":"2024-09-12T17:15:04.571576+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:15:04.571576+0000","last_undegraded":"2024-09-12T17:15:04.571576+0000","last_fullsized":"2024-09-12T17:15:04.571576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.571227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:38.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.873095+0000","last_change":"2024-09-12T17:15:16.872841+0000","last_active":"2024-09-12T17:15:16.873095+0000","last_peered":"2024-09-12T17:15:16.873095+0000","last_clean":"2024-09-12T17:15:16.873095+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:15:16.873095+0000","last_undegraded":"2024-09-12T17:15:16.873095+0000","last_fullsized":"2024-09-12T17:15:16.873095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.872542+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:45.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.875249+0000","last_change":"2024-09-12T17:15:03.875105+0000","last_active":"2024-09-12T17:15:03.875249+0000","last_peered":"2024-09-12T17:15:03.875249+0000","last_clean":"2024-09-12T17:15:03.875249+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:15:03.875249+0000","last_undegraded":"2024-09-12T17:15:03.875249+0000","last_fullsized":"2024-09-12T17:15:03.875249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.874897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:32.945371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.700030+0000","last_change":"2024-09-12T17:15:18.699771+0000","last_active":"2024-09-12T17:15:18.700030+0000","last_peered":"2024-09-12T17:15:18.700030+0000","last_clean":"2024-09-12T17:15:18.700030+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:15:18.700030+0000","last_undegraded":"2024-09-12T17:15:18.700030+0000","last_fullsized":"2024-09-12T17:15:18.700030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.699553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:11.188707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.247386+0000","last_change":"2024-09-12T17:15:04.247188+0000","last_active":"2024-09-12T17:15:04.247386+0000","last_peered":"2024-09-12T17:15:04.247386+0000","last_clean":"2024-09-12T17:15:04.247386+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:15:04.247386+0000","last_undegraded":"2024-09-12T17:15:04.247386+0000","last_fullsized":"2024-09-12T17:15:04.247386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.247001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:40.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.861612+0000","last_change":"2024-09-12T17:15:15.861444+0000","last_active":"2024-09-12T17:15:15.861612+0000","last_peered":"2024-09-12T17:15:15.861612+0000","last_clean":"2024-09-12T17:15:15.861612+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:15:15.861612+0000","last_undegraded":"2024-09-12T17:15:15.861612+0000","last_fullsized":"2024-09-12T17:15:15.861612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.861265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.696684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.597439+0000","last_change":"2024-09-12T17:15:05.597274+0000","last_active":"2024-09-12T17:15:05.597439+0000","last_peered":"2024-09-12T17:15:05.597439+0000","last_clean":"2024-09-12T17:15:05.597439+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:15:05.597439+0000","last_undegraded":"2024-09-12T17:15:05.597439+0000","last_fullsized":"2024-09-12T17:15:05.597439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.597076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.894915+0000","last_change":"2024-09-12T17:15:21.894740+0000","last_active":"2024-09-12T17:15:21.894915+0000","last_peered":"2024-09-12T17:15:21.894915+0000","last_clean":"2024-09-12T17:15:21.894915+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:15:21.894915+0000","last_undegraded":"2024-09-12T17:15:21.894915+0000","last_fullsized":"2024-09-12T17:15:21.894915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.894560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:42.114364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.277700+0000","last_change":"2024-09-12T17:15:14.277545+0000","last_active":"2024-09-12T17:15:14.277700+0000","last_peered":"2024-09-12T17:15:14.277700+0000","last_clean":"2024-09-12T17:15:14.277700+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:15:14.277700+0000","last_undegraded":"2024-09-12T17:15:14.277700+0000","last_fullsized":"2024-09-12T17:15:14.277700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.277335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.472821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.355322+0000","last_change":"2024-09-12T17:15:35.355049+0000","last_active":"2024-09-12T17:15:35.355322+0000","last_peered":"2024-09-12T17:15:35.355322+0000","last_clean":"2024-09-12T17:15:35.355322+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:15:35.355322+0000","last_undegraded":"2024-09-12T17:15:35.355322+0000","last_fullsized":"2024-09-12T17:15:35.355322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.354816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:08.672902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.549503+0000","last_change":"2024-09-12T17:15:06.549362+0000","last_active":"2024-09-12T17:15:06.549503+0000","last_peered":"2024-09-12T17:15:06.549503+0000","last_clean":"2024-09-12T17:15:06.549503+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:15:06.549503+0000","last_undegraded":"2024-09-12T17:15:06.549503+0000","last_fullsized":"2024-09-12T17:15:06.549503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.549179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:02.554930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.628694+0000","last_change":"2024-09-12T17:15:21.628515+0000","last_active":"2024-09-12T17:15:21.628694+0000","last_peered":"2024-09-12T17:15:21.628694+0000","last_clean":"2024-09-12T17:15:21.628694+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:15:21.628694+0000","last_undegraded":"2024-09-12T17:15:21.628694+0000","last_fullsized":"2024-09-12T17:15:21.628694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.628332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:19.659256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.916560+0000","last_change":"2024-09-12T17:15:04.916380+0000","last_active":"2024-09-12T17:15:04.916560+0000","last_peered":"2024-09-12T17:15:04.916560+0000","last_clean":"2024-09-12T17:15:04.916560+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:15:04.916560+0000","last_undegraded":"2024-09-12T17:15:04.916560+0000","last_fullsized":"2024-09-12T17:15:04.916560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.916186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:14.335123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'20","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.882899+0000","last_change":"2024-09-12T17:15:22.882754+0000","last_active":"2024-09-12T17:15:22.882899+0000","last_peered":"2024-09-12T17:15:22.882899+0000","last_clean":"2024-09-12T17:15:22.882899+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:15:22.882899+0000","last_undegraded":"2024-09-12T17:15:22.882899+0000","last_fullsized":"2024-09-12T17:15:22.882899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.882573+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:01.302462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.892920+0000","last_change":"2024-09-12T17:15:05.892750+0000","last_active":"2024-09-12T17:15:05.892920+0000","last_peered":"2024-09-12T17:15:05.892920+0000","last_clean":"2024-09-12T17:15:05.892920+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:15:05.892920+0000","last_undegraded":"2024-09-12T17:15:05.892920+0000","last_fullsized":"2024-09-12T17:15:05.892920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.892542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.813883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.916868+0000","last_change":"2024-09-12T17:15:19.916708+0000","last_active":"2024-09-12T17:15:19.916868+0000","last_peered":"2024-09-12T17:15:19.916868+0000","last_clean":"2024-09-12T17:15:19.916868+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:15:19.916868+0000","last_undegraded":"2024-09-12T17:15:19.916868+0000","last_fullsized":"2024-09-12T17:15:19.916868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.916525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.259459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.324327+0000","last_change":"2024-09-12T17:15:20.324077+0000","last_active":"2024-09-12T17:15:20.324327+0000","last_peered":"2024-09-12T17:15:20.324327+0000","last_clean":"2024-09-12T17:15:20.324327+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:15:20.324327+0000","last_undegraded":"2024-09-12T17:15:20.324327+0000","last_fullsized":"2024-09-12T17:15:20.324327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.323778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:06.113896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.882796+0000","last_change":"2024-09-12T17:15:20.882625+0000","last_active":"2024-09-12T17:15:20.882796+0000","last_peered":"2024-09-12T17:15:20.882796+0000","last_clean":"2024-09-12T17:15:20.882796+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:15:20.882796+0000","last_undegraded":"2024-09-12T17:15:20.882796+0000","last_fullsized":"2024-09-12T17:15:20.882796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.882443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.227785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.295924+0000","last_change":"2024-09-12T17:15:16.295674+0000","last_active":"2024-09-12T17:15:16.295924+0000","last_peered":"2024-09-12T17:15:16.295924+0000","last_clean":"2024-09-12T17:15:16.295924+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:15:16.295924+0000","last_undegraded":"2024-09-12T17:15:16.295924+0000","last_fullsized":"2024-09-12T17:15:16.295924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.295447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:39.795551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.138893+0000","last_change":"2024-09-12T17:15:20.138893+0000","last_active":"2024-09-12T17:15:20.138893+0000","last_peered":"2024-09-12T17:15:20.138893+0000","last_clean":"2024-09-12T17:15:20.138893+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:15:20.138893+0000","last_undegraded":"2024-09-12T17:15:20.138893+0000","last_fullsized":"2024-09-12T17:15:20.138893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.138667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.029770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.206544+0000","last_change":"2024-09-12T17:15:06.206386+0000","last_active":"2024-09-12T17:15:06.206544+0000","last_peered":"2024-09-12T17:15:06.206544+0000","last_clean":"2024-09-12T17:15:06.206544+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:15:06.206544+0000","last_undegraded":"2024-09-12T17:15:06.206544+0000","last_fullsized":"2024-09-12T17:15:06.206544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.206190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:25.118231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.926993+0000","last_change":"2024-09-12T17:15:18.926822+0000","last_active":"2024-09-12T17:15:18.926993+0000","last_peered":"2024-09-12T17:15:18.926993+0000","last_clean":"2024-09-12T17:15:18.926993+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:15:18.926993+0000","last_undegraded":"2024-09-12T17:15:18.926993+0000","last_fullsized":"2024-09-12T17:15:18.926993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.926612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.452117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.317435+0000","last_change":"2024-09-12T17:15:17.317282+0000","last_active":"2024-09-12T17:15:17.317435+0000","last_peered":"2024-09-12T17:15:17.317435+0000","last_clean":"2024-09-12T17:15:17.317435+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:15:17.317435+0000","last_undegraded":"2024-09-12T17:15:17.317435+0000","last_fullsized":"2024-09-12T17:15:17.317435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.317078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:13.516624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.338988+0000","last_change":"2024-09-12T17:15:18.338825+0000","last_active":"2024-09-12T17:15:18.338988+0000","last_peered":"2024-09-12T17:15:18.338988+0000","last_clean":"2024-09-12T17:15:18.338988+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:15:18.338988+0000","last_undegraded":"2024-09-12T17:15:18.338988+0000","last_fullsized":"2024-09-12T17:15:18.338988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.338612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:11.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.612522+0000","last_change":"2024-09-12T17:15:22.612356+0000","last_active":"2024-09-12T17:15:22.612522+0000","last_peered":"2024-09-12T17:15:22.612522+0000","last_clean":"2024-09-12T17:15:22.612522+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:15:22.612522+0000","last_undegraded":"2024-09-12T17:15:22.612522+0000","last_fullsized":"2024-09-12T17:15:22.612522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.612179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:31.610905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.598211+0000","last_change":"2024-09-12T17:15:07.598077+0000","last_active":"2024-09-12T17:15:07.598211+0000","last_peered":"2024-09-12T17:15:07.598211+0000","last_clean":"2024-09-12T17:15:07.598211+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:15:07.598211+0000","last_undegraded":"2024-09-12T17:15:07.598211+0000","last_fullsized":"2024-09-12T17:15:07.598211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.597893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:32.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.855004+0000","last_change":"2024-09-12T17:15:29.854853+0000","last_active":"2024-09-12T17:15:29.855004+0000","last_peered":"2024-09-12T17:15:29.855004+0000","last_clean":"2024-09-12T17:15:29.855004+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:15:29.855004+0000","last_undegraded":"2024-09-12T17:15:29.855004+0000","last_fullsized":"2024-09-12T17:15:29.855004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.854616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:22.735044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640326,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640326,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673030,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705733,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:16:18.145 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:16:18.146 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:16:18.146 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:16:18.147 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:16:18.147 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:11:13.711676+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=11, tm_sec=13, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=14, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:16:18.147 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:16:38.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:16:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.278+0000 7fed83e0e640 1 Processor -- start 2024-09-12T17:16:38.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.278+0000 7fed83e0e640 1 -- start start 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed83e0e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed7c110da0 0x7fed7c111180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed83e0e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed7c073a90 con 0x7fed7c1116c0 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed83e0e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fed7c0696e0 con 0x7fed7c110da0 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed813a9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fed7c1116c0 0x7fed7c1231e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50464/0 (socket says 172.21.15.62:50464) 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed81baa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed7c110da0 0x7fed7c111180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed813a9640 1 -- 172.21.15.62:0/3069288039 learned_addr learned my addr 172.21.15.62:0/3069288039 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:16:38.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298674543 0 0) 0x7fed7c073a90 con 0x7fed7c1116c0 2024-09-12T17:16:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed68003530 con 0x7fed7c1116c0 2024-09-12T17:16:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed81baa640 1 -- 172.21.15.62:0/3069288039 >> v1:172.21.15.62:6789/0 conn(0x7fed7c1116c0 legacy=0x7fed7c1231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2845074980 0 0) 0x7fed68003530 con 0x7fed7c1116c0 2024-09-12T17:16:38.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.282+0000 7fed81baa640 1 -- 172.21.15.62:0/3069288039 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c06dd50 con 0x7fed7c110da0 2024-09-12T17:16:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed81baa640 1 --2- 172.21.15.62:0/3069288039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c111180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fed74009740 tx=0x7fed7401c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1923ca0094e192c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed740b0070 con 0x7fed7c110da0 2024-09-12T17:16:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740ab400 con 0x7fed7c110da0 2024-09-12T17:16:38.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed80ba8640 1 -- 172.21.15.62:0/3069288039 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed6c001630 con 0x7fed7c110da0 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- 172.21.15.62:0/3069288039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 msgr2=0x7fed7c111180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 --2- 172.21.15.62:0/3069288039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c111180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fed74009740 tx=0x7fed7401c290 comp rx=0 tx=0).stop 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- 172.21.15.62:0/3069288039 shutdown_connections 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 --2- 172.21.15.62:0/3069288039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c111180 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- 172.21.15.62:0/3069288039 >> 172.21.15.62:0/3069288039 conn(0x7fed7c070900 msgr2=0x7fed7c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- 172.21.15.62:0/3069288039 shutdown_connections 2024-09-12T17:16:38.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- 172.21.15.62:0/3069288039 wait complete. 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 Processor -- start 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- start start 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed83e0e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c135470 con 0x7fed7c110da0 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed81baa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed81baa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36564/0 (socket says 172.21.15.62:36564) 2024-09-12T17:16:38.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed81baa640 1 -- 172.21.15.62:0/2232271030 learned_addr learned my addr 172.21.15.62:0/2232271030 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.286+0000 7fed81baa640 1 -- 172.21.15.62:0/2232271030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c12cf80 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed81baa640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fed74009740 tx=0x7fed7401aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed740bb020 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740b1040 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c116510 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed740b0050 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c116c80 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c111180 con 0x7fed7c110da0 2024-09-12T17:16:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7fed740be070 con 0x7fed7c110da0 2024-09-12T17:16:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 0x7fed6003d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7fed740e9040 con 0x7fed7c110da0 2024-09-12T17:16:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed813a9640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 0x7fed6003d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.290+0000 7fed813a9640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 0x7fed6003d6c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fed6c001df0 tx=0x7fed6c001600 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.294+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7fed74015f10 con 0x7fed7c110da0 2024-09-12T17:16:38.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.458+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 --> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed7c1120e0 con 0x7fed6003b200 2024-09-12T17:16:38.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.486+0000 7fed727fc640 1 -- 172.21.15.62:0/2232271030 <== mgr.4100 v2:172.21.15.193:6824/1409480917 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666205 (secure 0 0 0) 0x7fed6c007d90 con 0x7fed6003b200 2024-09-12T17:16:38.493 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T17:16:38.500 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T17:16:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 msgr2=0x7fed6003d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 0x7fed6003d6c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fed6c001df0 tx=0x7fed6c001600 comp rx=0 tx=0).stop 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 msgr2=0x7fed7c1c68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fed74009740 tx=0x7fed7401aad0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 shutdown_connections 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7fed6003b200 0x7fed6003d6c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 --2- 172.21.15.62:0/2232271030 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed7c110da0 0x7fed7c1c68e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 >> 172.21.15.62:0/2232271030 conn(0x7fed7c070900 msgr2=0x7fed7c1262c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 shutdown_connections 2024-09-12T17:16:38.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.490+0000 7fed83e0e640 1 -- 172.21.15.62:0/2232271030 wait complete. 2024-09-12T17:16:38.509 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-12T17:16:36.835586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5148,"num_read_kb":4734,"num_write":2123,"num_write_kb":60588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165088,"kb_used_data":2912,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322272,"statfs":{"total":386547056640,"available":386378006528,"internally_reserved":0,"allocated":2981888,"data_stored":1783504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006867"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.201214+0000","last_change":"2024-09-12T17:15:10.201061+0000","last_active":"2024-09-12T17:15:10.201214+0000","last_peered":"2024-09-12T17:15:10.201214+0000","last_clean":"2024-09-12T17:15:10.201214+0000","last_became_active":"2024-09-12T17:11:04.686641+0000","last_became_peered":"2024-09-12T17:11:04.686641+0000","last_unstale":"2024-09-12T17:15:10.201214+0000","last_undegraded":"2024-09-12T17:15:10.201214+0000","last_fullsized":"2024-09-12T17:15:10.201214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.200874+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.200874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:33.595229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'12","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.829332+0000","last_change":"2024-09-12T17:15:26.829156+0000","last_active":"2024-09-12T17:15:26.829332+0000","last_peered":"2024-09-12T17:15:26.829332+0000","last_clean":"2024-09-12T17:15:26.829332+0000","last_became_active":"2024-09-12T17:11:06.702052+0000","last_became_peered":"2024-09-12T17:11:06.702052+0000","last_unstale":"2024-09-12T17:15:26.829332+0000","last_undegraded":"2024-09-12T17:15:26.829332+0000","last_fullsized":"2024-09-12T17:15:26.829332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:26.828983+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.828983+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:58.923967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.622651+0000","last_change":"2024-09-12T17:15:10.622455+0000","last_active":"2024-09-12T17:15:10.622651+0000","last_peered":"2024-09-12T17:15:10.622651+0000","last_clean":"2024-09-12T17:15:10.622651+0000","last_became_active":"2024-09-12T17:11:04.678213+0000","last_became_peered":"2024-09-12T17:11:04.678213+0000","last_unstale":"2024-09-12T17:15:10.622651+0000","last_undegraded":"2024-09-12T17:15:10.622651+0000","last_fullsized":"2024-09-12T17:15:10.622651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.622272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.622272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:24.192408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.375554+0000","last_change":"2024-09-12T17:15:38.375409+0000","last_active":"2024-09-12T17:15:38.375554+0000","last_peered":"2024-09-12T17:15:38.375554+0000","last_clean":"2024-09-12T17:15:38.375554+0000","last_became_active":"2024-09-12T17:11:06.689064+0000","last_became_peered":"2024-09-12T17:11:06.689064+0000","last_unstale":"2024-09-12T17:15:38.375554+0000","last_undegraded":"2024-09-12T17:15:38.375554+0000","last_fullsized":"2024-09-12T17:15:38.375554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.375231+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.375231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:29.887495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.322131+0000","last_change":"2024-09-12T17:15:24.322131+0000","last_active":"2024-09-12T17:15:24.322131+0000","last_peered":"2024-09-12T17:15:24.322131+0000","last_clean":"2024-09-12T17:15:24.322131+0000","last_became_active":"2024-09-12T17:11:04.704963+0000","last_became_peered":"2024-09-12T17:11:04.704963+0000","last_unstale":"2024-09-12T17:15:24.322131+0000","last_undegraded":"2024-09-12T17:15:24.322131+0000","last_fullsized":"2024-09-12T17:15:24.322131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.321949+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.321949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:20.438915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.435179+0000","last_change":"2024-09-12T17:15:48.435046+0000","last_active":"2024-09-12T17:15:48.435179+0000","last_peered":"2024-09-12T17:15:48.435179+0000","last_clean":"2024-09-12T17:15:48.435179+0000","last_became_active":"2024-09-12T17:11:06.691444+0000","last_became_peered":"2024-09-12T17:11:06.691444+0000","last_unstale":"2024-09-12T17:15:48.435179+0000","last_undegraded":"2024-09-12T17:15:48.435179+0000","last_fullsized":"2024-09-12T17:15:48.435179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:48.434851+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.434851+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:16.242984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.169692+0000","last_change":"2024-09-12T17:15:09.169692+0000","last_active":"2024-09-12T17:15:09.169692+0000","last_peered":"2024-09-12T17:15:09.169692+0000","last_clean":"2024-09-12T17:15:09.169692+0000","last_became_active":"2024-09-12T17:11:04.671858+0000","last_became_peered":"2024-09-12T17:11:04.671858+0000","last_unstale":"2024-09-12T17:15:09.169692+0000","last_undegraded":"2024-09-12T17:15:09.169692+0000","last_fullsized":"2024-09-12T17:15:09.169692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.169513+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.169513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:40.605000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.167353+0000","last_change":"2024-09-12T17:15:21.167353+0000","last_active":"2024-09-12T17:15:21.167353+0000","last_peered":"2024-09-12T17:15:21.167353+0000","last_clean":"2024-09-12T17:15:21.167353+0000","last_became_active":"2024-09-12T17:11:43.811543+0000","last_became_peered":"2024-09-12T17:11:43.811543+0000","last_unstale":"2024-09-12T17:15:21.167353+0000","last_undegraded":"2024-09-12T17:15:21.167353+0000","last_fullsized":"2024-09-12T17:15:21.167353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:21.167170+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.167170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:52.575705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'6","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.283210+0000","last_change":"2024-09-12T17:15:22.283073+0000","last_active":"2024-09-12T17:15:22.283210+0000","last_peered":"2024-09-12T17:15:22.283210+0000","last_clean":"2024-09-12T17:15:22.283210+0000","last_became_active":"2024-09-12T17:11:04.698505+0000","last_became_peered":"2024-09-12T17:11:04.698505+0000","last_unstale":"2024-09-12T17:15:22.283210+0000","last_undegraded":"2024-09-12T17:15:22.283210+0000","last_fullsized":"2024-09-12T17:15:22.283210+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:22.282894+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.282894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:08.208753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'8","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.854962+0000","last_change":"2024-09-12T17:15:27.854962+0000","last_active":"2024-09-12T17:15:27.854962+0000","last_peered":"2024-09-12T17:15:27.854962+0000","last_clean":"2024-09-12T17:15:27.854962+0000","last_became_active":"2024-09-12T17:11:06.697417+0000","last_became_peered":"2024-09-12T17:11:06.697417+0000","last_unstale":"2024-09-12T17:15:27.854962+0000","last_undegraded":"2024-09-12T17:15:27.854962+0000","last_fullsized":"2024-09-12T17:15:27.854962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:27.854752+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.854752+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:50.593286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.164774+0000","last_change":"2024-09-12T17:15:07.164616+0000","last_active":"2024-09-12T17:15:07.164774+0000","last_peered":"2024-09-12T17:15:07.164774+0000","last_clean":"2024-09-12T17:15:07.164774+0000","last_became_active":"2024-09-12T17:11:04.669793+0000","last_became_peered":"2024-09-12T17:11:04.669793+0000","last_unstale":"2024-09-12T17:15:07.164774+0000","last_undegraded":"2024-09-12T17:15:07.164774+0000","last_fullsized":"2024-09-12T17:15:07.164774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.164431+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.164431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:00.603011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'14","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.381876+0000","last_change":"2024-09-12T17:15:39.381876+0000","last_active":"2024-09-12T17:15:39.381876+0000","last_peered":"2024-09-12T17:15:39.381876+0000","last_clean":"2024-09-12T17:15:39.381876+0000","last_became_active":"2024-09-12T17:11:06.707884+0000","last_became_peered":"2024-09-12T17:11:06.707884+0000","last_unstale":"2024-09-12T17:15:39.381876+0000","last_undegraded":"2024-09-12T17:15:39.381876+0000","last_fullsized":"2024-09-12T17:15:39.381876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:39.381696+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.381696+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:07:28.508456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.293484+0000","last_change":"2024-09-12T17:15:23.293319+0000","last_active":"2024-09-12T17:15:23.293484+0000","last_peered":"2024-09-12T17:15:23.293484+0000","last_clean":"2024-09-12T17:15:23.293484+0000","last_became_active":"2024-09-12T17:11:04.694542+0000","last_became_peered":"2024-09-12T17:11:04.694542+0000","last_unstale":"2024-09-12T17:15:23.293484+0000","last_undegraded":"2024-09-12T17:15:23.293484+0000","last_fullsized":"2024-09-12T17:15:23.293484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:23.293137+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.293137+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:49.114945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.127964+0000","last_change":"2024-09-12T17:15:23.127964+0000","last_active":"2024-09-12T17:15:23.127964+0000","last_peered":"2024-09-12T17:15:23.127964+0000","last_clean":"2024-09-12T17:15:23.127964+0000","last_became_active":"2024-09-12T17:11:06.694282+0000","last_became_peered":"2024-09-12T17:11:06.694282+0000","last_unstale":"2024-09-12T17:15:23.127964+0000","last_undegraded":"2024-09-12T17:15:23.127964+0000","last_fullsized":"2024-09-12T17:15:23.127964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:23.127781+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.127781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:57.207825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.599502+0000","last_change":"2024-09-12T17:15:09.599330+0000","last_active":"2024-09-12T17:15:09.599502+0000","last_peered":"2024-09-12T17:15:09.599502+0000","last_clean":"2024-09-12T17:15:09.599502+0000","last_became_active":"2024-09-12T17:11:04.674416+0000","last_became_peered":"2024-09-12T17:11:04.674416+0000","last_unstale":"2024-09-12T17:15:09.599502+0000","last_undegraded":"2024-09-12T17:15:09.599502+0000","last_fullsized":"2024-09-12T17:15:09.599502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:09.599149+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.599149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:05.569735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'6","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.044367+0000","last_change":"2024-09-12T17:15:25.044367+0000","last_active":"2024-09-12T17:15:25.044367+0000","last_peered":"2024-09-12T17:15:25.044367+0000","last_clean":"2024-09-12T17:15:25.044367+0000","last_became_active":"2024-09-12T17:11:06.699802+0000","last_became_peered":"2024-09-12T17:11:06.699802+0000","last_unstale":"2024-09-12T17:15:25.044367+0000","last_undegraded":"2024-09-12T17:15:25.044367+0000","last_fullsized":"2024-09-12T17:15:25.044367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:25.044184+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.044184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:49.581742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.401201+0000","last_change":"2024-09-12T17:15:37.401065+0000","last_active":"2024-09-12T17:15:37.401201+0000","last_peered":"2024-09-12T17:15:37.401201+0000","last_clean":"2024-09-12T17:15:37.401201+0000","last_became_active":"2024-09-12T17:11:06.691191+0000","last_became_peered":"2024-09-12T17:11:06.691191+0000","last_unstale":"2024-09-12T17:15:37.401201+0000","last_undegraded":"2024-09-12T17:15:37.401201+0000","last_fullsized":"2024-09-12T17:15:37.401201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:37.400885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.400885+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:38.552754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":53,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.870421+0000","last_change":"2024-09-12T17:15:08.870146+0000","last_active":"2024-09-12T17:15:08.870421+0000","last_peered":"2024-09-12T17:15:08.870421+0000","last_clean":"2024-09-12T17:15:08.870421+0000","last_became_active":"2024-09-12T17:11:04.677892+0000","last_became_peered":"2024-09-12T17:11:04.677892+0000","last_unstale":"2024-09-12T17:15:08.870421+0000","last_undegraded":"2024-09-12T17:15:08.870421+0000","last_fullsized":"2024-09-12T17:15:08.870421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.869833+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.869833+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:16.744295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.845610+0000","last_change":"2024-09-12T17:15:23.845462+0000","last_active":"2024-09-12T17:15:23.845610+0000","last_peered":"2024-09-12T17:15:23.845610+0000","last_clean":"2024-09-12T17:15:23.845610+0000","last_became_active":"2024-09-12T17:11:06.697325+0000","last_became_peered":"2024-09-12T17:11:06.697325+0000","last_unstale":"2024-09-12T17:15:23.845610+0000","last_undegraded":"2024-09-12T17:15:23.845610+0000","last_fullsized":"2024-09-12T17:15:23.845610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:23.845288+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.845288+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.261304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.197797+0000","last_change":"2024-09-12T17:15:08.197517+0000","last_active":"2024-09-12T17:15:08.197797+0000","last_peered":"2024-09-12T17:15:08.197797+0000","last_clean":"2024-09-12T17:15:08.197797+0000","last_became_active":"2024-09-12T17:11:04.697500+0000","last_became_peered":"2024-09-12T17:11:04.697500+0000","last_unstale":"2024-09-12T17:15:08.197797+0000","last_undegraded":"2024-09-12T17:15:08.197797+0000","last_fullsized":"2024-09-12T17:15:08.197797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:08.197226+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.197226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:47.048616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.879965+0000","last_change":"2024-09-12T17:15:24.879802+0000","last_active":"2024-09-12T17:15:24.879965+0000","last_peered":"2024-09-12T17:15:24.879965+0000","last_clean":"2024-09-12T17:15:24.879965+0000","last_became_active":"2024-09-12T17:11:06.702168+0000","last_became_peered":"2024-09-12T17:11:06.702168+0000","last_unstale":"2024-09-12T17:15:24.879965+0000","last_undegraded":"2024-09-12T17:15:24.879965+0000","last_fullsized":"2024-09-12T17:15:24.879965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:24.879626+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.879626+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:47.997644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.892682+0000","last_change":"2024-09-12T17:15:07.892541+0000","last_active":"2024-09-12T17:15:07.892682+0000","last_peered":"2024-09-12T17:15:07.892682+0000","last_clean":"2024-09-12T17:15:07.892682+0000","last_became_active":"2024-09-12T17:11:04.693333+0000","last_became_peered":"2024-09-12T17:11:04.693333+0000","last_unstale":"2024-09-12T17:15:07.892682+0000","last_undegraded":"2024-09-12T17:15:07.892682+0000","last_fullsized":"2024-09-12T17:15:07.892682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:07.892360+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.892360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:31.964096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:23.648964+0000","last_change":"2024-09-12T17:15:23.648776+0000","last_active":"2024-09-12T17:15:23.648964+0000","last_peered":"2024-09-12T17:15:23.648964+0000","last_clean":"2024-09-12T17:15:23.648964+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:23.648964+0000","last_undegraded":"2024-09-12T17:15:23.648964+0000","last_fullsized":"2024-09-12T17:15:23.648964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:23.648589+0000","last_clean_scrub_stamp":"2024-09-12T17:15:23.648589+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:28.617881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.918542+0000","last_change":"2024-09-12T17:15:06.918374+0000","last_active":"2024-09-12T17:15:06.918542+0000","last_peered":"2024-09-12T17:15:06.918542+0000","last_clean":"2024-09-12T17:15:06.918542+0000","last_became_active":"2024-09-12T17:11:04.668995+0000","last_became_peered":"2024-09-12T17:11:04.668995+0000","last_unstale":"2024-09-12T17:15:06.918542+0000","last_undegraded":"2024-09-12T17:15:06.918542+0000","last_fullsized":"2024-09-12T17:15:06.918542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:06.918133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.918133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:39.266087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'12","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.164173+0000","last_change":"2024-09-12T17:15:22.163926+0000","last_active":"2024-09-12T17:15:22.164173+0000","last_peered":"2024-09-12T17:15:22.164173+0000","last_clean":"2024-09-12T17:15:22.164173+0000","last_became_active":"2024-09-12T17:11:06.699771+0000","last_became_peered":"2024-09-12T17:11:06.699771+0000","last_unstale":"2024-09-12T17:15:22.164173+0000","last_undegraded":"2024-09-12T17:15:22.164173+0000","last_fullsized":"2024-09-12T17:15:22.164173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:22.163684+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.163684+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:25.007706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.559377+0000","last_change":"2024-09-12T17:15:08.559195+0000","last_active":"2024-09-12T17:15:08.559377+0000","last_peered":"2024-09-12T17:15:08.559377+0000","last_clean":"2024-09-12T17:15:08.559377+0000","last_became_active":"2024-09-12T17:11:04.683397+0000","last_became_peered":"2024-09-12T17:11:04.683397+0000","last_unstale":"2024-09-12T17:15:08.559377+0000","last_undegraded":"2024-09-12T17:15:08.559377+0000","last_fullsized":"2024-09-12T17:15:08.559377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:08.558975+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.558975+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:43.680852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.841596+0000","last_change":"2024-09-12T17:15:25.841423+0000","last_active":"2024-09-12T17:15:25.841596+0000","last_peered":"2024-09-12T17:15:25.841596+0000","last_clean":"2024-09-12T17:15:25.841596+0000","last_became_active":"2024-09-12T17:11:06.701803+0000","last_became_peered":"2024-09-12T17:11:06.701803+0000","last_unstale":"2024-09-12T17:15:25.841596+0000","last_undegraded":"2024-09-12T17:15:25.841596+0000","last_fullsized":"2024-09-12T17:15:25.841596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:25.841247+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.841247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:51.853720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.330124+0000","last_change":"2024-09-12T17:15:19.329873+0000","last_active":"2024-09-12T17:15:19.330124+0000","last_peered":"2024-09-12T17:15:19.330124+0000","last_clean":"2024-09-12T17:15:19.330124+0000","last_became_active":"2024-09-12T17:11:04.693069+0000","last_became_peered":"2024-09-12T17:11:04.693069+0000","last_unstale":"2024-09-12T17:15:19.330124+0000","last_undegraded":"2024-09-12T17:15:19.330124+0000","last_fullsized":"2024-09-12T17:15:19.330124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:19.329648+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.329648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:58:26.468038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'40","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.831038+0000","last_change":"2024-09-12T17:15:54.830899+0000","last_active":"2024-09-12T17:15:54.831038+0000","last_peered":"2024-09-12T17:15:54.831038+0000","last_clean":"2024-09-12T17:15:54.831038+0000","last_became_active":"2024-09-12T17:11:14.772925+0000","last_became_peered":"2024-09-12T17:11:14.772925+0000","last_unstale":"2024-09-12T17:15:54.831038+0000","last_undegraded":"2024-09-12T17:15:54.831038+0000","last_fullsized":"2024-09-12T17:15:54.831038+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T17:15:54.830688+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T17:15:54.830688+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.830688+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:37.434094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":177,"num_write":107,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.310849+0000","last_change":"2024-09-12T17:15:31.310675+0000","last_active":"2024-09-12T17:15:31.310849+0000","last_peered":"2024-09-12T17:15:31.310849+0000","last_clean":"2024-09-12T17:15:31.310849+0000","last_became_active":"2024-09-12T17:11:06.695058+0000","last_became_peered":"2024-09-12T17:11:06.695058+0000","last_unstale":"2024-09-12T17:15:31.310849+0000","last_undegraded":"2024-09-12T17:15:31.310849+0000","last_fullsized":"2024-09-12T17:15:31.310849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:31.310493+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.310493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:52.984419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:08.263490+0000","last_change":"2024-09-12T17:15:08.263324+0000","last_active":"2024-09-12T17:15:08.263490+0000","last_peered":"2024-09-12T17:15:08.263490+0000","last_clean":"2024-09-12T17:15:08.263490+0000","last_became_active":"2024-09-12T17:11:04.702482+0000","last_became_peered":"2024-09-12T17:11:04.702482+0000","last_unstale":"2024-09-12T17:15:08.263490+0000","last_undegraded":"2024-09-12T17:15:08.263490+0000","last_fullsized":"2024-09-12T17:15:08.263490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:08.263141+0000","last_clean_scrub_stamp":"2024-09-12T17:15:08.263141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:50.866547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.402456+0000","last_change":"2024-09-12T17:15:47.402317+0000","last_active":"2024-09-12T17:15:47.402456+0000","last_peered":"2024-09-12T17:15:47.402456+0000","last_clean":"2024-09-12T17:15:47.402456+0000","last_became_active":"2024-09-12T17:11:08.727222+0000","last_became_peered":"2024-09-12T17:11:08.727222+0000","last_unstale":"2024-09-12T17:15:47.402456+0000","last_undegraded":"2024-09-12T17:15:47.402456+0000","last_fullsized":"2024-09-12T17:15:47.402456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.402138+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.402138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:47.917779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:57.253327+0000","last_change":"2024-09-12T17:15:57.253178+0000","last_active":"2024-09-12T17:15:57.253327+0000","last_peered":"2024-09-12T17:15:57.253327+0000","last_clean":"2024-09-12T17:15:57.253327+0000","last_became_active":"2024-09-12T17:11:10.744876+0000","last_became_peered":"2024-09-12T17:11:10.744876+0000","last_unstale":"2024-09-12T17:15:57.253327+0000","last_undegraded":"2024-09-12T17:15:57.253327+0000","last_fullsized":"2024-09-12T17:15:57.253327+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:57.252992+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:57.252992+0000","last_clean_scrub_stamp":"2024-09-12T17:15:57.252992+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:43.291280+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.865973+0000","last_change":"2024-09-12T17:15:49.865702+0000","last_active":"2024-09-12T17:15:49.865973+0000","last_peered":"2024-09-12T17:15:49.865973+0000","last_clean":"2024-09-12T17:15:49.865973+0000","last_became_active":"2024-09-12T17:11:12.753650+0000","last_became_peered":"2024-09-12T17:11:12.753650+0000","last_unstale":"2024-09-12T17:15:49.865973+0000","last_undegraded":"2024-09-12T17:15:49.865973+0000","last_fullsized":"2024-09-12T17:15:49.865973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.865463+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.865463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:58:43.752559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.856866+0000","last_change":"2024-09-12T17:15:56.856681+0000","last_active":"2024-09-12T17:15:56.856866+0000","last_peered":"2024-09-12T17:15:56.856866+0000","last_clean":"2024-09-12T17:15:56.856866+0000","last_became_active":"2024-09-12T17:11:14.765653+0000","last_became_peered":"2024-09-12T17:11:14.765653+0000","last_unstale":"2024-09-12T17:15:56.856866+0000","last_undegraded":"2024-09-12T17:15:56.856866+0000","last_fullsized":"2024-09-12T17:15:56.856866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:56.856509+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:56.856509+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.856509+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:59.021075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.328569+0000","last_change":"2024-09-12T17:15:30.328446+0000","last_active":"2024-09-12T17:15:30.328569+0000","last_peered":"2024-09-12T17:15:30.328569+0000","last_clean":"2024-09-12T17:15:30.328569+0000","last_became_active":"2024-09-12T17:11:06.695428+0000","last_became_peered":"2024-09-12T17:11:06.695428+0000","last_unstale":"2024-09-12T17:15:30.328569+0000","last_undegraded":"2024-09-12T17:15:30.328569+0000","last_fullsized":"2024-09-12T17:15:30.328569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:30.328228+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.328228+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.601658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.272407+0000","last_change":"2024-09-12T17:15:01.272260+0000","last_active":"2024-09-12T17:15:01.272407+0000","last_peered":"2024-09-12T17:15:01.272407+0000","last_clean":"2024-09-12T17:15:01.272407+0000","last_became_active":"2024-09-12T17:11:04.663718+0000","last_became_peered":"2024-09-12T17:11:04.663718+0000","last_unstale":"2024-09-12T17:15:01.272407+0000","last_undegraded":"2024-09-12T17:15:01.272407+0000","last_fullsized":"2024-09-12T17:15:01.272407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.272070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.272070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:13:11.536461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.670280+0000","last_change":"2024-09-12T17:15:30.670135+0000","last_active":"2024-09-12T17:15:30.670280+0000","last_peered":"2024-09-12T17:15:30.670280+0000","last_clean":"2024-09-12T17:15:30.670280+0000","last_became_active":"2024-09-12T17:11:08.713827+0000","last_became_peered":"2024-09-12T17:11:08.713827+0000","last_unstale":"2024-09-12T17:15:30.670280+0000","last_undegraded":"2024-09-12T17:15:30.670280+0000","last_fullsized":"2024-09-12T17:15:30.670280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.669946+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.669946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:54.167361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"34'10","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.887726+0000","last_change":"2024-09-12T17:15:41.887582+0000","last_active":"2024-09-12T17:15:41.887726+0000","last_peered":"2024-09-12T17:15:41.887726+0000","last_clean":"2024-09-12T17:15:41.887726+0000","last_became_active":"2024-09-12T17:11:10.720254+0000","last_became_peered":"2024-09-12T17:11:10.720254+0000","last_unstale":"2024-09-12T17:15:41.887726+0000","last_undegraded":"2024-09-12T17:15:41.887726+0000","last_fullsized":"2024-09-12T17:15:41.887726+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:41.887381+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.887381+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:40.760250+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.795751+0000","last_change":"2024-09-12T17:15:46.795609+0000","last_active":"2024-09-12T17:15:46.795751+0000","last_peered":"2024-09-12T17:15:46.795751+0000","last_clean":"2024-09-12T17:15:46.795751+0000","last_became_active":"2024-09-12T17:11:12.754124+0000","last_became_peered":"2024-09-12T17:11:12.754124+0000","last_unstale":"2024-09-12T17:15:46.795751+0000","last_undegraded":"2024-09-12T17:15:46.795751+0000","last_fullsized":"2024-09-12T17:15:46.795751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.795426+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.795426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:26.633699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.519903+0000","last_change":"2024-09-12T17:15:55.519755+0000","last_active":"2024-09-12T17:15:55.519903+0000","last_peered":"2024-09-12T17:15:55.519903+0000","last_clean":"2024-09-12T17:15:55.519903+0000","last_became_active":"2024-09-12T17:11:14.777807+0000","last_became_peered":"2024-09-12T17:11:14.777807+0000","last_unstale":"2024-09-12T17:15:55.519903+0000","last_undegraded":"2024-09-12T17:15:55.519903+0000","last_fullsized":"2024-09-12T17:15:55.519903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:55.519568+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:55.519568+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.519568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:39.598516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'8","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.332161+0000","last_change":"2024-09-12T17:15:32.331908+0000","last_active":"2024-09-12T17:15:32.332161+0000","last_peered":"2024-09-12T17:15:32.332161+0000","last_clean":"2024-09-12T17:15:32.332161+0000","last_became_active":"2024-09-12T17:11:06.693086+0000","last_became_peered":"2024-09-12T17:11:06.693086+0000","last_unstale":"2024-09-12T17:15:32.332161+0000","last_undegraded":"2024-09-12T17:15:32.332161+0000","last_fullsized":"2024-09-12T17:15:32.332161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:32.331702+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.331702+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:50.106105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.310265+0000","last_change":"2024-09-12T17:15:07.310022+0000","last_active":"2024-09-12T17:15:07.310265+0000","last_peered":"2024-09-12T17:15:07.310265+0000","last_clean":"2024-09-12T17:15:07.310265+0000","last_became_active":"2024-09-12T17:11:04.698549+0000","last_became_peered":"2024-09-12T17:11:04.698549+0000","last_unstale":"2024-09-12T17:15:07.310265+0000","last_undegraded":"2024-09-12T17:15:07.310265+0000","last_fullsized":"2024-09-12T17:15:07.310265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.309797+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.309797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:17.281335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.657020+0000","last_change":"2024-09-12T17:15:31.656874+0000","last_active":"2024-09-12T17:15:31.657020+0000","last_peered":"2024-09-12T17:15:31.657020+0000","last_clean":"2024-09-12T17:15:31.657020+0000","last_became_active":"2024-09-12T17:11:08.702821+0000","last_became_peered":"2024-09-12T17:11:08.702821+0000","last_unstale":"2024-09-12T17:15:31.657020+0000","last_undegraded":"2024-09-12T17:15:31.657020+0000","last_fullsized":"2024-09-12T17:15:31.657020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:31.656700+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.656700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:53.215267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.996303+0000","last_change":"2024-09-12T17:15:35.996162+0000","last_active":"2024-09-12T17:15:35.996303+0000","last_peered":"2024-09-12T17:15:35.996303+0000","last_clean":"2024-09-12T17:15:35.996303+0000","last_became_active":"2024-09-12T17:11:10.751107+0000","last_became_peered":"2024-09-12T17:11:10.751107+0000","last_unstale":"2024-09-12T17:15:35.996303+0000","last_undegraded":"2024-09-12T17:15:35.996303+0000","last_fullsized":"2024-09-12T17:15:35.996303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:15:35.995960+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.995960+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:28.485115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'286","reported_seq":396,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:07.322693+0000","last_change":"2024-09-12T17:16:07.322693+0000","last_active":"2024-09-12T17:16:07.322693+0000","last_peered":"2024-09-12T17:16:07.322693+0000","last_clean":"2024-09-12T17:16:07.322693+0000","last_became_active":"2024-09-12T17:11:12.744861+0000","last_became_peered":"2024-09-12T17:11:12.744861+0000","last_unstale":"2024-09-12T17:16:07.322693+0000","last_undegraded":"2024-09-12T17:16:07.322693+0000","last_fullsized":"2024-09-12T17:16:07.322693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:16:07.322485+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:16:07.322485+0000","last_clean_scrub_stamp":"2024-09-12T17:16:07.322485+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:41.513150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.957683+0000","last_change":"2024-09-12T17:15:48.957435+0000","last_active":"2024-09-12T17:15:48.957683+0000","last_peered":"2024-09-12T17:15:48.957683+0000","last_clean":"2024-09-12T17:15:48.957683+0000","last_became_active":"2024-09-12T17:11:14.777037+0000","last_became_peered":"2024-09-12T17:11:14.777037+0000","last_unstale":"2024-09-12T17:15:48.957683+0000","last_undegraded":"2024-09-12T17:15:48.957683+0000","last_fullsized":"2024-09-12T17:15:48.957683+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.957213+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.957213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:30:34.560093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.646256+0000","last_change":"2024-09-12T17:15:13.646081+0000","last_active":"2024-09-12T17:15:13.646256+0000","last_peered":"2024-09-12T17:15:13.646256+0000","last_clean":"2024-09-12T17:15:13.646256+0000","last_became_active":"2024-09-12T17:11:06.709311+0000","last_became_peered":"2024-09-12T17:11:06.709311+0000","last_unstale":"2024-09-12T17:15:13.646256+0000","last_undegraded":"2024-09-12T17:15:13.646256+0000","last_fullsized":"2024-09-12T17:15:13.646256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:13.645895+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.645895+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:58.844204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.911092+0000","last_change":"2024-09-12T17:14:57.910932+0000","last_active":"2024-09-12T17:14:57.911092+0000","last_peered":"2024-09-12T17:14:57.911092+0000","last_clean":"2024-09-12T17:14:57.911092+0000","last_became_active":"2024-09-12T17:11:04.664858+0000","last_became_peered":"2024-09-12T17:11:04.664858+0000","last_unstale":"2024-09-12T17:14:57.911092+0000","last_undegraded":"2024-09-12T17:14:57.911092+0000","last_fullsized":"2024-09-12T17:14:57.911092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:14:57.910723+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.910723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:55.914281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.357958+0000","last_change":"2024-09-12T17:15:46.357811+0000","last_active":"2024-09-12T17:15:46.357958+0000","last_peered":"2024-09-12T17:15:46.357958+0000","last_clean":"2024-09-12T17:15:46.357958+0000","last_became_active":"2024-09-12T17:11:08.728812+0000","last_became_peered":"2024-09-12T17:11:08.728812+0000","last_unstale":"2024-09-12T17:15:46.357958+0000","last_undegraded":"2024-09-12T17:15:46.357958+0000","last_fullsized":"2024-09-12T17:15:46.357958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.357635+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.357635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:16.965443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.978908+0000","last_change":"2024-09-12T17:15:36.978732+0000","last_active":"2024-09-12T17:15:36.978908+0000","last_peered":"2024-09-12T17:15:36.978908+0000","last_clean":"2024-09-12T17:15:36.978908+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.978908+0000","last_undegraded":"2024-09-12T17:15:36.978908+0000","last_fullsized":"2024-09-12T17:15:36.978908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'39","last_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_deep_scrub":"34'39","last_deep_scrub_stamp":"2024-09-12T17:15:36.978491+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.978491+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:46.317803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":53,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'286","reported_seq":420,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.644683+0000","last_change":"2024-09-12T17:15:48.644518+0000","last_active":"2024-09-12T17:15:48.644683+0000","last_peered":"2024-09-12T17:15:48.644683+0000","last_clean":"2024-09-12T17:15:48.644683+0000","last_became_active":"2024-09-12T17:11:12.748032+0000","last_became_peered":"2024-09-12T17:11:12.748032+0000","last_unstale":"2024-09-12T17:15:48.644683+0000","last_undegraded":"2024-09-12T17:15:48.644683+0000","last_fullsized":"2024-09-12T17:15:48.644683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:48.644337+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.644337+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:12.300130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.270515+0000","last_change":"2024-09-12T17:15:27.270380+0000","last_active":"2024-09-12T17:15:27.270515+0000","last_peered":"2024-09-12T17:15:27.270515+0000","last_clean":"2024-09-12T17:15:27.270515+0000","last_became_active":"2024-09-12T17:11:06.688989+0000","last_became_peered":"2024-09-12T17:11:06.688989+0000","last_unstale":"2024-09-12T17:15:27.270515+0000","last_undegraded":"2024-09-12T17:15:27.270515+0000","last_fullsized":"2024-09-12T17:15:27.270515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:27.270201+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.270201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:34.314251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.252770+0000","last_change":"2024-09-12T17:15:00.252598+0000","last_active":"2024-09-12T17:15:00.252770+0000","last_peered":"2024-09-12T17:15:00.252770+0000","last_clean":"2024-09-12T17:15:00.252770+0000","last_became_active":"2024-09-12T17:11:04.670045+0000","last_became_peered":"2024-09-12T17:11:04.670045+0000","last_unstale":"2024-09-12T17:15:00.252770+0000","last_undegraded":"2024-09-12T17:15:00.252770+0000","last_fullsized":"2024-09-12T17:15:00.252770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:00.252406+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.252406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:21.057375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.845483+0000","last_change":"2024-09-12T17:15:28.845304+0000","last_active":"2024-09-12T17:15:28.845483+0000","last_peered":"2024-09-12T17:15:28.845483+0000","last_clean":"2024-09-12T17:15:28.845483+0000","last_became_active":"2024-09-12T17:11:08.711373+0000","last_became_peered":"2024-09-12T17:11:08.711373+0000","last_unstale":"2024-09-12T17:15:28.845483+0000","last_undegraded":"2024-09-12T17:15:28.845483+0000","last_fullsized":"2024-09-12T17:15:28.845483+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.845128+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.845128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:16:39.718369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'53","reported_seq":114,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.096929+0000","last_change":"2024-09-12T17:15:33.096929+0000","last_active":"2024-09-12T17:15:33.096929+0000","last_peered":"2024-09-12T17:15:33.096929+0000","last_clean":"2024-09-12T17:15:33.096929+0000","last_became_active":"2024-09-12T17:11:10.721443+0000","last_became_peered":"2024-09-12T17:11:10.721443+0000","last_unstale":"2024-09-12T17:15:33.096929+0000","last_undegraded":"2024-09-12T17:15:33.096929+0000","last_fullsized":"2024-09-12T17:15:33.096929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'53","last_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_deep_scrub":"34'53","last_deep_scrub_stamp":"2024-09-12T17:15:33.096724+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.096724+0000","objects_scrubbed":9,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:45.936243+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.659187+0000","last_change":"2024-09-12T17:15:46.659187+0000","last_active":"2024-09-12T17:15:46.659187+0000","last_peered":"2024-09-12T17:15:46.659187+0000","last_clean":"2024-09-12T17:15:46.659187+0000","last_became_active":"2024-09-12T17:11:12.748559+0000","last_became_peered":"2024-09-12T17:11:12.748559+0000","last_unstale":"2024-09-12T17:15:46.659187+0000","last_undegraded":"2024-09-12T17:15:46.659187+0000","last_fullsized":"2024-09-12T17:15:46.659187+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:46.659004+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.659004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:41.104711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.953689+0000","last_change":"2024-09-12T17:15:44.953689+0000","last_active":"2024-09-12T17:15:44.953689+0000","last_peered":"2024-09-12T17:15:44.953689+0000","last_clean":"2024-09-12T17:15:44.953689+0000","last_became_active":"2024-09-12T17:11:14.778282+0000","last_became_peered":"2024-09-12T17:11:14.778282+0000","last_unstale":"2024-09-12T17:15:44.953689+0000","last_undegraded":"2024-09-12T17:15:44.953689+0000","last_fullsized":"2024-09-12T17:15:44.953689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:44.953466+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.953466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:43.780448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.886220+0000","last_change":"2024-09-12T17:15:11.886035+0000","last_active":"2024-09-12T17:15:11.886220+0000","last_peered":"2024-09-12T17:15:11.886220+0000","last_clean":"2024-09-12T17:15:11.886220+0000","last_became_active":"2024-09-12T17:11:06.688733+0000","last_became_peered":"2024-09-12T17:11:06.688733+0000","last_unstale":"2024-09-12T17:15:11.886220+0000","last_undegraded":"2024-09-12T17:15:11.886220+0000","last_fullsized":"2024-09-12T17:15:11.886220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:11.885853+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.885853+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:32.791985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.230761+0000","last_change":"2024-09-12T17:14:58.230528+0000","last_active":"2024-09-12T17:14:58.230761+0000","last_peered":"2024-09-12T17:14:58.230761+0000","last_clean":"2024-09-12T17:14:58.230761+0000","last_became_active":"2024-09-12T17:11:04.673005+0000","last_became_peered":"2024-09-12T17:11:04.673005+0000","last_unstale":"2024-09-12T17:14:58.230761+0000","last_undegraded":"2024-09-12T17:14:58.230761+0000","last_fullsized":"2024-09-12T17:14:58.230761+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:14:58.230294+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.230294+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:55.690708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.679025+0000","last_change":"2024-09-12T17:15:26.678715+0000","last_active":"2024-09-12T17:15:26.679025+0000","last_peered":"2024-09-12T17:15:26.679025+0000","last_clean":"2024-09-12T17:15:26.679025+0000","last_became_active":"2024-09-12T17:11:08.702841+0000","last_became_peered":"2024-09-12T17:11:08.702841+0000","last_unstale":"2024-09-12T17:15:26.679025+0000","last_undegraded":"2024-09-12T17:15:26.679025+0000","last_fullsized":"2024-09-12T17:15:26.679025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.678505+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.678505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:32.805993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.325569+0000","last_change":"2024-09-12T17:15:55.325569+0000","last_active":"2024-09-12T17:15:55.325569+0000","last_peered":"2024-09-12T17:15:55.325569+0000","last_clean":"2024-09-12T17:15:55.325569+0000","last_became_active":"2024-09-12T17:11:10.741906+0000","last_became_peered":"2024-09-12T17:11:10.741906+0000","last_unstale":"2024-09-12T17:15:55.325569+0000","last_undegraded":"2024-09-12T17:15:55.325569+0000","last_fullsized":"2024-09-12T17:15:55.325569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:55.325481+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:55.325481+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.325481+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:28.728223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.632043+0000","last_change":"2024-09-12T17:15:45.632043+0000","last_active":"2024-09-12T17:15:45.632043+0000","last_peered":"2024-09-12T17:15:45.632043+0000","last_clean":"2024-09-12T17:15:45.632043+0000","last_became_active":"2024-09-12T17:11:12.756427+0000","last_became_peered":"2024-09-12T17:11:12.756427+0000","last_unstale":"2024-09-12T17:15:45.632043+0000","last_undegraded":"2024-09-12T17:15:45.632043+0000","last_fullsized":"2024-09-12T17:15:45.632043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.631841+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.631841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:06:33.615088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.860807+0000","last_change":"2024-09-12T17:15:52.860807+0000","last_active":"2024-09-12T17:15:52.860807+0000","last_peered":"2024-09-12T17:15:52.860807+0000","last_clean":"2024-09-12T17:15:52.860807+0000","last_became_active":"2024-09-12T17:11:14.767764+0000","last_became_peered":"2024-09-12T17:11:14.767764+0000","last_unstale":"2024-09-12T17:15:52.860807+0000","last_undegraded":"2024-09-12T17:15:52.860807+0000","last_fullsized":"2024-09-12T17:15:52.860807+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:52.860623+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.860623+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:37.942810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.156810+0000","last_change":"2024-09-12T17:15:12.156505+0000","last_active":"2024-09-12T17:15:12.156810+0000","last_peered":"2024-09-12T17:15:12.156810+0000","last_clean":"2024-09-12T17:15:12.156810+0000","last_became_active":"2024-09-12T17:11:06.696050+0000","last_became_peered":"2024-09-12T17:11:06.696050+0000","last_unstale":"2024-09-12T17:15:12.156810+0000","last_undegraded":"2024-09-12T17:15:12.156810+0000","last_fullsized":"2024-09-12T17:15:12.156810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.156239+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.156239+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:25.415656+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.347019+0000","last_change":"2024-09-12T17:15:06.346855+0000","last_active":"2024-09-12T17:15:06.347019+0000","last_peered":"2024-09-12T17:15:06.347019+0000","last_clean":"2024-09-12T17:15:06.347019+0000","last_became_active":"2024-09-12T17:11:04.701804+0000","last_became_peered":"2024-09-12T17:11:04.701804+0000","last_unstale":"2024-09-12T17:15:06.347019+0000","last_undegraded":"2024-09-12T17:15:06.347019+0000","last_fullsized":"2024-09-12T17:15:06.347019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:06.346636+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.346636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:07:51.428823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.667241+0000","last_change":"2024-09-12T17:15:29.667097+0000","last_active":"2024-09-12T17:15:29.667241+0000","last_peered":"2024-09-12T17:15:29.667241+0000","last_clean":"2024-09-12T17:15:29.667241+0000","last_became_active":"2024-09-12T17:11:08.702612+0000","last_became_peered":"2024-09-12T17:11:08.702612+0000","last_unstale":"2024-09-12T17:15:29.667241+0000","last_undegraded":"2024-09-12T17:15:29.667241+0000","last_fullsized":"2024-09-12T17:15:29.667241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.666868+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.666868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:49.783995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.337208+0000","last_change":"2024-09-12T17:15:53.337208+0000","last_active":"2024-09-12T17:15:53.337208+0000","last_peered":"2024-09-12T17:15:53.337208+0000","last_clean":"2024-09-12T17:15:53.337208+0000","last_became_active":"2024-09-12T17:11:10.742022+0000","last_became_peered":"2024-09-12T17:11:10.742022+0000","last_unstale":"2024-09-12T17:15:53.337208+0000","last_undegraded":"2024-09-12T17:15:53.337208+0000","last_fullsized":"2024-09-12T17:15:53.337208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:53.337017+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.337017+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:23.840226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'286","reported_seq":363,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.678644+0000","last_change":"2024-09-12T17:15:44.678644+0000","last_active":"2024-09-12T17:15:44.678644+0000","last_peered":"2024-09-12T17:15:44.678644+0000","last_clean":"2024-09-12T17:15:44.678644+0000","last_became_active":"2024-09-12T17:11:12.747730+0000","last_became_peered":"2024-09-12T17:11:12.747730+0000","last_unstale":"2024-09-12T17:15:44.678644+0000","last_undegraded":"2024-09-12T17:15:44.678644+0000","last_fullsized":"2024-09-12T17:15:44.678644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.678458+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.678458+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:47:12.551543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.559131+0000","last_change":"2024-09-12T17:15:52.559131+0000","last_active":"2024-09-12T17:15:52.559131+0000","last_peered":"2024-09-12T17:15:52.559131+0000","last_clean":"2024-09-12T17:15:52.559131+0000","last_became_active":"2024-09-12T17:11:14.782021+0000","last_became_peered":"2024-09-12T17:11:14.782021+0000","last_unstale":"2024-09-12T17:15:52.559131+0000","last_undegraded":"2024-09-12T17:15:52.559131+0000","last_fullsized":"2024-09-12T17:15:52.559131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:52.558952+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.558952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:37.731208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.111733+0000","last_change":"2024-09-12T17:15:13.111502+0000","last_active":"2024-09-12T17:15:13.111733+0000","last_peered":"2024-09-12T17:15:13.111733+0000","last_clean":"2024-09-12T17:15:13.111733+0000","last_became_active":"2024-09-12T17:11:06.692273+0000","last_became_peered":"2024-09-12T17:11:06.692273+0000","last_unstale":"2024-09-12T17:15:13.111733+0000","last_undegraded":"2024-09-12T17:15:13.111733+0000","last_fullsized":"2024-09-12T17:15:13.111733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:13.111208+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.111208+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:51.802604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.322359+0000","last_change":"2024-09-12T17:15:15.322215+0000","last_active":"2024-09-12T17:15:15.322359+0000","last_peered":"2024-09-12T17:15:15.322359+0000","last_clean":"2024-09-12T17:15:15.322359+0000","last_became_active":"2024-09-12T17:11:04.705033+0000","last_became_peered":"2024-09-12T17:11:04.705033+0000","last_unstale":"2024-09-12T17:15:15.322359+0000","last_undegraded":"2024-09-12T17:15:15.322359+0000","last_fullsized":"2024-09-12T17:15:15.322359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:15.322029+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.322029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:11:41.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.655138+0000","last_change":"2024-09-12T17:15:27.654987+0000","last_active":"2024-09-12T17:15:27.655138+0000","last_peered":"2024-09-12T17:15:27.655138+0000","last_clean":"2024-09-12T17:15:27.655138+0000","last_became_active":"2024-09-12T17:11:08.717489+0000","last_became_peered":"2024-09-12T17:11:08.717489+0000","last_unstale":"2024-09-12T17:15:27.655138+0000","last_undegraded":"2024-09-12T17:15:27.655138+0000","last_fullsized":"2024-09-12T17:15:27.655138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.654755+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.654755+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:56:35.730679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":140,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.323386+0000","last_change":"2024-09-12T17:15:54.323386+0000","last_active":"2024-09-12T17:15:54.323386+0000","last_peered":"2024-09-12T17:15:54.323386+0000","last_clean":"2024-09-12T17:15:54.323386+0000","last_became_active":"2024-09-12T17:11:10.741838+0000","last_became_peered":"2024-09-12T17:11:10.741838+0000","last_unstale":"2024-09-12T17:15:54.323386+0000","last_undegraded":"2024-09-12T17:15:54.323386+0000","last_fullsized":"2024-09-12T17:15:54.323386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'66","last_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_deep_scrub":"34'66","last_deep_scrub_stamp":"2024-09-12T17:15:54.323183+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.323183+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:10.081001+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.651288+0000","last_change":"2024-09-12T17:15:43.651288+0000","last_active":"2024-09-12T17:15:43.651288+0000","last_peered":"2024-09-12T17:15:43.651288+0000","last_clean":"2024-09-12T17:15:43.651288+0000","last_became_active":"2024-09-12T17:11:12.749901+0000","last_became_peered":"2024-09-12T17:11:12.749901+0000","last_unstale":"2024-09-12T17:15:43.651288+0000","last_undegraded":"2024-09-12T17:15:43.651288+0000","last_fullsized":"2024-09-12T17:15:43.651288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.651107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.651107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:32.997974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.519537+0000","last_change":"2024-09-12T17:15:53.519537+0000","last_active":"2024-09-12T17:15:53.519537+0000","last_peered":"2024-09-12T17:15:53.519537+0000","last_clean":"2024-09-12T17:15:53.519537+0000","last_became_active":"2024-09-12T17:11:14.752283+0000","last_became_peered":"2024-09-12T17:11:14.752283+0000","last_unstale":"2024-09-12T17:15:53.519537+0000","last_undegraded":"2024-09-12T17:15:53.519537+0000","last_fullsized":"2024-09-12T17:15:53.519537+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-09-12T17:15:53.519363+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.519363+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:29.687392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.848775+0000","last_change":"2024-09-12T17:15:12.848522+0000","last_active":"2024-09-12T17:15:12.848775+0000","last_peered":"2024-09-12T17:15:12.848775+0000","last_clean":"2024-09-12T17:15:12.848775+0000","last_became_active":"2024-09-12T17:11:06.705570+0000","last_became_peered":"2024-09-12T17:11:06.705570+0000","last_unstale":"2024-09-12T17:15:12.848775+0000","last_undegraded":"2024-09-12T17:15:12.848775+0000","last_fullsized":"2024-09-12T17:15:12.848775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.848285+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.848285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:44.476233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.570224+0000","last_change":"2024-09-12T17:15:01.570059+0000","last_active":"2024-09-12T17:15:01.570224+0000","last_peered":"2024-09-12T17:15:01.570224+0000","last_clean":"2024-09-12T17:15:01.570224+0000","last_became_active":"2024-09-12T17:11:04.681056+0000","last_became_peered":"2024-09-12T17:11:04.681056+0000","last_unstale":"2024-09-12T17:15:01.570224+0000","last_undegraded":"2024-09-12T17:15:01.570224+0000","last_fullsized":"2024-09-12T17:15:01.570224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.569882+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.569882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:12.460985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.079843+0000","last_change":"2024-09-12T17:15:26.079585+0000","last_active":"2024-09-12T17:15:26.079843+0000","last_peered":"2024-09-12T17:15:26.079843+0000","last_clean":"2024-09-12T17:15:26.079843+0000","last_became_active":"2024-09-12T17:11:08.713304+0000","last_became_peered":"2024-09-12T17:11:08.713304+0000","last_unstale":"2024-09-12T17:15:26.079843+0000","last_undegraded":"2024-09-12T17:15:26.079843+0000","last_fullsized":"2024-09-12T17:15:26.079843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:26.079373+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.079373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:00.776520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.855018+0000","last_change":"2024-09-12T17:15:39.855018+0000","last_active":"2024-09-12T17:15:39.855018+0000","last_peered":"2024-09-12T17:15:39.855018+0000","last_clean":"2024-09-12T17:15:39.855018+0000","last_became_active":"2024-09-12T17:11:10.720312+0000","last_became_peered":"2024-09-12T17:11:10.720312+0000","last_unstale":"2024-09-12T17:15:39.855018+0000","last_undegraded":"2024-09-12T17:15:39.855018+0000","last_fullsized":"2024-09-12T17:15:39.855018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:39.854818+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.854818+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.768653+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:05.359412+0000","last_change":"2024-09-12T17:16:05.359412+0000","last_active":"2024-09-12T17:16:05.359412+0000","last_peered":"2024-09-12T17:16:05.359412+0000","last_clean":"2024-09-12T17:16:05.359412+0000","last_became_active":"2024-09-12T17:11:12.745014+0000","last_became_peered":"2024-09-12T17:11:12.745014+0000","last_unstale":"2024-09-12T17:16:05.359412+0000","last_undegraded":"2024-09-12T17:16:05.359412+0000","last_fullsized":"2024-09-12T17:16:05.359412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:05.359198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:05.359198+0000","last_clean_scrub_stamp":"2024-09-12T17:16:05.359198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:26.308585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:10.295290+0000","last_change":"2024-09-12T17:16:10.295290+0000","last_active":"2024-09-12T17:16:10.295290+0000","last_peered":"2024-09-12T17:16:10.295290+0000","last_clean":"2024-09-12T17:16:10.295290+0000","last_became_active":"2024-09-12T17:11:14.758824+0000","last_became_peered":"2024-09-12T17:11:14.758824+0000","last_unstale":"2024-09-12T17:16:10.295290+0000","last_undegraded":"2024-09-12T17:16:10.295290+0000","last_fullsized":"2024-09-12T17:16:10.295290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:16:10.295068+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:16:10.295068+0000","last_clean_scrub_stamp":"2024-09-12T17:16:10.295068+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:10.307246+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'16","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.307466+0000","last_change":"2024-09-12T17:15:28.307333+0000","last_active":"2024-09-12T17:15:28.307466+0000","last_peered":"2024-09-12T17:15:28.307466+0000","last_clean":"2024-09-12T17:15:28.307466+0000","last_became_active":"2024-09-12T17:11:06.708424+0000","last_became_peered":"2024-09-12T17:11:06.708424+0000","last_unstale":"2024-09-12T17:15:28.307466+0000","last_undegraded":"2024-09-12T17:15:28.307466+0000","last_fullsized":"2024-09-12T17:15:28.307466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:28.307157+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.307157+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:43.614829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.407052+0000","last_change":"2024-09-12T17:15:04.406881+0000","last_active":"2024-09-12T17:15:04.407052+0000","last_peered":"2024-09-12T17:15:04.407052+0000","last_clean":"2024-09-12T17:15:04.407052+0000","last_became_active":"2024-09-12T17:11:04.693037+0000","last_became_peered":"2024-09-12T17:11:04.693037+0000","last_unstale":"2024-09-12T17:15:04.407052+0000","last_undegraded":"2024-09-12T17:15:04.407052+0000","last_fullsized":"2024-09-12T17:15:04.407052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.406686+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.406686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:45.243217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.658405+0000","last_change":"2024-09-12T17:15:28.658287+0000","last_active":"2024-09-12T17:15:28.658405+0000","last_peered":"2024-09-12T17:15:28.658405+0000","last_clean":"2024-09-12T17:15:28.658405+0000","last_became_active":"2024-09-12T17:11:08.717085+0000","last_became_peered":"2024-09-12T17:11:08.717085+0000","last_unstale":"2024-09-12T17:15:28.658405+0000","last_undegraded":"2024-09-12T17:15:28.658405+0000","last_fullsized":"2024-09-12T17:15:28.658405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.658107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.658107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:41.190010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'48","reported_seq":107,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.062564+0000","last_change":"2024-09-12T17:15:34.062414+0000","last_active":"2024-09-12T17:15:34.062564+0000","last_peered":"2024-09-12T17:15:34.062564+0000","last_clean":"2024-09-12T17:15:34.062564+0000","last_became_active":"2024-09-12T17:11:10.721065+0000","last_became_peered":"2024-09-12T17:11:10.721065+0000","last_unstale":"2024-09-12T17:15:34.062564+0000","last_undegraded":"2024-09-12T17:15:34.062564+0000","last_fullsized":"2024-09-12T17:15:34.062564+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-09-12T17:15:34.062221+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.062221+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:19.175698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":49,"num_read_kb":48,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'286","reported_seq":418,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.958125+0000","last_change":"2024-09-12T17:15:39.957861+0000","last_active":"2024-09-12T17:15:39.958125+0000","last_peered":"2024-09-12T17:15:39.958125+0000","last_clean":"2024-09-12T17:15:39.958125+0000","last_became_active":"2024-09-12T17:11:12.752000+0000","last_became_peered":"2024-09-12T17:11:12.752000+0000","last_unstale":"2024-09-12T17:15:39.958125+0000","last_undegraded":"2024-09-12T17:15:39.958125+0000","last_fullsized":"2024-09-12T17:15:39.958125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.957627+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.957627+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:08.558995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'17","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.569132+0000","last_change":"2024-09-12T17:15:51.569132+0000","last_active":"2024-09-12T17:15:51.569132+0000","last_peered":"2024-09-12T17:15:51.569132+0000","last_clean":"2024-09-12T17:15:51.569132+0000","last_became_active":"2024-09-12T17:11:14.777729+0000","last_became_peered":"2024-09-12T17:11:14.777729+0000","last_unstale":"2024-09-12T17:15:51.569132+0000","last_undegraded":"2024-09-12T17:15:51.569132+0000","last_fullsized":"2024-09-12T17:15:51.569132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-09-12T17:15:51.568910+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.568910+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:05.866665+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":32,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.119406+0000","last_change":"2024-09-12T17:15:14.119259+0000","last_active":"2024-09-12T17:15:14.119406+0000","last_peered":"2024-09-12T17:15:14.119406+0000","last_clean":"2024-09-12T17:15:14.119406+0000","last_became_active":"2024-09-12T17:11:06.699954+0000","last_became_peered":"2024-09-12T17:11:06.699954+0000","last_unstale":"2024-09-12T17:15:14.119406+0000","last_undegraded":"2024-09-12T17:15:14.119406+0000","last_fullsized":"2024-09-12T17:15:14.119406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:14.119067+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.119067+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:19.587103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.369479+0000","last_change":"2024-09-12T17:15:05.369239+0000","last_active":"2024-09-12T17:15:05.369479+0000","last_peered":"2024-09-12T17:15:05.369479+0000","last_clean":"2024-09-12T17:15:05.369479+0000","last_became_active":"2024-09-12T17:11:04.702491+0000","last_became_peered":"2024-09-12T17:11:04.702491+0000","last_unstale":"2024-09-12T17:15:05.369479+0000","last_undegraded":"2024-09-12T17:15:05.369479+0000","last_fullsized":"2024-09-12T17:15:05.369479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:05.369026+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.369026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:59:56.089945+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":441,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.846378+0000","last_change":"2024-09-12T17:15:30.846241+0000","last_active":"2024-09-12T17:15:30.846378+0000","last_peered":"2024-09-12T17:15:30.846378+0000","last_clean":"2024-09-12T17:15:30.846378+0000","last_became_active":"2024-09-12T17:11:43.817939+0000","last_became_peered":"2024-09-12T17:11:43.817939+0000","last_unstale":"2024-09-12T17:15:30.846378+0000","last_undegraded":"2024-09-12T17:15:30.846378+0000","last_fullsized":"2024-09-12T17:15:30.846378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:30.846040+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.846040+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:03.566242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.283310+0000","last_change":"2024-09-12T17:15:56.283310+0000","last_active":"2024-09-12T17:15:56.283310+0000","last_peered":"2024-09-12T17:15:56.283310+0000","last_clean":"2024-09-12T17:15:56.283310+0000","last_became_active":"2024-09-12T17:11:10.746021+0000","last_became_peered":"2024-09-12T17:11:10.746021+0000","last_unstale":"2024-09-12T17:15:56.283310+0000","last_undegraded":"2024-09-12T17:15:56.283310+0000","last_fullsized":"2024-09-12T17:15:56.283310+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:15:56.283107+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:15:56.283107+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.283107+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:42.856402+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'286","reported_seq":525,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.827707+0000","last_change":"2024-09-12T17:15:44.827707+0000","last_active":"2024-09-12T17:15:44.827707+0000","last_peered":"2024-09-12T17:15:44.827707+0000","last_clean":"2024-09-12T17:15:44.827707+0000","last_became_active":"2024-09-12T17:11:12.753697+0000","last_became_peered":"2024-09-12T17:11:12.753697+0000","last_unstale":"2024-09-12T17:15:44.827707+0000","last_undegraded":"2024-09-12T17:15:44.827707+0000","last_fullsized":"2024-09-12T17:15:44.827707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:44.827528+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.827528+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:09.301008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:46.985948+0000","last_change":"2024-09-12T17:15:46.985948+0000","last_active":"2024-09-12T17:15:46.985948+0000","last_peered":"2024-09-12T17:15:46.985948+0000","last_clean":"2024-09-12T17:15:46.985948+0000","last_became_active":"2024-09-12T17:11:14.774473+0000","last_became_peered":"2024-09-12T17:11:14.774473+0000","last_unstale":"2024-09-12T17:15:46.985948+0000","last_undegraded":"2024-09-12T17:15:46.985948+0000","last_fullsized":"2024-09-12T17:15:46.985948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:46.985735+0000","last_clean_scrub_stamp":"2024-09-12T17:15:46.985735+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:07.901157+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.876539+0000","last_change":"2024-09-12T17:15:13.876344+0000","last_active":"2024-09-12T17:15:13.876539+0000","last_peered":"2024-09-12T17:15:13.876539+0000","last_clean":"2024-09-12T17:15:13.876539+0000","last_became_active":"2024-09-12T17:11:06.706987+0000","last_became_peered":"2024-09-12T17:11:06.706987+0000","last_unstale":"2024-09-12T17:15:13.876539+0000","last_undegraded":"2024-09-12T17:15:13.876539+0000","last_fullsized":"2024-09-12T17:15:13.876539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:13.876174+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.876174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:46:45.655514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.392362+0000","last_change":"2024-09-12T17:15:03.392219+0000","last_active":"2024-09-12T17:15:03.392362+0000","last_peered":"2024-09-12T17:15:03.392362+0000","last_clean":"2024-09-12T17:15:03.392362+0000","last_became_active":"2024-09-12T17:11:04.703200+0000","last_became_peered":"2024-09-12T17:11:04.703200+0000","last_unstale":"2024-09-12T17:15:03.392362+0000","last_undegraded":"2024-09-12T17:15:03.392362+0000","last_fullsized":"2024-09-12T17:15:03.392362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.392030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.392030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:57.279126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.366222+0000","last_change":"2024-09-12T17:15:43.366222+0000","last_active":"2024-09-12T17:15:43.366222+0000","last_peered":"2024-09-12T17:15:43.366222+0000","last_clean":"2024-09-12T17:15:43.366222+0000","last_became_active":"2024-09-12T17:11:08.727406+0000","last_became_peered":"2024-09-12T17:11:08.727406+0000","last_unstale":"2024-09-12T17:15:43.366222+0000","last_undegraded":"2024-09-12T17:15:43.366222+0000","last_fullsized":"2024-09-12T17:15:43.366222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:43.366005+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.366005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:25.345493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.865578+0000","last_change":"2024-09-12T17:15:38.865438+0000","last_active":"2024-09-12T17:15:38.865578+0000","last_peered":"2024-09-12T17:15:38.865578+0000","last_clean":"2024-09-12T17:15:38.865578+0000","last_became_active":"2024-09-12T17:11:10.724496+0000","last_became_peered":"2024-09-12T17:11:10.724496+0000","last_unstale":"2024-09-12T17:15:38.865578+0000","last_undegraded":"2024-09-12T17:15:38.865578+0000","last_fullsized":"2024-09-12T17:15:38.865578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-09-12T17:15:38.865244+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.865244+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:53.633604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.969358+0000","last_change":"2024-09-12T17:15:37.969238+0000","last_active":"2024-09-12T17:15:37.969358+0000","last_peered":"2024-09-12T17:15:37.969358+0000","last_clean":"2024-09-12T17:15:37.969358+0000","last_became_active":"2024-09-12T17:11:12.757927+0000","last_became_peered":"2024-09-12T17:11:12.757927+0000","last_unstale":"2024-09-12T17:15:37.969358+0000","last_undegraded":"2024-09-12T17:15:37.969358+0000","last_fullsized":"2024-09-12T17:15:37.969358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:37.969052+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.969052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:48.170639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.867058+0000","last_change":"2024-09-12T17:15:48.867058+0000","last_active":"2024-09-12T17:15:48.867058+0000","last_peered":"2024-09-12T17:15:48.867058+0000","last_clean":"2024-09-12T17:15:48.867058+0000","last_became_active":"2024-09-12T17:11:14.751846+0000","last_became_peered":"2024-09-12T17:11:14.751846+0000","last_unstale":"2024-09-12T17:15:48.867058+0000","last_undegraded":"2024-09-12T17:15:48.867058+0000","last_fullsized":"2024-09-12T17:15:48.867058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-12T17:15:48.866885+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.866885+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:08.256752+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.275587+0000","last_change":"2024-09-12T17:15:25.275587+0000","last_active":"2024-09-12T17:15:25.275587+0000","last_peered":"2024-09-12T17:15:25.275587+0000","last_clean":"2024-09-12T17:15:25.275587+0000","last_became_active":"2024-09-12T17:11:06.707910+0000","last_became_peered":"2024-09-12T17:11:06.707910+0000","last_unstale":"2024-09-12T17:15:25.275587+0000","last_undegraded":"2024-09-12T17:15:25.275587+0000","last_fullsized":"2024-09-12T17:15:25.275587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:25.275402+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.275402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:48.030414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'74","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.911446+0000","last_change":"2024-09-12T17:14:55.911446+0000","last_active":"2024-09-12T17:14:55.911446+0000","last_peered":"2024-09-12T17:14:55.911446+0000","last_clean":"2024-09-12T17:14:55.911446+0000","last_became_active":"2024-09-12T17:10:50.636327+0000","last_became_peered":"2024-09-12T17:10:50.636327+0000","last_unstale":"2024-09-12T17:14:55.911446+0000","last_undegraded":"2024-09-12T17:14:55.911446+0000","last_fullsized":"2024-09-12T17:14:55.911446+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'74","last_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_deep_scrub":"34'74","last_deep_scrub_stamp":"2024-09-12T17:14:55.911203+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.911203+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:47:43.813828+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"34'2","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.344255+0000","last_change":"2024-09-12T17:14:58.344110+0000","last_active":"2024-09-12T17:14:58.344255+0000","last_peered":"2024-09-12T17:14:58.344255+0000","last_clean":"2024-09-12T17:14:58.344255+0000","last_became_active":"2024-09-12T17:10:54.772959+0000","last_became_peered":"2024-09-12T17:10:54.772959+0000","last_unstale":"2024-09-12T17:14:58.344255+0000","last_undegraded":"2024-09-12T17:14:58.344255+0000","last_fullsized":"2024-09-12T17:14:58.344255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:58.343916+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.343916+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:58.763095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0023592779999999998,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.363397+0000","last_change":"2024-09-12T17:15:00.363177+0000","last_active":"2024-09-12T17:15:00.363397+0000","last_peered":"2024-09-12T17:15:00.363397+0000","last_clean":"2024-09-12T17:15:00.363397+0000","last_became_active":"2024-09-12T17:11:04.702797+0000","last_became_peered":"2024-09-12T17:11:04.702797+0000","last_unstale":"2024-09-12T17:15:00.363397+0000","last_undegraded":"2024-09-12T17:15:00.363397+0000","last_fullsized":"2024-09-12T17:15:00.363397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.362898+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.362898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:40.201170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.860319+0000","last_change":"2024-09-12T17:15:33.860319+0000","last_active":"2024-09-12T17:15:33.860319+0000","last_peered":"2024-09-12T17:15:33.860319+0000","last_clean":"2024-09-12T17:15:33.860319+0000","last_became_active":"2024-09-12T17:11:43.815448+0000","last_became_peered":"2024-09-12T17:11:43.815448+0000","last_unstale":"2024-09-12T17:15:33.860319+0000","last_undegraded":"2024-09-12T17:15:33.860319+0000","last_fullsized":"2024-09-12T17:15:33.860319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.860118+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.860118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:13.485835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'90","reported_seq":181,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:52.298497+0000","last_change":"2024-09-12T17:15:52.298497+0000","last_active":"2024-09-12T17:15:52.298497+0000","last_peered":"2024-09-12T17:15:52.298497+0000","last_clean":"2024-09-12T17:15:52.298497+0000","last_became_active":"2024-09-12T17:11:10.742264+0000","last_became_peered":"2024-09-12T17:11:10.742264+0000","last_unstale":"2024-09-12T17:15:52.298497+0000","last_undegraded":"2024-09-12T17:15:52.298497+0000","last_fullsized":"2024-09-12T17:15:52.298497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'90","last_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_deep_scrub":"34'90","last_deep_scrub_stamp":"2024-09-12T17:15:52.298319+0000","last_clean_scrub_stamp":"2024-09-12T17:15:52.298319+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:46.248966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.630425+0000","last_change":"2024-09-12T17:15:42.630425+0000","last_active":"2024-09-12T17:15:42.630425+0000","last_peered":"2024-09-12T17:15:42.630425+0000","last_clean":"2024-09-12T17:15:42.630425+0000","last_became_active":"2024-09-12T17:11:12.754521+0000","last_became_peered":"2024-09-12T17:11:12.754521+0000","last_unstale":"2024-09-12T17:15:42.630425+0000","last_undegraded":"2024-09-12T17:15:42.630425+0000","last_fullsized":"2024-09-12T17:15:42.630425+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.630245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.630245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:53:54.028995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.933215+0000","last_change":"2024-09-12T17:15:45.933215+0000","last_active":"2024-09-12T17:15:45.933215+0000","last_peered":"2024-09-12T17:15:45.933215+0000","last_clean":"2024-09-12T17:15:45.933215+0000","last_became_active":"2024-09-12T17:11:14.773830+0000","last_became_peered":"2024-09-12T17:11:14.773830+0000","last_unstale":"2024-09-12T17:15:45.933215+0000","last_undegraded":"2024-09-12T17:15:45.933215+0000","last_fullsized":"2024-09-12T17:15:45.933215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-09-12T17:15:45.933032+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.933032+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:31.635022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:26.251384+0000","last_change":"2024-09-12T17:15:26.251257+0000","last_active":"2024-09-12T17:15:26.251384+0000","last_peered":"2024-09-12T17:15:26.251384+0000","last_clean":"2024-09-12T17:15:26.251384+0000","last_became_active":"2024-09-12T17:11:06.692326+0000","last_became_peered":"2024-09-12T17:11:06.692326+0000","last_unstale":"2024-09-12T17:15:26.251384+0000","last_undegraded":"2024-09-12T17:15:26.251384+0000","last_fullsized":"2024-09-12T17:15:26.251384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:26.251080+0000","last_clean_scrub_stamp":"2024-09-12T17:15:26.251080+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:29:57.034203+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.355017+0000","last_change":"2024-09-12T17:14:56.355017+0000","last_active":"2024-09-12T17:14:56.355017+0000","last_peered":"2024-09-12T17:14:56.355017+0000","last_clean":"2024-09-12T17:14:56.355017+0000","last_became_active":"2024-09-12T17:10:54.772834+0000","last_became_peered":"2024-09-12T17:10:54.772834+0000","last_unstale":"2024-09-12T17:14:56.355017+0000","last_undegraded":"2024-09-12T17:14:56.355017+0000","last_fullsized":"2024-09-12T17:14:56.355017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.354829+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.354829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:11.179727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001129941,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.554007+0000","last_change":"2024-09-12T17:15:00.553874+0000","last_active":"2024-09-12T17:15:00.554007+0000","last_peered":"2024-09-12T17:15:00.554007+0000","last_clean":"2024-09-12T17:15:00.554007+0000","last_became_active":"2024-09-12T17:11:04.676003+0000","last_became_peered":"2024-09-12T17:11:04.676003+0000","last_unstale":"2024-09-12T17:15:00.554007+0000","last_undegraded":"2024-09-12T17:15:00.554007+0000","last_fullsized":"2024-09-12T17:15:00.554007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:00.553655+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.553655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:28.442790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.377696+0000","last_change":"2024-09-12T17:15:42.377696+0000","last_active":"2024-09-12T17:15:42.377696+0000","last_peered":"2024-09-12T17:15:42.377696+0000","last_clean":"2024-09-12T17:15:42.377696+0000","last_became_active":"2024-09-12T17:11:08.727593+0000","last_became_peered":"2024-09-12T17:11:08.727593+0000","last_unstale":"2024-09-12T17:15:42.377696+0000","last_undegraded":"2024-09-12T17:15:42.377696+0000","last_fullsized":"2024-09-12T17:15:42.377696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.377456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.377456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:01.503677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'296","reported_seq":523,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.860338+0000","last_change":"2024-09-12T17:15:37.860338+0000","last_active":"2024-09-12T17:15:37.860338+0000","last_peered":"2024-09-12T17:15:37.860338+0000","last_clean":"2024-09-12T17:15:37.860338+0000","last_became_active":"2024-09-12T17:11:10.753319+0000","last_became_peered":"2024-09-12T17:11:10.753319+0000","last_unstale":"2024-09-12T17:15:37.860338+0000","last_undegraded":"2024-09-12T17:15:37.860338+0000","last_fullsized":"2024-09-12T17:15:37.860338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'296","last_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_deep_scrub":"34'296","last_deep_scrub_stamp":"2024-09-12T17:15:37.860130+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.860130+0000","objects_scrubbed":10,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:55.881587+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:03.344384+0000","last_change":"2024-09-12T17:16:03.344384+0000","last_active":"2024-09-12T17:16:03.344384+0000","last_peered":"2024-09-12T17:16:03.344384+0000","last_clean":"2024-09-12T17:16:03.344384+0000","last_became_active":"2024-09-12T17:11:12.741444+0000","last_became_peered":"2024-09-12T17:11:12.741444+0000","last_unstale":"2024-09-12T17:16:03.344384+0000","last_undegraded":"2024-09-12T17:16:03.344384+0000","last_fullsized":"2024-09-12T17:16:03.344384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:03.344204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:03.344204+0000","last_clean_scrub_stamp":"2024-09-12T17:16:03.344204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:33.204789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.915714+0000","last_change":"2024-09-12T17:15:50.915714+0000","last_active":"2024-09-12T17:15:50.915714+0000","last_peered":"2024-09-12T17:15:50.915714+0000","last_clean":"2024-09-12T17:15:50.915714+0000","last_became_active":"2024-09-12T17:11:14.777274+0000","last_became_peered":"2024-09-12T17:11:14.777274+0000","last_unstale":"2024-09-12T17:15:50.915714+0000","last_undegraded":"2024-09-12T17:15:50.915714+0000","last_fullsized":"2024-09-12T17:15:50.915714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:50.915527+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.915527+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:31.752058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'26","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.649839+0000","last_change":"2024-09-12T17:15:14.649699+0000","last_active":"2024-09-12T17:15:14.649839+0000","last_peered":"2024-09-12T17:15:14.649839+0000","last_clean":"2024-09-12T17:15:14.649839+0000","last_became_active":"2024-09-12T17:11:06.698813+0000","last_became_peered":"2024-09-12T17:11:06.698813+0000","last_unstale":"2024-09-12T17:15:14.649839+0000","last_undegraded":"2024-09-12T17:15:14.649839+0000","last_fullsized":"2024-09-12T17:15:14.649839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'26","last_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_deep_scrub":"34'26","last_deep_scrub_stamp":"2024-09-12T17:15:14.649518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.649518+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:27.736941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":104,"num_read_kb":88,"num_write":33,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.253023+0000","last_change":"2024-09-12T17:14:56.252899+0000","last_active":"2024-09-12T17:14:56.253023+0000","last_peered":"2024-09-12T17:14:56.253023+0000","last_clean":"2024-09-12T17:14:56.253023+0000","last_became_active":"2024-09-12T17:10:54.769132+0000","last_became_peered":"2024-09-12T17:10:54.769132+0000","last_unstale":"2024-09-12T17:14:56.253023+0000","last_undegraded":"2024-09-12T17:14:56.253023+0000","last_fullsized":"2024-09-12T17:14:56.253023+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.252710+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.252710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:16:23.672480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012780529999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.622944+0000","last_change":"2024-09-12T17:14:57.622760+0000","last_active":"2024-09-12T17:14:57.622944+0000","last_peered":"2024-09-12T17:14:57.622944+0000","last_clean":"2024-09-12T17:14:57.622944+0000","last_became_active":"2024-09-12T17:11:04.676864+0000","last_became_peered":"2024-09-12T17:11:04.676864+0000","last_unstale":"2024-09-12T17:14:57.622944+0000","last_undegraded":"2024-09-12T17:14:57.622944+0000","last_fullsized":"2024-09-12T17:14:57.622944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.622572+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.622572+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:58.441681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.094456+0000","last_change":"2024-09-12T17:15:24.094317+0000","last_active":"2024-09-12T17:15:24.094456+0000","last_peered":"2024-09-12T17:15:24.094456+0000","last_clean":"2024-09-12T17:15:24.094456+0000","last_became_active":"2024-09-12T17:11:08.710808+0000","last_became_peered":"2024-09-12T17:11:08.710808+0000","last_unstale":"2024-09-12T17:15:24.094456+0000","last_undegraded":"2024-09-12T17:15:24.094456+0000","last_fullsized":"2024-09-12T17:15:24.094456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.094126+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.094126+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:54:04.533467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'24","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.032736+0000","last_change":"2024-09-12T17:15:31.032736+0000","last_active":"2024-09-12T17:15:31.032736+0000","last_peered":"2024-09-12T17:15:31.032736+0000","last_clean":"2024-09-12T17:15:31.032736+0000","last_became_active":"2024-09-12T17:11:10.734336+0000","last_became_peered":"2024-09-12T17:11:10.734336+0000","last_unstale":"2024-09-12T17:15:31.032736+0000","last_undegraded":"2024-09-12T17:15:31.032736+0000","last_fullsized":"2024-09-12T17:15:31.032736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'24","last_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_deep_scrub":"34'24","last_deep_scrub_stamp":"2024-09-12T17:15:31.032542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.032542+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.819963+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.591841+0000","last_change":"2024-09-12T17:15:41.591841+0000","last_active":"2024-09-12T17:15:41.591841+0000","last_peered":"2024-09-12T17:15:41.591841+0000","last_clean":"2024-09-12T17:15:41.591841+0000","last_became_active":"2024-09-12T17:11:12.756545+0000","last_became_peered":"2024-09-12T17:11:12.756545+0000","last_unstale":"2024-09-12T17:15:41.591841+0000","last_undegraded":"2024-09-12T17:15:41.591841+0000","last_fullsized":"2024-09-12T17:15:41.591841+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.591665+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.591665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:23.603528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:11.264827+0000","last_change":"2024-09-12T17:16:11.264827+0000","last_active":"2024-09-12T17:16:11.264827+0000","last_peered":"2024-09-12T17:16:11.264827+0000","last_clean":"2024-09-12T17:16:11.264827+0000","last_became_active":"2024-09-12T17:11:14.759032+0000","last_became_peered":"2024-09-12T17:11:14.759032+0000","last_unstale":"2024-09-12T17:16:11.264827+0000","last_undegraded":"2024-09-12T17:16:11.264827+0000","last_fullsized":"2024-09-12T17:16:11.264827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:11.264625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:11.264625+0000","last_clean_scrub_stamp":"2024-09-12T17:16:11.264625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:39.829588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.619454+0000","last_change":"2024-09-12T17:15:12.619313+0000","last_active":"2024-09-12T17:15:12.619454+0000","last_peered":"2024-09-12T17:15:12.619454+0000","last_clean":"2024-09-12T17:15:12.619454+0000","last_became_active":"2024-09-12T17:11:06.697904+0000","last_became_peered":"2024-09-12T17:11:06.697904+0000","last_unstale":"2024-09-12T17:15:12.619454+0000","last_undegraded":"2024-09-12T17:15:12.619454+0000","last_fullsized":"2024-09-12T17:15:12.619454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:12.619133+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.619133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:53.401095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"34'3","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.349942+0000","last_change":"2024-09-12T17:14:57.349792+0000","last_active":"2024-09-12T17:14:57.349942+0000","last_peered":"2024-09-12T17:14:57.349942+0000","last_clean":"2024-09-12T17:14:57.349942+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:14:57.349942+0000","last_undegraded":"2024-09-12T17:14:57.349942+0000","last_fullsized":"2024-09-12T17:14:57.349942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:14:57.349607+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.349607+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:49.102885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002271763,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:57.265774+0000","last_change":"2024-09-12T17:14:57.265630+0000","last_active":"2024-09-12T17:14:57.265774+0000","last_peered":"2024-09-12T17:14:57.265774+0000","last_clean":"2024-09-12T17:14:57.265774+0000","last_became_active":"2024-09-12T17:11:04.673269+0000","last_became_peered":"2024-09-12T17:11:04.673269+0000","last_unstale":"2024-09-12T17:14:57.265774+0000","last_undegraded":"2024-09-12T17:14:57.265774+0000","last_fullsized":"2024-09-12T17:14:57.265774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:14:57.265430+0000","last_clean_scrub_stamp":"2024-09-12T17:14:57.265430+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:07.327769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:25.650742+0000","last_change":"2024-09-12T17:15:25.650742+0000","last_active":"2024-09-12T17:15:25.650742+0000","last_peered":"2024-09-12T17:15:25.650742+0000","last_clean":"2024-09-12T17:15:25.650742+0000","last_became_active":"2024-09-12T17:11:08.711173+0000","last_became_peered":"2024-09-12T17:11:08.711173+0000","last_unstale":"2024-09-12T17:15:25.650742+0000","last_undegraded":"2024-09-12T17:15:25.650742+0000","last_fullsized":"2024-09-12T17:15:25.650742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:25.650567+0000","last_clean_scrub_stamp":"2024-09-12T17:15:25.650567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:13.066845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'20","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.346298+0000","last_change":"2024-09-12T17:15:51.346298+0000","last_active":"2024-09-12T17:15:51.346298+0000","last_peered":"2024-09-12T17:15:51.346298+0000","last_clean":"2024-09-12T17:15:51.346298+0000","last_became_active":"2024-09-12T17:11:10.745641+0000","last_became_peered":"2024-09-12T17:11:10.745641+0000","last_unstale":"2024-09-12T17:15:51.346298+0000","last_undegraded":"2024-09-12T17:15:51.346298+0000","last_fullsized":"2024-09-12T17:15:51.346298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:51.346098+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.346098+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:33.524411+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:04.315468+0000","last_change":"2024-09-12T17:16:04.315468+0000","last_active":"2024-09-12T17:16:04.315468+0000","last_peered":"2024-09-12T17:16:04.315468+0000","last_clean":"2024-09-12T17:16:04.315468+0000","last_became_active":"2024-09-12T17:11:12.745768+0000","last_became_peered":"2024-09-12T17:11:12.745768+0000","last_unstale":"2024-09-12T17:16:04.315468+0000","last_undegraded":"2024-09-12T17:16:04.315468+0000","last_fullsized":"2024-09-12T17:16:04.315468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:04.315259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:04.315259+0000","last_clean_scrub_stamp":"2024-09-12T17:16:04.315259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:12:51.370363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:51.870101+0000","last_change":"2024-09-12T17:15:51.870101+0000","last_active":"2024-09-12T17:15:51.870101+0000","last_peered":"2024-09-12T17:15:51.870101+0000","last_clean":"2024-09-12T17:15:51.870101+0000","last_became_active":"2024-09-12T17:11:14.764342+0000","last_became_peered":"2024-09-12T17:11:14.764342+0000","last_unstale":"2024-09-12T17:15:51.870101+0000","last_undegraded":"2024-09-12T17:15:51.870101+0000","last_fullsized":"2024-09-12T17:15:51.870101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:51.869905+0000","last_clean_scrub_stamp":"2024-09-12T17:15:51.869905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.607819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.824007+0000","last_change":"2024-09-12T17:15:09.823868+0000","last_active":"2024-09-12T17:15:09.824007+0000","last_peered":"2024-09-12T17:15:09.824007+0000","last_clean":"2024-09-12T17:15:09.824007+0000","last_became_active":"2024-09-12T17:11:06.704725+0000","last_became_peered":"2024-09-12T17:11:06.704725+0000","last_unstale":"2024-09-12T17:15:09.824007+0000","last_undegraded":"2024-09-12T17:15:09.824007+0000","last_fullsized":"2024-09-12T17:15:09.824007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:09.823660+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.823660+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.548199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.276097+0000","last_change":"2024-09-12T17:14:59.275856+0000","last_active":"2024-09-12T17:14:59.276097+0000","last_peered":"2024-09-12T17:14:59.276097+0000","last_clean":"2024-09-12T17:14:59.276097+0000","last_became_active":"2024-09-12T17:11:04.673336+0000","last_became_peered":"2024-09-12T17:11:04.673336+0000","last_unstale":"2024-09-12T17:14:59.276097+0000","last_undegraded":"2024-09-12T17:14:59.276097+0000","last_fullsized":"2024-09-12T17:14:59.276097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:59.275635+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.275635+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:37:08.199637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:55.609810+0000","last_change":"2024-09-12T17:14:55.609658+0000","last_active":"2024-09-12T17:14:55.609810+0000","last_peered":"2024-09-12T17:14:55.609810+0000","last_clean":"2024-09-12T17:14:55.609810+0000","last_became_active":"2024-09-12T17:10:54.776001+0000","last_became_peered":"2024-09-12T17:10:54.776001+0000","last_unstale":"2024-09-12T17:14:55.609810+0000","last_undegraded":"2024-09-12T17:14:55.609810+0000","last_fullsized":"2024-09-12T17:14:55.609810+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:55.609474+0000","last_clean_scrub_stamp":"2024-09-12T17:14:55.609474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:43.527501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0014851020000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:24.687586+0000","last_change":"2024-09-12T17:15:24.687586+0000","last_active":"2024-09-12T17:15:24.687586+0000","last_peered":"2024-09-12T17:15:24.687586+0000","last_clean":"2024-09-12T17:15:24.687586+0000","last_became_active":"2024-09-12T17:11:08.713694+0000","last_became_peered":"2024-09-12T17:11:08.713694+0000","last_unstale":"2024-09-12T17:15:24.687586+0000","last_undegraded":"2024-09-12T17:15:24.687586+0000","last_fullsized":"2024-09-12T17:15:24.687586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:24.687400+0000","last_clean_scrub_stamp":"2024-09-12T17:15:24.687400+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:45.771402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'76","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.685630+0000","last_change":"2024-09-12T17:15:32.685630+0000","last_active":"2024-09-12T17:15:32.685630+0000","last_peered":"2024-09-12T17:15:32.685630+0000","last_clean":"2024-09-12T17:15:32.685630+0000","last_became_active":"2024-09-12T17:11:10.744389+0000","last_became_peered":"2024-09-12T17:11:10.744389+0000","last_unstale":"2024-09-12T17:15:32.685630+0000","last_undegraded":"2024-09-12T17:15:32.685630+0000","last_fullsized":"2024-09-12T17:15:32.685630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'76","last_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_deep_scrub":"34'76","last_deep_scrub_stamp":"2024-09-12T17:15:32.685518+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.685518+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:06:32.484233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.953964+0000","last_change":"2024-09-12T17:15:38.953964+0000","last_active":"2024-09-12T17:15:38.953964+0000","last_peered":"2024-09-12T17:15:38.953964+0000","last_clean":"2024-09-12T17:15:38.953964+0000","last_became_active":"2024-09-12T17:11:12.752260+0000","last_became_peered":"2024-09-12T17:11:12.752260+0000","last_unstale":"2024-09-12T17:15:38.953964+0000","last_undegraded":"2024-09-12T17:15:38.953964+0000","last_fullsized":"2024-09-12T17:15:38.953964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:38.953775+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.953775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:36.984698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:54.507245+0000","last_change":"2024-09-12T17:15:54.507245+0000","last_active":"2024-09-12T17:15:54.507245+0000","last_peered":"2024-09-12T17:15:54.507245+0000","last_clean":"2024-09-12T17:15:54.507245+0000","last_became_active":"2024-09-12T17:11:14.751132+0000","last_became_peered":"2024-09-12T17:11:14.751132+0000","last_unstale":"2024-09-12T17:15:54.507245+0000","last_undegraded":"2024-09-12T17:15:54.507245+0000","last_fullsized":"2024-09-12T17:15:54.507245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-09-12T17:15:54.507061+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-09-12T17:15:54.507061+0000","last_clean_scrub_stamp":"2024-09-12T17:15:54.507061+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:10.549246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.842566+0000","last_change":"2024-09-12T17:15:10.842397+0000","last_active":"2024-09-12T17:15:10.842566+0000","last_peered":"2024-09-12T17:15:10.842566+0000","last_clean":"2024-09-12T17:15:10.842566+0000","last_became_active":"2024-09-12T17:11:06.705110+0000","last_became_peered":"2024-09-12T17:11:06.705110+0000","last_unstale":"2024-09-12T17:15:10.842566+0000","last_undegraded":"2024-09-12T17:15:10.842566+0000","last_fullsized":"2024-09-12T17:15:10.842566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:10.842219+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.842219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:45.585105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.546848+0000","last_change":"2024-09-12T17:14:59.546720+0000","last_active":"2024-09-12T17:14:59.546848+0000","last_peered":"2024-09-12T17:14:59.546848+0000","last_clean":"2024-09-12T17:14:59.546848+0000","last_became_active":"2024-09-12T17:11:04.675398+0000","last_became_peered":"2024-09-12T17:11:04.675398+0000","last_unstale":"2024-09-12T17:14:59.546848+0000","last_undegraded":"2024-09-12T17:14:59.546848+0000","last_fullsized":"2024-09-12T17:14:59.546848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.546539+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.546539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:06.551999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.384965+0000","last_change":"2024-09-12T17:15:02.384841+0000","last_active":"2024-09-12T17:15:02.384965+0000","last_peered":"2024-09-12T17:15:02.384965+0000","last_clean":"2024-09-12T17:15:02.384965+0000","last_became_active":"2024-09-12T17:10:54.770352+0000","last_became_peered":"2024-09-12T17:10:54.770352+0000","last_unstale":"2024-09-12T17:15:02.384965+0000","last_undegraded":"2024-09-12T17:15:02.384965+0000","last_fullsized":"2024-09-12T17:15:02.384965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:02.384664+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.384664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:21.774531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0031269850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.385448+0000","last_change":"2024-09-12T17:15:49.385448+0000","last_active":"2024-09-12T17:15:49.385448+0000","last_peered":"2024-09-12T17:15:49.385448+0000","last_clean":"2024-09-12T17:15:49.385448+0000","last_became_active":"2024-09-12T17:11:08.724716+0000","last_became_peered":"2024-09-12T17:11:08.724716+0000","last_unstale":"2024-09-12T17:15:49.385448+0000","last_undegraded":"2024-09-12T17:15:49.385448+0000","last_fullsized":"2024-09-12T17:15:49.385448+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.385273+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.385273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:07.869553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.883962+0000","last_change":"2024-09-12T17:15:40.883962+0000","last_active":"2024-09-12T17:15:40.883962+0000","last_peered":"2024-09-12T17:15:40.883962+0000","last_clean":"2024-09-12T17:15:40.883962+0000","last_became_active":"2024-09-12T17:11:10.744697+0000","last_became_peered":"2024-09-12T17:11:10.744697+0000","last_unstale":"2024-09-12T17:15:40.883962+0000","last_undegraded":"2024-09-12T17:15:40.883962+0000","last_fullsized":"2024-09-12T17:15:40.883962+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-09-12T17:15:40.883767+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.883767+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:44.835444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'286","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.855770+0000","last_change":"2024-09-12T17:15:43.855770+0000","last_active":"2024-09-12T17:15:43.855770+0000","last_peered":"2024-09-12T17:15:43.855770+0000","last_clean":"2024-09-12T17:15:43.855770+0000","last_became_active":"2024-09-12T17:11:12.749192+0000","last_became_peered":"2024-09-12T17:11:12.749192+0000","last_unstale":"2024-09-12T17:15:43.855770+0000","last_undegraded":"2024-09-12T17:15:43.855770+0000","last_fullsized":"2024-09-12T17:15:43.855770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.855585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.855585+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.436369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'8","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:16.263071+0000","last_change":"2024-09-12T17:16:16.263071+0000","last_active":"2024-09-12T17:16:16.263071+0000","last_peered":"2024-09-12T17:16:16.263071+0000","last_clean":"2024-09-12T17:16:16.263071+0000","last_became_active":"2024-09-12T17:11:14.772440+0000","last_became_peered":"2024-09-12T17:11:14.772440+0000","last_unstale":"2024-09-12T17:16:16.263071+0000","last_undegraded":"2024-09-12T17:16:16.263071+0000","last_fullsized":"2024-09-12T17:16:16.263071+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:16:16.262866+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:16:16.262866+0000","last_clean_scrub_stamp":"2024-09-12T17:16:16.262866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:36:27.876075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"34'18","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.324685+0000","last_change":"2024-09-12T17:15:21.324685+0000","last_active":"2024-09-12T17:15:21.324685+0000","last_peered":"2024-09-12T17:15:21.324685+0000","last_clean":"2024-09-12T17:15:21.324685+0000","last_became_active":"2024-09-12T17:11:06.689139+0000","last_became_peered":"2024-09-12T17:11:06.689139+0000","last_unstale":"2024-09-12T17:15:21.324685+0000","last_undegraded":"2024-09-12T17:15:21.324685+0000","last_fullsized":"2024-09-12T17:15:21.324685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'18","last_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_deep_scrub":"34'18","last_deep_scrub_stamp":"2024-09-12T17:15:21.324508+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.324508+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:04.865579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.370073+0000","last_change":"2024-09-12T17:15:01.369815+0000","last_active":"2024-09-12T17:15:01.370073+0000","last_peered":"2024-09-12T17:15:01.370073+0000","last_clean":"2024-09-12T17:15:01.370073+0000","last_became_active":"2024-09-12T17:11:04.694206+0000","last_became_peered":"2024-09-12T17:11:04.694206+0000","last_unstale":"2024-09-12T17:15:01.370073+0000","last_undegraded":"2024-09-12T17:15:01.370073+0000","last_fullsized":"2024-09-12T17:15:01.370073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.369538+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.369538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:43.619390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.592043+0000","last_change":"2024-09-12T17:14:56.591887+0000","last_active":"2024-09-12T17:14:56.592043+0000","last_peered":"2024-09-12T17:14:56.592043+0000","last_clean":"2024-09-12T17:14:56.592043+0000","last_became_active":"2024-09-12T17:10:54.774360+0000","last_became_peered":"2024-09-12T17:10:54.774360+0000","last_unstale":"2024-09-12T17:14:56.592043+0000","last_undegraded":"2024-09-12T17:14:56.592043+0000","last_fullsized":"2024-09-12T17:14:56.592043+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:56.591696+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.591696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:05.758061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010427839999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.424706+0000","last_change":"2024-09-12T17:15:41.424706+0000","last_active":"2024-09-12T17:15:41.424706+0000","last_peered":"2024-09-12T17:15:41.424706+0000","last_clean":"2024-09-12T17:15:41.424706+0000","last_became_active":"2024-09-12T17:11:08.724854+0000","last_became_peered":"2024-09-12T17:11:08.724854+0000","last_unstale":"2024-09-12T17:15:41.424706+0000","last_undegraded":"2024-09-12T17:15:41.424706+0000","last_fullsized":"2024-09-12T17:15:41.424706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.424524+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.424524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:18.841300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.366997+0000","last_change":"2024-09-12T17:15:50.366997+0000","last_active":"2024-09-12T17:15:50.366997+0000","last_peered":"2024-09-12T17:15:50.366997+0000","last_clean":"2024-09-12T17:15:50.366997+0000","last_became_active":"2024-09-12T17:11:10.745293+0000","last_became_peered":"2024-09-12T17:11:10.745293+0000","last_unstale":"2024-09-12T17:15:50.366997+0000","last_undegraded":"2024-09-12T17:15:50.366997+0000","last_fullsized":"2024-09-12T17:15:50.366997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-09-12T17:15:50.366844+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.366844+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:11.340218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'286","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:39.659082+0000","last_change":"2024-09-12T17:15:39.659082+0000","last_active":"2024-09-12T17:15:39.659082+0000","last_peered":"2024-09-12T17:15:39.659082+0000","last_clean":"2024-09-12T17:15:39.659082+0000","last_became_active":"2024-09-12T17:11:12.749003+0000","last_became_peered":"2024-09-12T17:11:12.749003+0000","last_unstale":"2024-09-12T17:15:39.659082+0000","last_undegraded":"2024-09-12T17:15:39.659082+0000","last_fullsized":"2024-09-12T17:15:39.659082+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:39.658876+0000","last_clean_scrub_stamp":"2024-09-12T17:15:39.658876+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:28:39.698721+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'5","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:55.849478+0000","last_change":"2024-09-12T17:15:55.849478+0000","last_active":"2024-09-12T17:15:55.849478+0000","last_peered":"2024-09-12T17:15:55.849478+0000","last_clean":"2024-09-12T17:15:55.849478+0000","last_became_active":"2024-09-12T17:11:14.773327+0000","last_became_peered":"2024-09-12T17:11:14.773327+0000","last_unstale":"2024-09-12T17:15:55.849478+0000","last_undegraded":"2024-09-12T17:15:55.849478+0000","last_fullsized":"2024-09-12T17:15:55.849478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-09-12T17:15:55.849295+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-09-12T17:15:55.849295+0000","last_clean_scrub_stamp":"2024-09-12T17:15:55.849295+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.260603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'6","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.153122+0000","last_change":"2024-09-12T17:15:11.152858+0000","last_active":"2024-09-12T17:15:11.153122+0000","last_peered":"2024-09-12T17:15:11.153122+0000","last_clean":"2024-09-12T17:15:11.153122+0000","last_became_active":"2024-09-12T17:11:06.690937+0000","last_became_peered":"2024-09-12T17:11:06.690937+0000","last_unstale":"2024-09-12T17:15:11.153122+0000","last_undegraded":"2024-09-12T17:15:11.153122+0000","last_fullsized":"2024-09-12T17:15:11.153122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:11.152634+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.152634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:17.511951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:56.954866+0000","last_change":"2024-09-12T17:14:56.954698+0000","last_active":"2024-09-12T17:14:56.954866+0000","last_peered":"2024-09-12T17:14:56.954866+0000","last_clean":"2024-09-12T17:14:56.954866+0000","last_became_active":"2024-09-12T17:11:04.668739+0000","last_became_peered":"2024-09-12T17:11:04.668739+0000","last_unstale":"2024-09-12T17:14:56.954866+0000","last_undegraded":"2024-09-12T17:14:56.954866+0000","last_fullsized":"2024-09-12T17:14:56.954866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:14:56.954518+0000","last_clean_scrub_stamp":"2024-09-12T17:14:56.954518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:16:01.720351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.386536+0000","last_change":"2024-09-12T17:14:59.386412+0000","last_active":"2024-09-12T17:14:59.386536+0000","last_peered":"2024-09-12T17:14:59.386536+0000","last_clean":"2024-09-12T17:14:59.386536+0000","last_became_active":"2024-09-12T17:10:54.827941+0000","last_became_peered":"2024-09-12T17:10:54.827941+0000","last_unstale":"2024-09-12T17:14:59.386536+0000","last_undegraded":"2024-09-12T17:14:59.386536+0000","last_fullsized":"2024-09-12T17:14:59.386536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.386232+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.386232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:09.105379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029398739999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.432260+0000","last_change":"2024-09-12T17:15:40.432260+0000","last_active":"2024-09-12T17:15:40.432260+0000","last_peered":"2024-09-12T17:15:40.432260+0000","last_clean":"2024-09-12T17:15:40.432260+0000","last_became_active":"2024-09-12T17:11:08.720668+0000","last_became_peered":"2024-09-12T17:11:08.720668+0000","last_unstale":"2024-09-12T17:15:40.432260+0000","last_undegraded":"2024-09-12T17:15:40.432260+0000","last_fullsized":"2024-09-12T17:15:40.432260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.432083+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.432083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:51:25.686692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'101","reported_seq":195,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.074417+0000","last_change":"2024-09-12T17:15:32.074417+0000","last_active":"2024-09-12T17:15:32.074417+0000","last_peered":"2024-09-12T17:15:32.074417+0000","last_clean":"2024-09-12T17:15:32.074417+0000","last_became_active":"2024-09-12T17:11:10.744438+0000","last_became_peered":"2024-09-12T17:11:10.744438+0000","last_unstale":"2024-09-12T17:15:32.074417+0000","last_undegraded":"2024-09-12T17:15:32.074417+0000","last_fullsized":"2024-09-12T17:15:32.074417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'101","last_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_deep_scrub":"34'101","last_deep_scrub_stamp":"2024-09-12T17:15:32.074146+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.074146+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:45.161569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.634033+0000","last_change":"2024-09-12T17:15:40.634033+0000","last_active":"2024-09-12T17:15:40.634033+0000","last_peered":"2024-09-12T17:15:40.634033+0000","last_clean":"2024-09-12T17:15:40.634033+0000","last_became_active":"2024-09-12T17:11:12.756505+0000","last_became_peered":"2024-09-12T17:11:12.756505+0000","last_unstale":"2024-09-12T17:15:40.634033+0000","last_undegraded":"2024-09-12T17:15:40.634033+0000","last_fullsized":"2024-09-12T17:15:40.634033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.633855+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.633855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:24.161604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:48.006178+0000","last_change":"2024-09-12T17:15:48.006178+0000","last_active":"2024-09-12T17:15:48.006178+0000","last_peered":"2024-09-12T17:15:48.006178+0000","last_clean":"2024-09-12T17:15:48.006178+0000","last_became_active":"2024-09-12T17:11:14.773448+0000","last_became_peered":"2024-09-12T17:11:14.773448+0000","last_unstale":"2024-09-12T17:15:48.006178+0000","last_undegraded":"2024-09-12T17:15:48.006178+0000","last_fullsized":"2024-09-12T17:15:48.006178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:48.006000+0000","last_clean_scrub_stamp":"2024-09-12T17:15:48.006000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:11.503416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.921995+0000","last_change":"2024-09-12T17:15:49.921995+0000","last_active":"2024-09-12T17:15:49.921995+0000","last_peered":"2024-09-12T17:15:49.921995+0000","last_clean":"2024-09-12T17:15:49.921995+0000","last_became_active":"2024-09-12T17:11:14.775721+0000","last_became_peered":"2024-09-12T17:11:14.775721+0000","last_unstale":"2024-09-12T17:15:49.921995+0000","last_undegraded":"2024-09-12T17:15:49.921995+0000","last_fullsized":"2024-09-12T17:15:49.921995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:49.921812+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.921812+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:20.937204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.152040+0000","last_change":"2024-09-12T17:15:15.151829+0000","last_active":"2024-09-12T17:15:15.152040+0000","last_peered":"2024-09-12T17:15:15.152040+0000","last_clean":"2024-09-12T17:15:15.152040+0000","last_became_active":"2024-09-12T17:11:06.699600+0000","last_became_peered":"2024-09-12T17:11:06.699600+0000","last_unstale":"2024-09-12T17:15:15.152040+0000","last_undegraded":"2024-09-12T17:15:15.152040+0000","last_fullsized":"2024-09-12T17:15:15.152040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:15.151618+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.151618+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:24.317983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:12.299393+0000","last_change":"2024-09-12T17:15:12.299261+0000","last_active":"2024-09-12T17:15:12.299393+0000","last_peered":"2024-09-12T17:15:12.299393+0000","last_clean":"2024-09-12T17:15:12.299393+0000","last_became_active":"2024-09-12T17:11:04.704288+0000","last_became_peered":"2024-09-12T17:11:04.704288+0000","last_unstale":"2024-09-12T17:15:12.299393+0000","last_undegraded":"2024-09-12T17:15:12.299393+0000","last_fullsized":"2024-09-12T17:15:12.299393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:12.299076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:12.299076+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:16.946359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":22,"num_write_kb":4098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"34'2","reported_seq":231,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:31.890725+0000","last_change":"2024-09-12T17:15:31.890554+0000","last_active":"2024-09-12T17:15:31.890725+0000","last_peered":"2024-09-12T17:15:31.890725+0000","last_clean":"2024-09-12T17:15:31.890725+0000","last_became_active":"2024-09-12T17:11:08.713018+0000","last_became_peered":"2024-09-12T17:11:08.713018+0000","last_unstale":"2024-09-12T17:15:31.890725+0000","last_undegraded":"2024-09-12T17:15:31.890725+0000","last_fullsized":"2024-09-12T17:15:31.890725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:31.890371+0000","last_clean_scrub_stamp":"2024-09-12T17:15:31.890371+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:17.136058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'40","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:58.233153+0000","last_change":"2024-09-12T17:15:58.233153+0000","last_active":"2024-09-12T17:15:58.233153+0000","last_peered":"2024-09-12T17:15:58.233153+0000","last_clean":"2024-09-12T17:15:58.233153+0000","last_became_active":"2024-09-12T17:11:10.737922+0000","last_became_peered":"2024-09-12T17:11:10.737922+0000","last_unstale":"2024-09-12T17:15:58.233153+0000","last_undegraded":"2024-09-12T17:15:58.233153+0000","last_fullsized":"2024-09-12T17:15:58.233153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'40","last_scrub_stamp":"2024-09-12T17:15:58.232921+0000","last_deep_scrub":"34'40","last_deep_scrub_stamp":"2024-09-12T17:15:58.232921+0000","last_clean_scrub_stamp":"2024-09-12T17:15:58.232921+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:21.161495+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:06.356165+0000","last_change":"2024-09-12T17:16:06.356165+0000","last_active":"2024-09-12T17:16:06.356165+0000","last_peered":"2024-09-12T17:16:06.356165+0000","last_clean":"2024-09-12T17:16:06.356165+0000","last_became_active":"2024-09-12T17:11:12.739797+0000","last_became_peered":"2024-09-12T17:11:12.739797+0000","last_unstale":"2024-09-12T17:16:06.356165+0000","last_undegraded":"2024-09-12T17:16:06.356165+0000","last_fullsized":"2024-09-12T17:16:06.356165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:06.355872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:06.355872+0000","last_clean_scrub_stamp":"2024-09-12T17:16:06.355872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:00.995836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:58.546810+0000","last_change":"2024-09-12T17:15:58.546810+0000","last_active":"2024-09-12T17:15:58.546810+0000","last_peered":"2024-09-12T17:15:58.546810+0000","last_clean":"2024-09-12T17:15:58.546810+0000","last_became_active":"2024-09-12T17:11:14.752202+0000","last_became_peered":"2024-09-12T17:11:14.752202+0000","last_unstale":"2024-09-12T17:15:58.546810+0000","last_undegraded":"2024-09-12T17:15:58.546810+0000","last_fullsized":"2024-09-12T17:15:58.546810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:58.546621+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:58.546621+0000","last_clean_scrub_stamp":"2024-09-12T17:15:58.546621+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:25.952637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.850424+0000","last_change":"2024-09-12T17:15:14.850267+0000","last_active":"2024-09-12T17:15:14.850424+0000","last_peered":"2024-09-12T17:15:14.850424+0000","last_clean":"2024-09-12T17:15:14.850424+0000","last_became_active":"2024-09-12T17:11:06.698082+0000","last_became_peered":"2024-09-12T17:11:06.698082+0000","last_unstale":"2024-09-12T17:15:14.850424+0000","last_undegraded":"2024-09-12T17:15:14.850424+0000","last_fullsized":"2024-09-12T17:15:14.850424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.850076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.850076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:10.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.314335+0000","last_change":"2024-09-12T17:15:02.314071+0000","last_active":"2024-09-12T17:15:02.314335+0000","last_peered":"2024-09-12T17:15:02.314335+0000","last_clean":"2024-09-12T17:15:02.314335+0000","last_became_active":"2024-09-12T17:11:04.674195+0000","last_became_peered":"2024-09-12T17:11:04.674195+0000","last_unstale":"2024-09-12T17:15:02.314335+0000","last_undegraded":"2024-09-12T17:15:02.314335+0000","last_fullsized":"2024-09-12T17:15:02.314335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.313786+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.313786+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:05.350741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.369588+0000","last_change":"2024-09-12T17:15:45.369445+0000","last_active":"2024-09-12T17:15:45.369588+0000","last_peered":"2024-09-12T17:15:45.369588+0000","last_clean":"2024-09-12T17:15:45.369588+0000","last_became_active":"2024-09-12T17:11:08.726578+0000","last_became_peered":"2024-09-12T17:11:08.726578+0000","last_unstale":"2024-09-12T17:15:45.369588+0000","last_undegraded":"2024-09-12T17:15:45.369588+0000","last_fullsized":"2024-09-12T17:15:45.369588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.369237+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.369237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:13:37.442814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.650928+0000","last_change":"2024-09-12T17:15:34.650775+0000","last_active":"2024-09-12T17:15:34.650928+0000","last_peered":"2024-09-12T17:15:34.650928+0000","last_clean":"2024-09-12T17:15:34.650928+0000","last_became_active":"2024-09-12T17:11:10.722380+0000","last_became_peered":"2024-09-12T17:11:10.722380+0000","last_unstale":"2024-09-12T17:15:34.650928+0000","last_undegraded":"2024-09-12T17:15:34.650928+0000","last_fullsized":"2024-09-12T17:15:34.650928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:34.650585+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.650585+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:46:36.625397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.955970+0000","last_change":"2024-09-12T17:15:42.955676+0000","last_active":"2024-09-12T17:15:42.955970+0000","last_peered":"2024-09-12T17:15:42.955970+0000","last_clean":"2024-09-12T17:15:42.955970+0000","last_became_active":"2024-09-12T17:11:12.755579+0000","last_became_peered":"2024-09-12T17:11:12.755579+0000","last_unstale":"2024-09-12T17:15:42.955970+0000","last_undegraded":"2024-09-12T17:15:42.955970+0000","last_fullsized":"2024-09-12T17:15:42.955970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:42.955456+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.955456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:31.849550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:56.556951+0000","last_change":"2024-09-12T17:15:56.556816+0000","last_active":"2024-09-12T17:15:56.556951+0000","last_peered":"2024-09-12T17:15:56.556951+0000","last_clean":"2024-09-12T17:15:56.556951+0000","last_became_active":"2024-09-12T17:11:14.778248+0000","last_became_peered":"2024-09-12T17:11:14.778248+0000","last_unstale":"2024-09-12T17:15:56.556951+0000","last_undegraded":"2024-09-12T17:15:56.556951+0000","last_fullsized":"2024-09-12T17:15:56.556951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:56.556639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:56.556639+0000","last_clean_scrub_stamp":"2024-09-12T17:15:56.556639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:52.034317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.591015+0000","last_change":"2024-09-12T17:15:11.590855+0000","last_active":"2024-09-12T17:15:11.591015+0000","last_peered":"2024-09-12T17:15:11.591015+0000","last_clean":"2024-09-12T17:15:11.591015+0000","last_became_active":"2024-09-12T17:11:06.691279+0000","last_became_peered":"2024-09-12T17:11:06.691279+0000","last_unstale":"2024-09-12T17:15:11.591015+0000","last_undegraded":"2024-09-12T17:15:11.591015+0000","last_fullsized":"2024-09-12T17:15:11.591015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:11.590645+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.590645+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:31:52.146542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.289982+0000","last_change":"2024-09-12T17:15:03.289858+0000","last_active":"2024-09-12T17:15:03.289982+0000","last_peered":"2024-09-12T17:15:03.289982+0000","last_clean":"2024-09-12T17:15:03.289982+0000","last_became_active":"2024-09-12T17:11:04.686684+0000","last_became_peered":"2024-09-12T17:11:04.686684+0000","last_unstale":"2024-09-12T17:15:03.289982+0000","last_undegraded":"2024-09-12T17:15:03.289982+0000","last_fullsized":"2024-09-12T17:15:03.289982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.289669+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.289669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:07:54.942393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:27.086863+0000","last_change":"2024-09-12T17:15:27.086675+0000","last_active":"2024-09-12T17:15:27.086863+0000","last_peered":"2024-09-12T17:15:27.086863+0000","last_clean":"2024-09-12T17:15:27.086863+0000","last_became_active":"2024-09-12T17:11:08.714986+0000","last_became_peered":"2024-09-12T17:11:08.714986+0000","last_unstale":"2024-09-12T17:15:27.086863+0000","last_undegraded":"2024-09-12T17:15:27.086863+0000","last_fullsized":"2024-09-12T17:15:27.086863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:27.086490+0000","last_clean_scrub_stamp":"2024-09-12T17:15:27.086490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:56:57.656954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'49","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.673143+0000","last_change":"2024-09-12T17:15:35.672973+0000","last_active":"2024-09-12T17:15:35.673143+0000","last_peered":"2024-09-12T17:15:35.673143+0000","last_clean":"2024-09-12T17:15:35.673143+0000","last_became_active":"2024-09-12T17:11:10.724948+0000","last_became_peered":"2024-09-12T17:11:10.724948+0000","last_unstale":"2024-09-12T17:15:35.673143+0000","last_undegraded":"2024-09-12T17:15:35.673143+0000","last_fullsized":"2024-09-12T17:15:35.673143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'49","last_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_deep_scrub":"34'49","last_deep_scrub_stamp":"2024-09-12T17:15:35.672790+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.672790+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:49.446223+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:45.784101+0000","last_change":"2024-09-12T17:15:45.783931+0000","last_active":"2024-09-12T17:15:45.784101+0000","last_peered":"2024-09-12T17:15:45.784101+0000","last_clean":"2024-09-12T17:15:45.784101+0000","last_became_active":"2024-09-12T17:11:12.748757+0000","last_became_peered":"2024-09-12T17:11:12.748757+0000","last_unstale":"2024-09-12T17:15:45.784101+0000","last_undegraded":"2024-09-12T17:15:45.784101+0000","last_fullsized":"2024-09-12T17:15:45.784101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:45.783750+0000","last_clean_scrub_stamp":"2024-09-12T17:15:45.783750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:55.502897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:18.282837+0000","last_change":"2024-09-12T17:16:18.282837+0000","last_active":"2024-09-12T17:16:18.282837+0000","last_peered":"2024-09-12T17:16:18.282837+0000","last_clean":"2024-09-12T17:16:18.282837+0000","last_became_active":"2024-09-12T17:11:14.778391+0000","last_became_peered":"2024-09-12T17:11:14.778391+0000","last_unstale":"2024-09-12T17:16:18.282837+0000","last_undegraded":"2024-09-12T17:16:18.282837+0000","last_fullsized":"2024-09-12T17:16:18.282837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:18.282602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:18.282602+0000","last_clean_scrub_stamp":"2024-09-12T17:16:18.282602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:27.787975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'12","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.353435+0000","last_change":"2024-09-12T17:15:29.353247+0000","last_active":"2024-09-12T17:15:29.353435+0000","last_peered":"2024-09-12T17:15:29.353435+0000","last_clean":"2024-09-12T17:15:29.353435+0000","last_became_active":"2024-09-12T17:11:06.689484+0000","last_became_peered":"2024-09-12T17:11:06.689484+0000","last_unstale":"2024-09-12T17:15:29.353435+0000","last_undegraded":"2024-09-12T17:15:29.353435+0000","last_fullsized":"2024-09-12T17:15:29.353435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:29.353071+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.353071+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:11.062516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.890737+0000","last_change":"2024-09-12T17:14:58.890548+0000","last_active":"2024-09-12T17:14:58.890737+0000","last_peered":"2024-09-12T17:14:58.890737+0000","last_clean":"2024-09-12T17:14:58.890737+0000","last_became_active":"2024-09-12T17:11:04.693454+0000","last_became_peered":"2024-09-12T17:11:04.693454+0000","last_unstale":"2024-09-12T17:14:58.890737+0000","last_undegraded":"2024-09-12T17:14:58.890737+0000","last_fullsized":"2024-09-12T17:14:58.890737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.890365+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.890365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:09.596280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:44.349063+0000","last_change":"2024-09-12T17:15:44.348933+0000","last_active":"2024-09-12T17:15:44.349063+0000","last_peered":"2024-09-12T17:15:44.349063+0000","last_clean":"2024-09-12T17:15:44.349063+0000","last_became_active":"2024-09-12T17:11:08.719218+0000","last_became_peered":"2024-09-12T17:11:08.719218+0000","last_unstale":"2024-09-12T17:15:44.349063+0000","last_undegraded":"2024-09-12T17:15:44.349063+0000","last_fullsized":"2024-09-12T17:15:44.349063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:44.348761+0000","last_clean_scrub_stamp":"2024-09-12T17:15:44.348761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:35:50.958089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.032930+0000","last_change":"2024-09-12T17:15:35.032692+0000","last_active":"2024-09-12T17:15:35.032930+0000","last_peered":"2024-09-12T17:15:35.032930+0000","last_clean":"2024-09-12T17:15:35.032930+0000","last_became_active":"2024-09-12T17:11:10.721502+0000","last_became_peered":"2024-09-12T17:11:10.721502+0000","last_unstale":"2024-09-12T17:15:35.032930+0000","last_undegraded":"2024-09-12T17:15:35.032930+0000","last_fullsized":"2024-09-12T17:15:35.032930+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:35.032454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.032454+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:12:53.441585+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:41.949640+0000","last_change":"2024-09-12T17:15:41.949494+0000","last_active":"2024-09-12T17:15:41.949640+0000","last_peered":"2024-09-12T17:15:41.949640+0000","last_clean":"2024-09-12T17:15:41.949640+0000","last_became_active":"2024-09-12T17:11:12.742910+0000","last_became_peered":"2024-09-12T17:11:12.742910+0000","last_unstale":"2024-09-12T17:15:41.949640+0000","last_undegraded":"2024-09-12T17:15:41.949640+0000","last_fullsized":"2024-09-12T17:15:41.949640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:41.949314+0000","last_clean_scrub_stamp":"2024-09-12T17:15:41.949314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:03.033316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.390800+0000","last_change":"2024-09-12T17:15:36.390800+0000","last_active":"2024-09-12T17:15:36.390800+0000","last_peered":"2024-09-12T17:15:36.390800+0000","last_clean":"2024-09-12T17:15:36.390800+0000","last_became_active":"2024-09-12T17:11:06.686925+0000","last_became_peered":"2024-09-12T17:11:06.686925+0000","last_unstale":"2024-09-12T17:15:36.390800+0000","last_undegraded":"2024-09-12T17:15:36.390800+0000","last_fullsized":"2024-09-12T17:15:36.390800+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:36.390596+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.390596+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:49.608907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:09.279391+0000","last_change":"2024-09-12T17:15:09.279239+0000","last_active":"2024-09-12T17:15:09.279391+0000","last_peered":"2024-09-12T17:15:09.279391+0000","last_clean":"2024-09-12T17:15:09.279391+0000","last_became_active":"2024-09-12T17:11:04.702567+0000","last_became_peered":"2024-09-12T17:11:04.702567+0000","last_unstale":"2024-09-12T17:15:09.279391+0000","last_undegraded":"2024-09-12T17:15:09.279391+0000","last_fullsized":"2024-09-12T17:15:09.279391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:09.279045+0000","last_clean_scrub_stamp":"2024-09-12T17:15:09.279045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:06.707329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.686351+0000","last_change":"2024-09-12T17:15:33.686351+0000","last_active":"2024-09-12T17:15:33.686351+0000","last_peered":"2024-09-12T17:15:33.686351+0000","last_clean":"2024-09-12T17:15:33.686351+0000","last_became_active":"2024-09-12T17:11:08.710486+0000","last_became_peered":"2024-09-12T17:11:08.710486+0000","last_unstale":"2024-09-12T17:15:33.686351+0000","last_undegraded":"2024-09-12T17:15:33.686351+0000","last_fullsized":"2024-09-12T17:15:33.686351+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:33.686171+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.686171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:55:43.686493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'65","reported_seq":139,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:37.656453+0000","last_change":"2024-09-12T17:15:37.656278+0000","last_active":"2024-09-12T17:15:37.656453+0000","last_peered":"2024-09-12T17:15:37.656453+0000","last_clean":"2024-09-12T17:15:37.656453+0000","last_became_active":"2024-09-12T17:11:10.725889+0000","last_became_peered":"2024-09-12T17:11:10.725889+0000","last_unstale":"2024-09-12T17:15:37.656453+0000","last_undegraded":"2024-09-12T17:15:37.656453+0000","last_fullsized":"2024-09-12T17:15:37.656453+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'65","last_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_deep_scrub":"34'65","last_deep_scrub_stamp":"2024-09-12T17:15:37.656070+0000","last_clean_scrub_stamp":"2024-09-12T17:15:37.656070+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:16.570468+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:40.942111+0000","last_change":"2024-09-12T17:15:40.941979+0000","last_active":"2024-09-12T17:15:40.942111+0000","last_peered":"2024-09-12T17:15:40.942111+0000","last_clean":"2024-09-12T17:15:40.942111+0000","last_became_active":"2024-09-12T17:11:12.742652+0000","last_became_peered":"2024-09-12T17:11:12.742652+0000","last_unstale":"2024-09-12T17:15:40.942111+0000","last_undegraded":"2024-09-12T17:15:40.942111+0000","last_fullsized":"2024-09-12T17:15:40.942111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:40.941800+0000","last_clean_scrub_stamp":"2024-09-12T17:15:40.941800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:45.911092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'14","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:57.512296+0000","last_change":"2024-09-12T17:15:57.512296+0000","last_active":"2024-09-12T17:15:57.512296+0000","last_peered":"2024-09-12T17:15:57.512296+0000","last_clean":"2024-09-12T17:15:57.512296+0000","last_became_active":"2024-09-12T17:11:14.777336+0000","last_became_peered":"2024-09-12T17:11:14.777336+0000","last_unstale":"2024-09-12T17:15:57.512296+0000","last_undegraded":"2024-09-12T17:15:57.512296+0000","last_fullsized":"2024-09-12T17:15:57.512296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:57.512178+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:57.512178+0000","last_clean_scrub_stamp":"2024-09-12T17:15:57.512178+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:35.784521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'14","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.679383+0000","last_change":"2024-09-12T17:15:16.679383+0000","last_active":"2024-09-12T17:15:16.679383+0000","last_peered":"2024-09-12T17:15:16.679383+0000","last_clean":"2024-09-12T17:15:16.679383+0000","last_became_active":"2024-09-12T17:11:06.708870+0000","last_became_peered":"2024-09-12T17:11:06.708870+0000","last_unstale":"2024-09-12T17:15:16.679383+0000","last_undegraded":"2024-09-12T17:15:16.679383+0000","last_fullsized":"2024-09-12T17:15:16.679383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.679191+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.679191+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:01.792668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:59.892102+0000","last_change":"2024-09-12T17:14:59.891960+0000","last_active":"2024-09-12T17:14:59.892102+0000","last_peered":"2024-09-12T17:14:59.892102+0000","last_clean":"2024-09-12T17:14:59.892102+0000","last_became_active":"2024-09-12T17:11:04.663958+0000","last_became_peered":"2024-09-12T17:11:04.663958+0000","last_unstale":"2024-09-12T17:14:59.892102+0000","last_undegraded":"2024-09-12T17:14:59.892102+0000","last_fullsized":"2024-09-12T17:14:59.892102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:59.891778+0000","last_clean_scrub_stamp":"2024-09-12T17:14:59.891778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:26.957401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:30.044894+0000","last_change":"2024-09-12T17:15:30.044894+0000","last_active":"2024-09-12T17:15:30.044894+0000","last_peered":"2024-09-12T17:15:30.044894+0000","last_clean":"2024-09-12T17:15:30.044894+0000","last_became_active":"2024-09-12T17:11:43.808425+0000","last_became_peered":"2024-09-12T17:11:43.808425+0000","last_unstale":"2024-09-12T17:15:30.044894+0000","last_undegraded":"2024-09-12T17:15:30.044894+0000","last_fullsized":"2024-09-12T17:15:30.044894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:30.044721+0000","last_clean_scrub_stamp":"2024-09-12T17:15:30.044721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:10.826683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:01.287836+0000","last_change":"2024-09-12T17:16:01.287693+0000","last_active":"2024-09-12T17:16:01.287836+0000","last_peered":"2024-09-12T17:16:01.287836+0000","last_clean":"2024-09-12T17:16:01.287836+0000","last_became_active":"2024-09-12T17:11:10.743084+0000","last_became_peered":"2024-09-12T17:11:10.743084+0000","last_unstale":"2024-09-12T17:16:01.287836+0000","last_undegraded":"2024-09-12T17:16:01.287836+0000","last_fullsized":"2024-09-12T17:16:01.287836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:16:01.287470+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:16:01.287470+0000","last_clean_scrub_stamp":"2024-09-12T17:16:01.287470+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:31.223965+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.825583+0000","last_change":"2024-09-12T17:15:47.825453+0000","last_active":"2024-09-12T17:15:47.825583+0000","last_peered":"2024-09-12T17:15:47.825583+0000","last_clean":"2024-09-12T17:15:47.825583+0000","last_became_active":"2024-09-12T17:11:12.758246+0000","last_became_peered":"2024-09-12T17:11:12.758246+0000","last_unstale":"2024-09-12T17:15:47.825583+0000","last_undegraded":"2024-09-12T17:15:47.825583+0000","last_fullsized":"2024-09-12T17:15:47.825583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.825272+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.825272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:30.075123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:14.270941+0000","last_change":"2024-09-12T17:16:14.270941+0000","last_active":"2024-09-12T17:16:14.270941+0000","last_peered":"2024-09-12T17:16:14.270941+0000","last_clean":"2024-09-12T17:16:14.270941+0000","last_became_active":"2024-09-12T17:11:14.765304+0000","last_became_peered":"2024-09-12T17:11:14.765304+0000","last_unstale":"2024-09-12T17:16:14.270941+0000","last_undegraded":"2024-09-12T17:16:14.270941+0000","last_fullsized":"2024-09-12T17:16:14.270941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:16:14.270689+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:16:14.270689+0000","last_clean_scrub_stamp":"2024-09-12T17:16:14.270689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:26.310974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"34'12","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:33.347265+0000","last_change":"2024-09-12T17:15:33.347117+0000","last_active":"2024-09-12T17:15:33.347265+0000","last_peered":"2024-09-12T17:15:33.347265+0000","last_clean":"2024-09-12T17:15:33.347265+0000","last_became_active":"2024-09-12T17:11:06.708597+0000","last_became_peered":"2024-09-12T17:11:06.708597+0000","last_unstale":"2024-09-12T17:15:33.347265+0000","last_undegraded":"2024-09-12T17:15:33.347265+0000","last_fullsized":"2024-09-12T17:15:33.347265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-09-12T17:15:33.346944+0000","last_clean_scrub_stamp":"2024-09-12T17:15:33.346944+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:57.089366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":60,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.858494+0000","last_change":"2024-09-12T17:15:02.858355+0000","last_active":"2024-09-12T17:15:02.858494+0000","last_peered":"2024-09-12T17:15:02.858494+0000","last_clean":"2024-09-12T17:15:02.858494+0000","last_became_active":"2024-09-12T17:11:04.671125+0000","last_became_peered":"2024-09-12T17:11:04.671125+0000","last_unstale":"2024-09-12T17:15:02.858494+0000","last_undegraded":"2024-09-12T17:15:02.858494+0000","last_fullsized":"2024-09-12T17:15:02.858494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.858176+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.858176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:23.000373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:28.068214+0000","last_change":"2024-09-12T17:15:28.068082+0000","last_active":"2024-09-12T17:15:28.068214+0000","last_peered":"2024-09-12T17:15:28.068214+0000","last_clean":"2024-09-12T17:15:28.068214+0000","last_became_active":"2024-09-12T17:11:08.710893+0000","last_became_peered":"2024-09-12T17:11:08.710893+0000","last_unstale":"2024-09-12T17:15:28.068214+0000","last_undegraded":"2024-09-12T17:15:28.068214+0000","last_fullsized":"2024-09-12T17:15:28.068214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:28.067903+0000","last_clean_scrub_stamp":"2024-09-12T17:15:28.067903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:07.804712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":98,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:38.706808+0000","last_change":"2024-09-12T17:15:38.706808+0000","last_active":"2024-09-12T17:15:38.706808+0000","last_peered":"2024-09-12T17:15:38.706808+0000","last_clean":"2024-09-12T17:15:38.706808+0000","last_became_active":"2024-09-12T17:11:10.739326+0000","last_became_peered":"2024-09-12T17:11:10.739326+0000","last_unstale":"2024-09-12T17:15:38.706808+0000","last_undegraded":"2024-09-12T17:15:38.706808+0000","last_fullsized":"2024-09-12T17:15:38.706808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:38.706615+0000","last_clean_scrub_stamp":"2024-09-12T17:15:38.706615+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:06.515086+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:50.610985+0000","last_change":"2024-09-12T17:15:50.610985+0000","last_active":"2024-09-12T17:15:50.610985+0000","last_peered":"2024-09-12T17:15:50.610985+0000","last_clean":"2024-09-12T17:15:50.610985+0000","last_became_active":"2024-09-12T17:11:12.752773+0000","last_became_peered":"2024-09-12T17:11:12.752773+0000","last_unstale":"2024-09-12T17:15:50.610985+0000","last_undegraded":"2024-09-12T17:15:50.610985+0000","last_fullsized":"2024-09-12T17:15:50.610985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:50.610873+0000","last_clean_scrub_stamp":"2024-09-12T17:15:50.610873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:52.368817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'5","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:13.245535+0000","last_change":"2024-09-12T17:16:13.245535+0000","last_active":"2024-09-12T17:16:13.245535+0000","last_peered":"2024-09-12T17:16:13.245535+0000","last_clean":"2024-09-12T17:16:13.245535+0000","last_became_active":"2024-09-12T17:11:14.771428+0000","last_became_peered":"2024-09-12T17:11:14.771428+0000","last_unstale":"2024-09-12T17:16:13.245535+0000","last_undegraded":"2024-09-12T17:16:13.245535+0000","last_fullsized":"2024-09-12T17:16:13.245535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:16:13.245337+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:16:13.245337+0000","last_clean_scrub_stamp":"2024-09-12T17:16:13.245337+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:35.190507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.695132+0000","last_change":"2024-09-12T17:15:15.694857+0000","last_active":"2024-09-12T17:15:15.695132+0000","last_peered":"2024-09-12T17:15:15.695132+0000","last_clean":"2024-09-12T17:15:15.695132+0000","last_became_active":"2024-09-12T17:11:06.699005+0000","last_became_peered":"2024-09-12T17:11:06.699005+0000","last_unstale":"2024-09-12T17:15:15.695132+0000","last_undegraded":"2024-09-12T17:15:15.695132+0000","last_fullsized":"2024-09-12T17:15:15.695132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:15.694614+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.694614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:28.534133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:11.276016+0000","last_change":"2024-09-12T17:15:11.275775+0000","last_active":"2024-09-12T17:15:11.276016+0000","last_peered":"2024-09-12T17:15:11.276016+0000","last_clean":"2024-09-12T17:15:11.276016+0000","last_became_active":"2024-09-12T17:11:04.699256+0000","last_became_peered":"2024-09-12T17:11:04.699256+0000","last_unstale":"2024-09-12T17:15:11.276016+0000","last_undegraded":"2024-09-12T17:15:11.276016+0000","last_fullsized":"2024-09-12T17:15:11.276016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:11.275550+0000","last_clean_scrub_stamp":"2024-09-12T17:15:11.275550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:13.702407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.841600+0000","last_change":"2024-09-12T17:15:35.841473+0000","last_active":"2024-09-12T17:15:35.841600+0000","last_peered":"2024-09-12T17:15:35.841600+0000","last_clean":"2024-09-12T17:15:35.841600+0000","last_became_active":"2024-09-12T17:11:08.701578+0000","last_became_peered":"2024-09-12T17:11:08.701578+0000","last_unstale":"2024-09-12T17:15:35.841600+0000","last_undegraded":"2024-09-12T17:15:35.841600+0000","last_fullsized":"2024-09-12T17:15:35.841600+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:35.841290+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.841290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:56.567347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:02.327511+0000","last_change":"2024-09-12T17:16:02.327511+0000","last_active":"2024-09-12T17:16:02.327511+0000","last_peered":"2024-09-12T17:16:02.327511+0000","last_clean":"2024-09-12T17:16:02.327511+0000","last_became_active":"2024-09-12T17:11:10.748814+0000","last_became_peered":"2024-09-12T17:11:10.748814+0000","last_unstale":"2024-09-12T17:16:02.327511+0000","last_undegraded":"2024-09-12T17:16:02.327511+0000","last_fullsized":"2024-09-12T17:16:02.327511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-09-12T17:16:02.327298+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-09-12T17:16:02.327298+0000","last_clean_scrub_stamp":"2024-09-12T17:16:02.327298+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:00.071926+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'286","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:43.942026+0000","last_change":"2024-09-12T17:15:43.942026+0000","last_active":"2024-09-12T17:15:43.942026+0000","last_peered":"2024-09-12T17:15:43.942026+0000","last_clean":"2024-09-12T17:15:43.942026+0000","last_became_active":"2024-09-12T17:11:12.757820+0000","last_became_peered":"2024-09-12T17:11:12.757820+0000","last_unstale":"2024-09-12T17:15:43.942026+0000","last_undegraded":"2024-09-12T17:15:43.942026+0000","last_fullsized":"2024-09-12T17:15:43.942026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'286","last_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_deep_scrub":"34'286","last_deep_scrub_stamp":"2024-09-12T17:15:43.941828+0000","last_clean_scrub_stamp":"2024-09-12T17:15:43.941828+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:54.981369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"34'8","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:12.242904+0000","last_change":"2024-09-12T17:16:12.242904+0000","last_active":"2024-09-12T17:16:12.242904+0000","last_peered":"2024-09-12T17:16:12.242904+0000","last_clean":"2024-09-12T17:16:12.242904+0000","last_became_active":"2024-09-12T17:11:14.757006+0000","last_became_peered":"2024-09-12T17:11:14.757006+0000","last_unstale":"2024-09-12T17:16:12.242904+0000","last_undegraded":"2024-09-12T17:16:12.242904+0000","last_fullsized":"2024-09-12T17:16:12.242904+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:16:12.242607+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:16:12.242607+0000","last_clean_scrub_stamp":"2024-09-12T17:16:12.242607+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:22.193779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.160600+0000","last_change":"2024-09-12T17:15:19.160440+0000","last_active":"2024-09-12T17:15:19.160600+0000","last_peered":"2024-09-12T17:15:19.160600+0000","last_clean":"2024-09-12T17:15:19.160600+0000","last_became_active":"2024-09-12T17:11:06.691400+0000","last_became_peered":"2024-09-12T17:11:06.691400+0000","last_unstale":"2024-09-12T17:15:19.160600+0000","last_undegraded":"2024-09-12T17:15:19.160600+0000","last_fullsized":"2024-09-12T17:15:19.160600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:19.160245+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.160245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:47.049379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:00.864791+0000","last_change":"2024-09-12T17:15:00.864639+0000","last_active":"2024-09-12T17:15:00.864791+0000","last_peered":"2024-09-12T17:15:00.864791+0000","last_clean":"2024-09-12T17:15:00.864791+0000","last_became_active":"2024-09-12T17:11:04.668922+0000","last_became_peered":"2024-09-12T17:11:04.668922+0000","last_unstale":"2024-09-12T17:15:00.864791+0000","last_undegraded":"2024-09-12T17:15:00.864791+0000","last_fullsized":"2024-09-12T17:15:00.864791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:00.864442+0000","last_clean_scrub_stamp":"2024-09-12T17:15:00.864442+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:24.991687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.833283+0000","last_change":"2024-09-12T17:15:34.833150+0000","last_active":"2024-09-12T17:15:34.833283+0000","last_peered":"2024-09-12T17:15:34.833283+0000","last_clean":"2024-09-12T17:15:34.833283+0000","last_became_active":"2024-09-12T17:11:08.715412+0000","last_became_peered":"2024-09-12T17:11:08.715412+0000","last_unstale":"2024-09-12T17:15:34.833283+0000","last_undegraded":"2024-09-12T17:15:34.833283+0000","last_fullsized":"2024-09-12T17:15:34.833283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:34.832966+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.832966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:45:52.647443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'46","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:42.861639+0000","last_change":"2024-09-12T17:15:42.861499+0000","last_active":"2024-09-12T17:15:42.861639+0000","last_peered":"2024-09-12T17:15:42.861639+0000","last_clean":"2024-09-12T17:15:42.861639+0000","last_became_active":"2024-09-12T17:11:10.719637+0000","last_became_peered":"2024-09-12T17:11:10.719637+0000","last_unstale":"2024-09-12T17:15:42.861639+0000","last_undegraded":"2024-09-12T17:15:42.861639+0000","last_fullsized":"2024-09-12T17:15:42.861639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-09-12T17:15:42.861281+0000","last_clean_scrub_stamp":"2024-09-12T17:15:42.861281+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:02.493188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:47.625355+0000","last_change":"2024-09-12T17:15:47.625209+0000","last_active":"2024-09-12T17:15:47.625355+0000","last_peered":"2024-09-12T17:15:47.625355+0000","last_clean":"2024-09-12T17:15:47.625355+0000","last_became_active":"2024-09-12T17:11:12.753930+0000","last_became_peered":"2024-09-12T17:11:12.753930+0000","last_unstale":"2024-09-12T17:15:47.625355+0000","last_undegraded":"2024-09-12T17:15:47.625355+0000","last_fullsized":"2024-09-12T17:15:47.625355+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:47.625030+0000","last_clean_scrub_stamp":"2024-09-12T17:15:47.625030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:50.457416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:53.844675+0000","last_change":"2024-09-12T17:15:53.844522+0000","last_active":"2024-09-12T17:15:53.844675+0000","last_peered":"2024-09-12T17:15:53.844675+0000","last_clean":"2024-09-12T17:15:53.844675+0000","last_became_active":"2024-09-12T17:11:14.770639+0000","last_became_peered":"2024-09-12T17:11:14.770639+0000","last_unstale":"2024-09-12T17:15:53.844675+0000","last_undegraded":"2024-09-12T17:15:53.844675+0000","last_fullsized":"2024-09-12T17:15:53.844675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:53.844338+0000","last_clean_scrub_stamp":"2024-09-12T17:15:53.844338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:03.815876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.127591+0000","last_change":"2024-09-12T17:15:18.127348+0000","last_active":"2024-09-12T17:15:18.127591+0000","last_peered":"2024-09-12T17:15:18.127591+0000","last_clean":"2024-09-12T17:15:18.127591+0000","last_became_active":"2024-09-12T17:11:06.692669+0000","last_became_peered":"2024-09-12T17:11:06.692669+0000","last_unstale":"2024-09-12T17:15:18.127591+0000","last_undegraded":"2024-09-12T17:15:18.127591+0000","last_fullsized":"2024-09-12T17:15:18.127591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:18.127110+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.127110+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:36.993142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:10.285728+0000","last_change":"2024-09-12T17:15:10.285556+0000","last_active":"2024-09-12T17:15:10.285728+0000","last_peered":"2024-09-12T17:15:10.285728+0000","last_clean":"2024-09-12T17:15:10.285728+0000","last_became_active":"2024-09-12T17:11:04.704501+0000","last_became_peered":"2024-09-12T17:11:04.704501+0000","last_unstale":"2024-09-12T17:15:10.285728+0000","last_undegraded":"2024-09-12T17:15:10.285728+0000","last_fullsized":"2024-09-12T17:15:10.285728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:10.285362+0000","last_clean_scrub_stamp":"2024-09-12T17:15:10.285362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:12.449928+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.037796+0000","last_change":"2024-09-12T17:15:29.037671+0000","last_active":"2024-09-12T17:15:29.037796+0000","last_peered":"2024-09-12T17:15:29.037796+0000","last_clean":"2024-09-12T17:15:29.037796+0000","last_became_active":"2024-09-12T17:11:08.715293+0000","last_became_peered":"2024-09-12T17:11:08.715293+0000","last_unstale":"2024-09-12T17:15:29.037796+0000","last_undegraded":"2024-09-12T17:15:29.037796+0000","last_fullsized":"2024-09-12T17:15:29.037796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:29.037477+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.037477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:54.325784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.646999+0000","last_change":"2024-09-12T17:15:36.646833+0000","last_active":"2024-09-12T17:15:36.646999+0000","last_peered":"2024-09-12T17:15:36.646999+0000","last_clean":"2024-09-12T17:15:36.646999+0000","last_became_active":"2024-09-12T17:11:10.744211+0000","last_became_peered":"2024-09-12T17:11:10.744211+0000","last_unstale":"2024-09-12T17:15:36.646999+0000","last_undegraded":"2024-09-12T17:15:36.646999+0000","last_fullsized":"2024-09-12T17:15:36.646999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'37","last_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_deep_scrub":"34'37","last_deep_scrub_stamp":"2024-09-12T17:15:36.646641+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.646641+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:39.059542+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:08.313576+0000","last_change":"2024-09-12T17:16:08.313576+0000","last_active":"2024-09-12T17:16:08.313576+0000","last_peered":"2024-09-12T17:16:08.313576+0000","last_clean":"2024-09-12T17:16:08.313576+0000","last_became_active":"2024-09-12T17:11:12.745171+0000","last_became_peered":"2024-09-12T17:11:12.745171+0000","last_unstale":"2024-09-12T17:16:08.313576+0000","last_undegraded":"2024-09-12T17:16:08.313576+0000","last_fullsized":"2024-09-12T17:16:08.313576+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:08.313398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:08.313398+0000","last_clean_scrub_stamp":"2024-09-12T17:16:08.313398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:25.990313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"34'2","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:19.256446+0000","last_change":"2024-09-12T17:16:19.256446+0000","last_active":"2024-09-12T17:16:19.256446+0000","last_peered":"2024-09-12T17:16:19.256446+0000","last_clean":"2024-09-12T17:16:19.256446+0000","last_became_active":"2024-09-12T17:11:14.756775+0000","last_became_peered":"2024-09-12T17:11:14.756775+0000","last_unstale":"2024-09-12T17:16:19.256446+0000","last_undegraded":"2024-09-12T17:16:19.256446+0000","last_fullsized":"2024-09-12T17:16:19.256446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:16:19.256265+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:16:19.256265+0000","last_clean_scrub_stamp":"2024-09-12T17:16:19.256265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:23.401581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'10","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.119280+0000","last_change":"2024-09-12T17:15:17.119280+0000","last_active":"2024-09-12T17:15:17.119280+0000","last_peered":"2024-09-12T17:15:17.119280+0000","last_clean":"2024-09-12T17:15:17.119280+0000","last_became_active":"2024-09-12T17:11:43.804591+0000","last_became_peered":"2024-09-12T17:11:43.804591+0000","last_unstale":"2024-09-12T17:15:17.119280+0000","last_undegraded":"2024-09-12T17:15:17.119280+0000","last_fullsized":"2024-09-12T17:15:17.119280+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-09-12T17:15:17.119084+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.119084+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:32.612758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:14:58.581681+0000","last_change":"2024-09-12T17:14:58.581536+0000","last_active":"2024-09-12T17:14:58.581681+0000","last_peered":"2024-09-12T17:14:58.581681+0000","last_clean":"2024-09-12T17:14:58.581681+0000","last_became_active":"2024-09-12T17:11:04.696155+0000","last_became_peered":"2024-09-12T17:11:04.696155+0000","last_unstale":"2024-09-12T17:14:58.581681+0000","last_undegraded":"2024-09-12T17:14:58.581681+0000","last_fullsized":"2024-09-12T17:14:58.581681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:14:58.581351+0000","last_clean_scrub_stamp":"2024-09-12T17:14:58.581351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:52:14.075025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:32.898390+0000","last_change":"2024-09-12T17:15:32.898232+0000","last_active":"2024-09-12T17:15:32.898390+0000","last_peered":"2024-09-12T17:15:32.898390+0000","last_clean":"2024-09-12T17:15:32.898390+0000","last_became_active":"2024-09-12T17:11:08.721674+0000","last_became_peered":"2024-09-12T17:11:08.721674+0000","last_unstale":"2024-09-12T17:15:32.898390+0000","last_undegraded":"2024-09-12T17:15:32.898390+0000","last_fullsized":"2024-09-12T17:15:32.898390+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-12T17:15:32.898046+0000","last_clean_scrub_stamp":"2024-09-12T17:15:32.898046+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:58.817691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'31","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:00.246265+0000","last_change":"2024-09-12T17:16:00.246097+0000","last_active":"2024-09-12T17:16:00.246265+0000","last_peered":"2024-09-12T17:16:00.246265+0000","last_clean":"2024-09-12T17:16:00.246265+0000","last_became_active":"2024-09-12T17:11:10.738021+0000","last_became_peered":"2024-09-12T17:11:10.738021+0000","last_unstale":"2024-09-12T17:16:00.246265+0000","last_undegraded":"2024-09-12T17:16:00.246265+0000","last_fullsized":"2024-09-12T17:16:00.246265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'31","last_scrub_stamp":"2024-09-12T17:16:00.245908+0000","last_deep_scrub":"34'31","last_deep_scrub_stamp":"2024-09-12T17:16:00.245908+0000","last_clean_scrub_stamp":"2024-09-12T17:16:00.245908+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:22:12.239925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:09.329945+0000","last_change":"2024-09-12T17:16:09.329804+0000","last_active":"2024-09-12T17:16:09.329945+0000","last_peered":"2024-09-12T17:16:09.329945+0000","last_clean":"2024-09-12T17:16:09.329945+0000","last_became_active":"2024-09-12T17:11:12.755786+0000","last_became_peered":"2024-09-12T17:11:12.755786+0000","last_unstale":"2024-09-12T17:16:09.329945+0000","last_undegraded":"2024-09-12T17:16:09.329945+0000","last_fullsized":"2024-09-12T17:16:09.329945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:16:09.329619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:16:09.329619+0000","last_clean_scrub_stamp":"2024-09-12T17:16:09.329619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:33.358269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'8","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:17.293955+0000","last_change":"2024-09-12T17:16:17.293955+0000","last_active":"2024-09-12T17:16:17.293955+0000","last_peered":"2024-09-12T17:16:17.293955+0000","last_clean":"2024-09-12T17:16:17.293955+0000","last_became_active":"2024-09-12T17:11:14.778894+0000","last_became_peered":"2024-09-12T17:11:14.778894+0000","last_unstale":"2024-09-12T17:16:17.293955+0000","last_undegraded":"2024-09-12T17:16:17.293955+0000","last_fullsized":"2024-09-12T17:16:17.293955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:16:17.293746+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:16:17.293746+0000","last_clean_scrub_stamp":"2024-09-12T17:16:17.293746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:24.754569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.133079+0000","last_change":"2024-09-12T17:15:16.132949+0000","last_active":"2024-09-12T17:15:16.133079+0000","last_peered":"2024-09-12T17:15:16.133079+0000","last_clean":"2024-09-12T17:15:16.133079+0000","last_became_active":"2024-09-12T17:11:06.688759+0000","last_became_peered":"2024-09-12T17:11:06.688759+0000","last_unstale":"2024-09-12T17:15:16.133079+0000","last_undegraded":"2024-09-12T17:15:16.133079+0000","last_fullsized":"2024-09-12T17:15:16.133079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:16.132765+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.132765+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:29:16.951874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:01.868010+0000","last_change":"2024-09-12T17:15:01.867847+0000","last_active":"2024-09-12T17:15:01.868010+0000","last_peered":"2024-09-12T17:15:01.868010+0000","last_clean":"2024-09-12T17:15:01.868010+0000","last_became_active":"2024-09-12T17:11:04.677196+0000","last_became_peered":"2024-09-12T17:11:04.677196+0000","last_unstale":"2024-09-12T17:15:01.868010+0000","last_undegraded":"2024-09-12T17:15:01.868010+0000","last_fullsized":"2024-09-12T17:15:01.868010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:01.867668+0000","last_clean_scrub_stamp":"2024-09-12T17:15:01.867668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:06.434128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:36.888001+0000","last_change":"2024-09-12T17:15:36.887755+0000","last_active":"2024-09-12T17:15:36.888001+0000","last_peered":"2024-09-12T17:15:36.888001+0000","last_clean":"2024-09-12T17:15:36.888001+0000","last_became_active":"2024-09-12T17:11:08.717099+0000","last_became_peered":"2024-09-12T17:11:08.717099+0000","last_unstale":"2024-09-12T17:15:36.888001+0000","last_undegraded":"2024-09-12T17:15:36.888001+0000","last_fullsized":"2024-09-12T17:15:36.888001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-12T17:15:36.887464+0000","last_clean_scrub_stamp":"2024-09-12T17:15:36.887464+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:14.748108+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'41","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:59.218937+0000","last_change":"2024-09-12T17:15:59.218798+0000","last_active":"2024-09-12T17:15:59.218937+0000","last_peered":"2024-09-12T17:15:59.218937+0000","last_clean":"2024-09-12T17:15:59.218937+0000","last_became_active":"2024-09-12T17:11:10.741965+0000","last_became_peered":"2024-09-12T17:11:10.741965+0000","last_unstale":"2024-09-12T17:15:59.218937+0000","last_undegraded":"2024-09-12T17:15:59.218937+0000","last_fullsized":"2024-09-12T17:15:59.218937+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'41","last_scrub_stamp":"2024-09-12T17:15:59.218580+0000","last_deep_scrub":"34'41","last_deep_scrub_stamp":"2024-09-12T17:15:59.218580+0000","last_clean_scrub_stamp":"2024-09-12T17:15:59.218580+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:40.604790+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:49.652404+0000","last_change":"2024-09-12T17:15:49.652254+0000","last_active":"2024-09-12T17:15:49.652404+0000","last_peered":"2024-09-12T17:15:49.652404+0000","last_clean":"2024-09-12T17:15:49.652404+0000","last_became_active":"2024-09-12T17:11:12.754497+0000","last_became_peered":"2024-09-12T17:11:12.754497+0000","last_unstale":"2024-09-12T17:15:49.652404+0000","last_undegraded":"2024-09-12T17:15:49.652404+0000","last_fullsized":"2024-09-12T17:15:49.652404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:49.652077+0000","last_clean_scrub_stamp":"2024-09-12T17:15:49.652077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:48.997120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:16:15.308898+0000","last_change":"2024-09-12T17:16:15.308898+0000","last_active":"2024-09-12T17:16:15.308898+0000","last_peered":"2024-09-12T17:16:15.308898+0000","last_clean":"2024-09-12T17:16:15.308898+0000","last_became_active":"2024-09-12T17:11:14.756801+0000","last_became_peered":"2024-09-12T17:11:14.756801+0000","last_unstale":"2024-09-12T17:16:15.308898+0000","last_undegraded":"2024-09-12T17:16:15.308898+0000","last_fullsized":"2024-09-12T17:16:15.308898+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:16:15.308680+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:16:15.308680+0000","last_clean_scrub_stamp":"2024-09-12T17:16:15.308680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:57.061324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.889371+0000","last_change":"2024-09-12T17:15:17.889200+0000","last_active":"2024-09-12T17:15:17.889371+0000","last_peered":"2024-09-12T17:15:17.889371+0000","last_clean":"2024-09-12T17:15:17.889371+0000","last_became_active":"2024-09-12T17:11:06.705023+0000","last_became_peered":"2024-09-12T17:11:06.705023+0000","last_unstale":"2024-09-12T17:15:17.889371+0000","last_undegraded":"2024-09-12T17:15:17.889371+0000","last_fullsized":"2024-09-12T17:15:17.889371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:17.889016+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.889016+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:34:57.728810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.238720+0000","last_change":"2024-09-12T17:15:05.238547+0000","last_active":"2024-09-12T17:15:05.238720+0000","last_peered":"2024-09-12T17:15:05.238720+0000","last_clean":"2024-09-12T17:15:05.238720+0000","last_became_active":"2024-09-12T17:11:04.671725+0000","last_became_peered":"2024-09-12T17:11:04.671725+0000","last_unstale":"2024-09-12T17:15:05.238720+0000","last_undegraded":"2024-09-12T17:15:05.238720+0000","last_fullsized":"2024-09-12T17:15:05.238720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.238353+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.238353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:56.750159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.671276+0000","last_change":"2024-09-12T17:15:20.671042+0000","last_active":"2024-09-12T17:15:20.671276+0000","last_peered":"2024-09-12T17:15:20.671276+0000","last_clean":"2024-09-12T17:15:20.671276+0000","last_became_active":"2024-09-12T17:11:06.697753+0000","last_became_peered":"2024-09-12T17:11:06.697753+0000","last_unstale":"2024-09-12T17:15:20.671276+0000","last_undegraded":"2024-09-12T17:15:20.671276+0000","last_fullsized":"2024-09-12T17:15:20.671276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.670806+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.670806+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:30.872392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:02.616378+0000","last_change":"2024-09-12T17:15:02.616092+0000","last_active":"2024-09-12T17:15:02.616378+0000","last_peered":"2024-09-12T17:15:02.616378+0000","last_clean":"2024-09-12T17:15:02.616378+0000","last_became_active":"2024-09-12T17:11:04.674114+0000","last_became_peered":"2024-09-12T17:11:04.674114+0000","last_unstale":"2024-09-12T17:15:02.616378+0000","last_undegraded":"2024-09-12T17:15:02.616378+0000","last_fullsized":"2024-09-12T17:15:02.616378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:02.615816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:02.615816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:34.024352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:34.322903+0000","last_change":"2024-09-12T17:15:34.322903+0000","last_active":"2024-09-12T17:15:34.322903+0000","last_peered":"2024-09-12T17:15:34.322903+0000","last_clean":"2024-09-12T17:15:34.322903+0000","last_became_active":"2024-09-12T17:11:06.694944+0000","last_became_peered":"2024-09-12T17:11:06.694944+0000","last_unstale":"2024-09-12T17:15:34.322903+0000","last_undegraded":"2024-09-12T17:15:34.322903+0000","last_fullsized":"2024-09-12T17:15:34.322903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:34.322694+0000","last_clean_scrub_stamp":"2024-09-12T17:15:34.322694+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:48.925147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":63,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:13.284536+0000","last_change":"2024-09-12T17:15:13.284400+0000","last_active":"2024-09-12T17:15:13.284536+0000","last_peered":"2024-09-12T17:15:13.284536+0000","last_clean":"2024-09-12T17:15:13.284536+0000","last_became_active":"2024-09-12T17:11:04.703505+0000","last_became_peered":"2024-09-12T17:11:04.703505+0000","last_unstale":"2024-09-12T17:15:13.284536+0000","last_undegraded":"2024-09-12T17:15:13.284536+0000","last_fullsized":"2024-09-12T17:15:13.284536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:13.284187+0000","last_clean_scrub_stamp":"2024-09-12T17:15:13.284187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:57.850098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.670504+0000","last_change":"2024-09-12T17:15:19.670350+0000","last_active":"2024-09-12T17:15:19.670504+0000","last_peered":"2024-09-12T17:15:19.670504+0000","last_clean":"2024-09-12T17:15:19.670504+0000","last_became_active":"2024-09-12T17:11:06.699432+0000","last_became_peered":"2024-09-12T17:11:06.699432+0000","last_unstale":"2024-09-12T17:15:19.670504+0000","last_undegraded":"2024-09-12T17:15:19.670504+0000","last_fullsized":"2024-09-12T17:15:19.670504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:19.670162+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.670162+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:29.009474+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.567132+0000","last_change":"2024-09-12T17:15:03.566984+0000","last_active":"2024-09-12T17:15:03.567132+0000","last_peered":"2024-09-12T17:15:03.567132+0000","last_clean":"2024-09-12T17:15:03.567132+0000","last_became_active":"2024-09-12T17:11:04.683427+0000","last_became_peered":"2024-09-12T17:11:04.683427+0000","last_unstale":"2024-09-12T17:15:03.567132+0000","last_undegraded":"2024-09-12T17:15:03.567132+0000","last_fullsized":"2024-09-12T17:15:03.567132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:03.566768+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.566768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:44:47.560762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.649801+0000","last_change":"2024-09-12T17:15:17.649633+0000","last_active":"2024-09-12T17:15:17.649801+0000","last_peered":"2024-09-12T17:15:17.649801+0000","last_clean":"2024-09-12T17:15:17.649801+0000","last_became_active":"2024-09-12T17:11:06.701823+0000","last_became_peered":"2024-09-12T17:11:06.701823+0000","last_unstale":"2024-09-12T17:15:17.649801+0000","last_undegraded":"2024-09-12T17:15:17.649801+0000","last_fullsized":"2024-09-12T17:15:17.649801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.649454+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.649454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:05.606953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.571576+0000","last_change":"2024-09-12T17:15:04.571415+0000","last_active":"2024-09-12T17:15:04.571576+0000","last_peered":"2024-09-12T17:15:04.571576+0000","last_clean":"2024-09-12T17:15:04.571576+0000","last_became_active":"2024-09-12T17:11:04.680048+0000","last_became_peered":"2024-09-12T17:11:04.680048+0000","last_unstale":"2024-09-12T17:15:04.571576+0000","last_undegraded":"2024-09-12T17:15:04.571576+0000","last_fullsized":"2024-09-12T17:15:04.571576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.571227+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.571227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:32:38.651271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.873095+0000","last_change":"2024-09-12T17:15:16.872841+0000","last_active":"2024-09-12T17:15:16.873095+0000","last_peered":"2024-09-12T17:15:16.873095+0000","last_clean":"2024-09-12T17:15:16.873095+0000","last_became_active":"2024-09-12T17:11:06.705191+0000","last_became_peered":"2024-09-12T17:11:06.705191+0000","last_unstale":"2024-09-12T17:15:16.873095+0000","last_undegraded":"2024-09-12T17:15:16.873095+0000","last_fullsized":"2024-09-12T17:15:16.873095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:16.872542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.872542+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:45.755207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:03.875249+0000","last_change":"2024-09-12T17:15:03.875105+0000","last_active":"2024-09-12T17:15:03.875249+0000","last_peered":"2024-09-12T17:15:03.875249+0000","last_clean":"2024-09-12T17:15:03.875249+0000","last_became_active":"2024-09-12T17:11:04.668882+0000","last_became_peered":"2024-09-12T17:11:04.668882+0000","last_unstale":"2024-09-12T17:15:03.875249+0000","last_undegraded":"2024-09-12T17:15:03.875249+0000","last_fullsized":"2024-09-12T17:15:03.875249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:03.874897+0000","last_clean_scrub_stamp":"2024-09-12T17:15:03.874897+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:32.945371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.700030+0000","last_change":"2024-09-12T17:15:18.699771+0000","last_active":"2024-09-12T17:15:18.700030+0000","last_peered":"2024-09-12T17:15:18.700030+0000","last_clean":"2024-09-12T17:15:18.700030+0000","last_became_active":"2024-09-12T17:11:06.698835+0000","last_became_peered":"2024-09-12T17:11:06.698835+0000","last_unstale":"2024-09-12T17:15:18.700030+0000","last_undegraded":"2024-09-12T17:15:18.700030+0000","last_fullsized":"2024-09-12T17:15:18.700030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.699553+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.699553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:11.188707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.247386+0000","last_change":"2024-09-12T17:15:04.247188+0000","last_active":"2024-09-12T17:15:04.247386+0000","last_peered":"2024-09-12T17:15:04.247386+0000","last_clean":"2024-09-12T17:15:04.247386+0000","last_became_active":"2024-09-12T17:11:04.687356+0000","last_became_peered":"2024-09-12T17:11:04.687356+0000","last_unstale":"2024-09-12T17:15:04.247386+0000","last_undegraded":"2024-09-12T17:15:04.247386+0000","last_fullsized":"2024-09-12T17:15:04.247386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:04.247001+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.247001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:40.105409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:15.861612+0000","last_change":"2024-09-12T17:15:15.861444+0000","last_active":"2024-09-12T17:15:15.861612+0000","last_peered":"2024-09-12T17:15:15.861612+0000","last_clean":"2024-09-12T17:15:15.861612+0000","last_became_active":"2024-09-12T17:11:06.688796+0000","last_became_peered":"2024-09-12T17:11:06.688796+0000","last_unstale":"2024-09-12T17:15:15.861612+0000","last_undegraded":"2024-09-12T17:15:15.861612+0000","last_fullsized":"2024-09-12T17:15:15.861612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:15.861265+0000","last_clean_scrub_stamp":"2024-09-12T17:15:15.861265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:04.696684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.597439+0000","last_change":"2024-09-12T17:15:05.597274+0000","last_active":"2024-09-12T17:15:05.597439+0000","last_peered":"2024-09-12T17:15:05.597439+0000","last_clean":"2024-09-12T17:15:05.597439+0000","last_became_active":"2024-09-12T17:11:04.677470+0000","last_became_peered":"2024-09-12T17:11:04.677470+0000","last_unstale":"2024-09-12T17:15:05.597439+0000","last_undegraded":"2024-09-12T17:15:05.597439+0000","last_fullsized":"2024-09-12T17:15:05.597439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.597076+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.597076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:16.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.894915+0000","last_change":"2024-09-12T17:15:21.894740+0000","last_active":"2024-09-12T17:15:21.894915+0000","last_peered":"2024-09-12T17:15:21.894915+0000","last_clean":"2024-09-12T17:15:21.894915+0000","last_became_active":"2024-09-12T17:11:06.703106+0000","last_became_peered":"2024-09-12T17:11:06.703106+0000","last_unstale":"2024-09-12T17:15:21.894915+0000","last_undegraded":"2024-09-12T17:15:21.894915+0000","last_fullsized":"2024-09-12T17:15:21.894915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:21.894560+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.894560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:42.114364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:14.277700+0000","last_change":"2024-09-12T17:15:14.277545+0000","last_active":"2024-09-12T17:15:14.277700+0000","last_peered":"2024-09-12T17:15:14.277700+0000","last_clean":"2024-09-12T17:15:14.277700+0000","last_became_active":"2024-09-12T17:11:04.699038+0000","last_became_peered":"2024-09-12T17:11:04.699038+0000","last_unstale":"2024-09-12T17:15:14.277700+0000","last_undegraded":"2024-09-12T17:15:14.277700+0000","last_fullsized":"2024-09-12T17:15:14.277700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:14.277335+0000","last_clean_scrub_stamp":"2024-09-12T17:15:14.277335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:30.472821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:35.355322+0000","last_change":"2024-09-12T17:15:35.355049+0000","last_active":"2024-09-12T17:15:35.355322+0000","last_peered":"2024-09-12T17:15:35.355322+0000","last_clean":"2024-09-12T17:15:35.355322+0000","last_became_active":"2024-09-12T17:11:06.692694+0000","last_became_peered":"2024-09-12T17:11:06.692694+0000","last_unstale":"2024-09-12T17:15:35.355322+0000","last_undegraded":"2024-09-12T17:15:35.355322+0000","last_fullsized":"2024-09-12T17:15:35.355322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-12T17:15:35.354816+0000","last_clean_scrub_stamp":"2024-09-12T17:15:35.354816+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:08.672902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.549503+0000","last_change":"2024-09-12T17:15:06.549362+0000","last_active":"2024-09-12T17:15:06.549503+0000","last_peered":"2024-09-12T17:15:06.549503+0000","last_clean":"2024-09-12T17:15:06.549503+0000","last_became_active":"2024-09-12T17:11:04.682577+0000","last_became_peered":"2024-09-12T17:11:04.682577+0000","last_unstale":"2024-09-12T17:15:06.549503+0000","last_undegraded":"2024-09-12T17:15:06.549503+0000","last_fullsized":"2024-09-12T17:15:06.549503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.549179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.549179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:02.554930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:21.628694+0000","last_change":"2024-09-12T17:15:21.628515+0000","last_active":"2024-09-12T17:15:21.628694+0000","last_peered":"2024-09-12T17:15:21.628694+0000","last_clean":"2024-09-12T17:15:21.628694+0000","last_became_active":"2024-09-12T17:11:06.701925+0000","last_became_peered":"2024-09-12T17:11:06.701925+0000","last_unstale":"2024-09-12T17:15:21.628694+0000","last_undegraded":"2024-09-12T17:15:21.628694+0000","last_fullsized":"2024-09-12T17:15:21.628694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-12T17:15:21.628332+0000","last_clean_scrub_stamp":"2024-09-12T17:15:21.628332+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:19.659256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:04.916560+0000","last_change":"2024-09-12T17:15:04.916380+0000","last_active":"2024-09-12T17:15:04.916560+0000","last_peered":"2024-09-12T17:15:04.916560+0000","last_clean":"2024-09-12T17:15:04.916560+0000","last_became_active":"2024-09-12T17:11:04.671213+0000","last_became_peered":"2024-09-12T17:11:04.671213+0000","last_unstale":"2024-09-12T17:15:04.916560+0000","last_undegraded":"2024-09-12T17:15:04.916560+0000","last_fullsized":"2024-09-12T17:15:04.916560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:04.916186+0000","last_clean_scrub_stamp":"2024-09-12T17:15:04.916186+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:14.335123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'20","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.882899+0000","last_change":"2024-09-12T17:15:22.882754+0000","last_active":"2024-09-12T17:15:22.882899+0000","last_peered":"2024-09-12T17:15:22.882899+0000","last_clean":"2024-09-12T17:15:22.882899+0000","last_became_active":"2024-09-12T17:11:06.696975+0000","last_became_peered":"2024-09-12T17:11:06.696975+0000","last_unstale":"2024-09-12T17:15:22.882899+0000","last_undegraded":"2024-09-12T17:15:22.882899+0000","last_fullsized":"2024-09-12T17:15:22.882899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'20","last_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_deep_scrub":"34'20","last_deep_scrub_stamp":"2024-09-12T17:15:22.882573+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.882573+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:01.302462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":85,"num_read_kb":77,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:05.892920+0000","last_change":"2024-09-12T17:15:05.892750+0000","last_active":"2024-09-12T17:15:05.892920+0000","last_peered":"2024-09-12T17:15:05.892920+0000","last_clean":"2024-09-12T17:15:05.892920+0000","last_became_active":"2024-09-12T17:11:04.669289+0000","last_became_peered":"2024-09-12T17:11:04.669289+0000","last_unstale":"2024-09-12T17:15:05.892920+0000","last_undegraded":"2024-09-12T17:15:05.892920+0000","last_fullsized":"2024-09-12T17:15:05.892920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:05.892542+0000","last_clean_scrub_stamp":"2024-09-12T17:15:05.892542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:20:36.813883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:19.916868+0000","last_change":"2024-09-12T17:15:19.916708+0000","last_active":"2024-09-12T17:15:19.916868+0000","last_peered":"2024-09-12T17:15:19.916868+0000","last_clean":"2024-09-12T17:15:19.916868+0000","last_became_active":"2024-09-12T17:11:06.705133+0000","last_became_peered":"2024-09-12T17:11:06.705133+0000","last_unstale":"2024-09-12T17:15:19.916868+0000","last_undegraded":"2024-09-12T17:15:19.916868+0000","last_fullsized":"2024-09-12T17:15:19.916868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:19.916525+0000","last_clean_scrub_stamp":"2024-09-12T17:15:19.916525+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:00:08.259459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.324327+0000","last_change":"2024-09-12T17:15:20.324077+0000","last_active":"2024-09-12T17:15:20.324327+0000","last_peered":"2024-09-12T17:15:20.324327+0000","last_clean":"2024-09-12T17:15:20.324327+0000","last_became_active":"2024-09-12T17:11:04.698447+0000","last_became_peered":"2024-09-12T17:11:04.698447+0000","last_unstale":"2024-09-12T17:15:20.324327+0000","last_undegraded":"2024-09-12T17:15:20.324327+0000","last_fullsized":"2024-09-12T17:15:20.324327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:20.323778+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.323778+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:06.113896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.882796+0000","last_change":"2024-09-12T17:15:20.882625+0000","last_active":"2024-09-12T17:15:20.882796+0000","last_peered":"2024-09-12T17:15:20.882796+0000","last_clean":"2024-09-12T17:15:20.882796+0000","last_became_active":"2024-09-12T17:11:06.697378+0000","last_became_peered":"2024-09-12T17:11:06.697378+0000","last_unstale":"2024-09-12T17:15:20.882796+0000","last_undegraded":"2024-09-12T17:15:20.882796+0000","last_fullsized":"2024-09-12T17:15:20.882796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.882443+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.882443+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:33.227785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:16.295924+0000","last_change":"2024-09-12T17:15:16.295674+0000","last_active":"2024-09-12T17:15:16.295924+0000","last_peered":"2024-09-12T17:15:16.295924+0000","last_clean":"2024-09-12T17:15:16.295924+0000","last_became_active":"2024-09-12T17:11:04.705548+0000","last_became_peered":"2024-09-12T17:11:04.705548+0000","last_unstale":"2024-09-12T17:15:16.295924+0000","last_undegraded":"2024-09-12T17:15:16.295924+0000","last_fullsized":"2024-09-12T17:15:16.295924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:16.295447+0000","last_clean_scrub_stamp":"2024-09-12T17:15:16.295447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:40:39.795551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:20.139028+0000","last_change":"2024-09-12T17:15:20.138893+0000","last_active":"2024-09-12T17:15:20.139028+0000","last_peered":"2024-09-12T17:15:20.139028+0000","last_clean":"2024-09-12T17:15:20.139028+0000","last_became_active":"2024-09-12T17:11:43.795456+0000","last_became_peered":"2024-09-12T17:11:43.795456+0000","last_unstale":"2024-09-12T17:15:20.139028+0000","last_undegraded":"2024-09-12T17:15:20.139028+0000","last_fullsized":"2024-09-12T17:15:20.139028+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:20.138667+0000","last_clean_scrub_stamp":"2024-09-12T17:15:20.138667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:48:31.029770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:06.206544+0000","last_change":"2024-09-12T17:15:06.206386+0000","last_active":"2024-09-12T17:15:06.206544+0000","last_peered":"2024-09-12T17:15:06.206544+0000","last_clean":"2024-09-12T17:15:06.206544+0000","last_became_active":"2024-09-12T17:11:04.687718+0000","last_became_peered":"2024-09-12T17:11:04.687718+0000","last_unstale":"2024-09-12T17:15:06.206544+0000","last_undegraded":"2024-09-12T17:15:06.206544+0000","last_fullsized":"2024-09-12T17:15:06.206544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:06.206190+0000","last_clean_scrub_stamp":"2024-09-12T17:15:06.206190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:54:25.118231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'14","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.926993+0000","last_change":"2024-09-12T17:15:18.926822+0000","last_active":"2024-09-12T17:15:18.926993+0000","last_peered":"2024-09-12T17:15:18.926993+0000","last_clean":"2024-09-12T17:15:18.926993+0000","last_became_active":"2024-09-12T17:11:06.691358+0000","last_became_peered":"2024-09-12T17:11:06.691358+0000","last_unstale":"2024-09-12T17:15:18.926993+0000","last_undegraded":"2024-09-12T17:15:18.926993+0000","last_fullsized":"2024-09-12T17:15:18.926993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-09-12T17:15:18.926612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.926612+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:31.452117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:17.317435+0000","last_change":"2024-09-12T17:15:17.317282+0000","last_active":"2024-09-12T17:15:17.317435+0000","last_peered":"2024-09-12T17:15:17.317435+0000","last_clean":"2024-09-12T17:15:17.317435+0000","last_became_active":"2024-09-12T17:11:04.698560+0000","last_became_peered":"2024-09-12T17:11:04.698560+0000","last_unstale":"2024-09-12T17:15:17.317435+0000","last_undegraded":"2024-09-12T17:15:17.317435+0000","last_fullsized":"2024-09-12T17:15:17.317435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:17.317078+0000","last_clean_scrub_stamp":"2024-09-12T17:15:17.317078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:13.516624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:18.338988+0000","last_change":"2024-09-12T17:15:18.338825+0000","last_active":"2024-09-12T17:15:18.338988+0000","last_peered":"2024-09-12T17:15:18.338988+0000","last_clean":"2024-09-12T17:15:18.338988+0000","last_became_active":"2024-09-12T17:11:04.698348+0000","last_became_peered":"2024-09-12T17:11:04.698348+0000","last_unstale":"2024-09-12T17:15:18.338988+0000","last_undegraded":"2024-09-12T17:15:18.338988+0000","last_fullsized":"2024-09-12T17:15:18.338988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-12T17:15:18.338612+0000","last_clean_scrub_stamp":"2024-09-12T17:15:18.338612+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:11.611344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:22.612522+0000","last_change":"2024-09-12T17:15:22.612356+0000","last_active":"2024-09-12T17:15:22.612522+0000","last_peered":"2024-09-12T17:15:22.612522+0000","last_clean":"2024-09-12T17:15:22.612522+0000","last_became_active":"2024-09-12T17:11:06.698606+0000","last_became_peered":"2024-09-12T17:11:06.698606+0000","last_unstale":"2024-09-12T17:15:22.612522+0000","last_undegraded":"2024-09-12T17:15:22.612522+0000","last_fullsized":"2024-09-12T17:15:22.612522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-12T17:15:22.612179+0000","last_clean_scrub_stamp":"2024-09-12T17:15:22.612179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:31.610905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:07.598211+0000","last_change":"2024-09-12T17:15:07.598077+0000","last_active":"2024-09-12T17:15:07.598211+0000","last_peered":"2024-09-12T17:15:07.598211+0000","last_clean":"2024-09-12T17:15:07.598211+0000","last_became_active":"2024-09-12T17:11:04.682686+0000","last_became_peered":"2024-09-12T17:11:04.682686+0000","last_unstale":"2024-09-12T17:15:07.598211+0000","last_undegraded":"2024-09-12T17:15:07.598211+0000","last_fullsized":"2024-09-12T17:15:07.598211+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:15:07.597893+0000","last_clean_scrub_stamp":"2024-09-12T17:15:07.597893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:32.700321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'8","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T17:15:29.855004+0000","last_change":"2024-09-12T17:15:29.854853+0000","last_active":"2024-09-12T17:15:29.855004+0000","last_peered":"2024-09-12T17:15:29.855004+0000","last_clean":"2024-09-12T17:15:29.855004+0000","last_became_active":"2024-09-12T17:11:06.705619+0000","last_became_peered":"2024-09-12T17:11:06.705619+0000","last_unstale":"2024-09-12T17:15:29.855004+0000","last_undegraded":"2024-09-12T17:15:29.855004+0000","last_fullsized":"2024-09-12T17:15:29.855004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-09-12T17:15:29.854616+0000","last_clean_scrub_stamp":"2024-09-12T17:15:29.854616+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:22.735044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1557,"ondisk_log_size":1557,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1673,"num_read_kb":1563,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640330,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39976,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331864,"statfs":{"total":96636764160,"available":96595828736,"internally_reserved":0,"allocated":483328,"data_stored":152070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640330,"num_pgs":137,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":1036288,"data_stored":740928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949673034,"num_pgs":150,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":446464,"data_stored":150838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705737,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1015808,"data_stored":739668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:16:38.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T17:16:38.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f524af50640 1 Processor -- start 2024-09-12T17:16:38.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f524af50640 1 -- start start 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f524af50640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f524412cf30 0x7f524412d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f524af50640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5244096ac0 con 0x7f524412d850 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f524af50640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5244099b00 con 0x7f524412cf30 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f5243fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f524412d850 0x7f5244094050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50476/0 (socket says 172.21.15.62:50476) 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f5243fff640 1 -- 172.21.15.62:0/1164492889 learned_addr learned my addr 172.21.15.62:0/1164492889 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f5248cec640 1 --2- 172.21.15.62:0/1164492889 >> v2:172.21.15.62:3300/0 conn(0x7f524412cf30 0x7f524412d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870901346 0 0) 0x7f5244096ac0 con 0x7f524412d850 2024-09-12T17:16:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5234003530 con 0x7f524412d850 2024-09-12T17:16:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f5248cec640 1 -- 172.21.15.62:0/1164492889 >> v1:172.21.15.62:6789/0 conn(0x7f524412d850 legacy=0x7f5244094050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2831700939 0 0) 0x7f5234003530 con 0x7f524412d850 2024-09-12T17:16:38.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.674+0000 7f5248cec640 1 -- 172.21.15.62:0/1164492889 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524409a160 con 0x7f524412cf30 2024-09-12T17:16:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 --2- 172.21.15.62:0/1164492889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524412d310 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5238009740 tx=0x7f523801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a08f4393bc503e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52380b0070 con 0x7f524412cf30 2024-09-12T17:16:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380ab400 con 0x7f524412cf30 2024-09-12T17:16:38.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f52437fe640 1 -- 172.21.15.62:0/1164492889 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5230001630 con 0x7f524412cf30 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- 172.21.15.62:0/1164492889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 msgr2=0x7f524412d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 --2- 172.21.15.62:0/1164492889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524412d310 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5238009740 tx=0x7f523801c320 comp rx=0 tx=0).stop 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- 172.21.15.62:0/1164492889 shutdown_connections 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 --2- 172.21.15.62:0/1164492889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524412d310 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- 172.21.15.62:0/1164492889 >> 172.21.15.62:0/1164492889 conn(0x7f524409a930 msgr2=0x7f524409ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- 172.21.15.62:0/1164492889 shutdown_connections 2024-09-12T17:16:38.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- 172.21.15.62:0/1164492889 wait complete. 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 Processor -- start 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- start start 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f524af50640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5244135600 con 0x7f524412cf30 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36586/0 (socket says 172.21.15.62:36586) 2024-09-12T17:16:38.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 -- 172.21.15.62:0/162047883 learned_addr learned my addr 172.21.15.62:0/162047883 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 -- 172.21.15.62:0/162047883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524408f5c0 con 0x7f524412cf30 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.678+0000 7f5248cec640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5238009740 tx=0x7f523801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52380bb020 con 0x7f524412cf30 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52380b1040 con 0x7f524412cf30 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524408ea50 con 0x7f524412cf30 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52380b0050 con 0x7f524412cf30 2024-09-12T17:16:38.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524408fad0 con 0x7f524412cf30 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f524408fdb0 con 0x7f524412cf30 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 48332+0+0 (secure 0 0 0) 0x7f52380be070 con 0x7f524412cf30 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 0x7f522803d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6284+0+0 (secure 0 0 0) 0x7f52380e9000 con 0x7f524412cf30 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f5243fff640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 0x7f522803d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T17:16:38.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.682+0000 7f5243fff640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 0x7f522803d6c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5230001ec0 tx=0x7f52300019b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T17:16:38.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.686+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (secure 0 0 0) 0x7f5238015f10 con 0x7f524412cf30 2024-09-12T17:16:38.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.854+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f524412d390 con 0x7f524412cf30 2024-09-12T17:16:38.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.858+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f52380b5610 con 0x7f524412cf30 2024-09-12T17:16:38.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f52417fa640 1 -- 172.21.15.62:0/162047883 <== mon.0 v2:172.21.15.62:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f52380b46c0 con 0x7f524412cf30 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 msgr2=0x7f522803d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 0x7f522803d6c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5230001ec0 tx=0x7f52300019b0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 msgr2=0x7f524408d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5238009740 tx=0x7f523801ab60 comp rx=0 tx=0).stop 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 shutdown_connections 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.193:6824/1409480917,v1:172.21.15.193:6825/1409480917] conn(0x7f522803b200 0x7f522803d6c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 --2- 172.21.15.62:0/162047883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f524412cf30 0x7f524408d520 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 >> 172.21.15.62:0/162047883 conn(0x7f524409a930 msgr2=0x7f5244072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T17:16:38.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 shutdown_connections 2024-09-12T17:16:38.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T17:16:38.862+0000 7f524af50640 1 -- 172.21.15.62:0/162047883 wait complete. 2024-09-12T17:16:38.880 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T17:16:38.880 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T17:16:38.880 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T17:16:38.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:43.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T17:16:44.982 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T17:16:44.982 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T17:16:44.982 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:45.041 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T17:16:45.041 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T17:16:45.041 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:45.139 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T17:16:45.140 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T17:16:45.140 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:48.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T17:16:48.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T17:16:51.242 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T17:16:51.242 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T17:16:51.242 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T17:16:51.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:51.280 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T17:16:51.281 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T17:16:51.281 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T17:16:51.281 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:16:51.302 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T17:16:51.302 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T17:16:51.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-12T17:16:51.362 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T17:16:51.362 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T17:16:51.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:16:51.583 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T17:16:51.857 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:16:51.857 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T17:16:52.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:16:52.058 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T17:16:52.245 INFO:tasks.ceph:Archiving mon data... 2024-09-12T17:16:52.246 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/data/mon.a.tgz 2024-09-12T17:16:52.247 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T17:16:52.252 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.leln0CrVM9 2024-09-12T17:16:52.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.leln0CrVM9 2024-09-12T17:16:52.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.leln0CrVM9 2024-09-12T17:16:52.451 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.leln0CrVM9 is 301KB 2024-09-12T17:16:52.508 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.leln0CrVM9 2024-09-12T17:16:52.513 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T17:16:52.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:16:52.559 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:16:52.623 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:16:52.628 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:16:52.628 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T17:16:52.630 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi062/crash 2024-09-12T17:16:52.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:16:52.678 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi193/crash 2024-09-12T17:16:52.679 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:16:52.693 INFO:tasks.ceph:Compressing logs... 2024-09-12T17:16:52.693 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:16:52.723 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:16:52.746 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24607.log 2024-09-12T17:16:52.747 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22750.log 2024-09-12T17:16:52.747 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25154.log 2024-09-12T17:16:52.748 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22750.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24607.log.gz 2024-09-12T17:16:52.748 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22820.log 2024-09-12T17:16:52.748 INFO:teuthology.orchestra.run.smithi062.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.22750.log.gz 2024-09-12T17:16:52.748 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T17:16:52.749 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25154.log: /var/log/ceph/ceph-client.admin.22820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25102.log 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.22820.log.gz 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25128.log 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25154.log.gz 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.25102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.24946.log 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25128.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25102.log.gz 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T17:16:52.750 INFO:teuthology.orchestra.run.smithi062.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25128.log.gz 2024-09-12T17:16:52.751 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25206.log 2024-09-12T17:16:52.751 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24946.log.gz 2024-09-12T17:16:52.751 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25316.log 2024-09-12T17:16:52.751 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24387.log 2024-09-12T17:16:52.752 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25206.log.gz 2024-09-12T17:16:52.752 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24855.log 2024-09-12T17:16:52.753 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25316.log.gz -5 2024-09-12T17:16:52.753 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24920.log 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24387.log: /var/log/ceph/ceph-client.admin.24855.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24387.log.gz 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24439.log 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24855.log.gz 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25366.log 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24920.log.gz 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24367.log 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24439.log.gz 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25076.log 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25366.log.gz 2024-09-12T17:16:52.755 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24495.log 2024-09-12T17:16:52.757 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.24367.log.gz 2024-09-12T17:16:52.757 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22861.log 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24495.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25076.log.gz 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24998.log 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24495.log.gz 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.22861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24606.log 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.22861.log.gz 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25264.log 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24998.log: /var/log/ceph/ceph-client.admin.24606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24317.log 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24998.log.gz 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24606.log.gz 2024-09-12T17:16:52.758 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25024.log 2024-09-12T17:16:52.760 INFO:teuthology.orchestra.run.smithi062.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25264.log.gz 2024-09-12T17:16:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24465.log 2024-09-12T17:16:52.760 INFO:teuthology.orchestra.run.smithi062.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.24317.log.gz 2024-09-12T17:16:52.760 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24699.log 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25024.log.gz 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24599.log 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24465.log.gz 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24699.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24699.log.gz 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24972.log 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24599.log: 86.2%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.24599.log.gz 2024-09-12T17:16:52.761 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24729.log 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25290.log 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.24972.log.gz 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25235.log 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24729.log.gz 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24894.log 2024-09-12T17:16:52.763 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.25290.log.gz 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24829.log 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25235.log: /var/log/ceph/ceph-client.admin.24894.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25235.log.gz 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25342.log 2024-09-12T17:16:52.764 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.24894.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24829.log: /var/log/ceph/ceph.audit.log: 85.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.24829.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.24342.log 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24503.log 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24342.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25342.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25180.log 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24342.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24501.log 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24503.log.gz 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24502.log 2024-09-12T17:16:52.767 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.25180.log: /var/log/ceph/ceph-client.admin.24501.log: gzip -5 --verbose -- 85.7% /var/log/ceph/ceph.tmp-client.admin.21501.log 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25180.log.gz 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24501.log.gz 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24703.log 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.24502.log.gz 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.tmp-client.admin.21501.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph.tmp-client.admin.21501.log.gz /var/log/ceph/ceph-client.admin.24413.log 2024-09-12T17:16:52.768 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T17:16:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24803.log 2024-09-12T17:16:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24413.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24703.log.gz 2024-09-12T17:16:52.770 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24709.log 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24803.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24413.log.gz 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24597.log 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.24803.log.gz 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24271.log 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24709.log.gz 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25050.log 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24597.log.gz 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.24271.log: /var/log/ceph/ceph-client.admin.25050.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24271.log.gz 2024-09-12T17:16:52.771 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25050.log.gz 2024-09-12T17:16:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46123.log 2024-09-12T17:16:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49073.log 2024-09-12T17:16:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.46123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44353.log 2024-09-12T17:16:52.775 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.49073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56743.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.46123.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.44353.log: /var/log/ceph/ceph-client.0.56743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68543.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28892.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49073.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.68543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25154.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25082.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44353.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56743.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25154.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28892.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71493.log 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.25154.log.gz 2024-09-12T17:16:52.776 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68543.log.gz 2024-09-12T17:16:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41403.log 2024-09-12T17:16:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.71493.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.25082.log.gz 2024-09-12T17:16:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69723.log 2024-09-12T17:16:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.41403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72083.log 2024-09-12T17:16:52.777 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.69723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83263.log 2024-09-12T17:16:52.779 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50253.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.72083.log: /var/log/ceph/ceph-client.0.83263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29609.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.41403.log.gz 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71493.log.gz 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%/var/log/ceph/ceph-client.0.50253.log: -- replaced with /var/log/ceph/ceph-client.0.69723.log.gz 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61463.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33733.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.29609.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72083.log.gz 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.61463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66183.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.83263.log.gz/var/log/ceph/ceph-client.0.33733.log: 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30789.log 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50253.log.gz 2024-09-12T17:16:52.780 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.66183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25106.log 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.29609.log.gz 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.30789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31969.log 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.33733.log.gz 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53203.log 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25106.log.gz 2024-09-12T17:16:52.781 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.31969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73263.log 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.53203.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.66183.log.gz 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.73263.log: 91.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80903.log 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.30789.log.gz 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85033.log 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.2.log: 93.5% 91.7% -- replaced with /var/log/ceph/ceph-client.0.31969.log.gz 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.61463.log.gz/var/log/ceph/ceph-client.0.80903.log: 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35503.log 2024-09-12T17:16:52.785 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53203.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.85033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85623.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.35503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64413.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.85623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46713.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8% 91.3% -- replaced with /var/log/ceph/ceph-client.0.80903.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.73263.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.64413.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85033.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35503.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86213.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40223.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.46713.log: /var/log/ceph/ceph-client.0.86213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41993.log 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3%/var/log/ceph/ceph-client.0.40223.log: -- replaced with /var/log/ceph/ceph-client.0.85623.log.gz 2024-09-12T17:16:52.786 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31379.log 2024-09-12T17:16:52.790 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49663.log 2024-09-12T17:16:52.790 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.41993.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46713.log.gz/var/log/ceph/ceph-client.0.31379.log: 2024-09-12T17:16:52.790 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86213.log.gz 2024-09-12T17:16:52.790 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64413.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65593.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40223.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.49663.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41993.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72673.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.65593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76803.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.72673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52613.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%/var/log/ceph/ceph-client.0.76803.log: -- replaced with /var/log/ceph/ceph-client.0.31379.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.62643.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.52613.log: 90.6% 91.6% -- replaced with /var/log/ceph/ceph-client.0.49663.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60873.log 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.76803.log.gz 91.4% 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.65593.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.62643.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72673.log.gz 2024-09-12T17:16:52.791 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40813.log 2024-09-12T17:16:52.792 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55563.log 2024-09-12T17:16:52.792 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.60873.log: /var/log/ceph/ceph-client.0.40813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30199.log 2024-09-12T17:16:52.792 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.55563.log: gzip -5 --verbose -- 91.6% /var/log/ceph/ceph-client.0.54973.log 2024-09-12T17:16:52.792 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.52613.log.gz 2024-09-12T17:16:52.794 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.62643.log.gz 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.30199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57333.log 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40813.log.gz 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.54973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56153.log 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55563.log.gz 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr: 92.8%gzip -- replaced with /var/log/ceph/ceph-client.0.60873.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.62053.log 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.57333.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30199.log.gz 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.56153.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33143.log 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.62053.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54973.log.gz 2024-09-12T17:16:52.795 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81493.log 2024-09-12T17:16:52.796 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.56153.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T17:16:52.796 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-12T17:16:52.796 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.33143.log: /var/log/ceph/ceph-client.0.81493.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57333.log.gz 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62053.log.gz 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.33143.log.gz 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43763.log 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47893.log 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81493.log.gz 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.43763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39043.log 2024-09-12T17:16:52.798 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.47893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67363.log 2024-09-12T17:16:52.799 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.39043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34323.log 2024-09-12T17:16:52.799 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3%/var/log/ceph/ceph-client.0.67363.log: -- replaced with /var/log/ceph/ceph-client.0.43763.log.gz 2024-09-12T17:16:52.799 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47893.log.gz 2024-09-12T17:16:52.800 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39043.log.gz 2024-09-12T17:16:52.800 INFO:teuthology.orchestra.run.smithi193.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.67363.log.gz 2024-09-12T17:16:52.800 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75623.log 2024-09-12T17:16:52.800 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.34323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70313.log 2024-09-12T17:16:52.800 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.75623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70903.log 2024-09-12T17:16:52.801 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.70313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77387.log 2024-09-12T17:16:52.801 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.70903.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34323.log.gz 2024-09-12T17:16:52.802 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.70313.log.gz 2024-09-12T17:16:52.802 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.70903.log.gz 2024-09-12T17:16:52.802 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67953.log 2024-09-12T17:16:52.802 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75623.log.gz 2024-09-12T17:16:52.803 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.77387.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T17:16:52.804 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.67953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83853.log 2024-09-12T17:16:52.804 INFO:teuthology.orchestra.run.smithi193.stderr: 91.8%/var/log/ceph/ceph-mgr.x.log: -- replaced with /var/log/ceph/ceph-client.0.77387.log.gz 2024-09-12T17:16:52.804 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87988.log 2024-09-12T17:16:52.804 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.83853.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67953.log.gz 2024-09-12T17:16:52.805 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83853.log.gz 2024-09-12T17:16:52.805 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45533.log 2024-09-12T17:16:52.805 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.87988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28940.log 2024-09-12T17:16:52.806 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77971.log 2024-09-12T17:16:52.807 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28940.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28940.log.gz 2024-09-12T17:16:52.807 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6%gzip -- replaced with /var/log/ceph/ceph-client.0.45533.log.gz 2024-09-12T17:16:52.807 INFO:teuthology.orchestra.run.smithi193.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.58513.log 2024-09-12T17:16:52.808 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.77971.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.77971.log.gz 2024-09-12T17:16:52.809 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76213.log 2024-09-12T17:16:52.809 INFO:teuthology.orchestra.run.smithi193.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.87988.log.gz 2024-09-12T17:16:52.809 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.58513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63823.log 2024-09-12T17:16:52.809 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28916.log 2024-09-12T17:16:52.811 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.76213.log: /var/log/ceph/ceph-client.0.63823.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.58513.log.gz 2024-09-12T17:16:52.811 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.76213.log.gz 2024-09-12T17:16:52.811 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63823.log.gz 2024-09-12T17:16:52.812 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36683.log 2024-09-12T17:16:52.812 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37273.log 2024-09-12T17:16:52.812 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28916.log: /var/log/ceph/ceph-client.0.36683.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.28916.log.gz 2024-09-12T17:16:52.812 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73853.log 2024-09-12T17:16:52.813 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38453.log 2024-09-12T17:16:52.814 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.37273.log: /var/log/ceph/ceph-client.0.73853.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.36683.log.gz 2024-09-12T17:16:52.814 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.37273.log.gz 2024-09-12T17:16:52.815 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32559.log 2024-09-12T17:16:52.815 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.38453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43173.log 2024-09-12T17:16:52.816 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.32559.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73853.log.gz 2024-09-12T17:16:52.816 INFO:teuthology.orchestra.run.smithi193.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.32559.log.gz 2024-09-12T17:16:52.817 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T17:16:52.817 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38453.log.gz 2024-09-12T17:16:52.817 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.43173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37863.log 2024-09-12T17:16:52.818 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28844.log 2024-09-12T17:16:52.819 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.37863.log: 91.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T17:16:52.820 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.43173.log.gz 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37863.log.gz 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80313.log 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50843.log 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28844.log.gz/var/log/ceph/ceph-client.0.80313.log: 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79723.log 2024-09-12T17:16:52.821 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28868.log 2024-09-12T17:16:52.822 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.50843.log: /var/log/ceph/ceph-client.0.79723.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80313.log.gz 2024-09-12T17:16:52.822 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.79723.log.gz 2024-09-12T17:16:52.822 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50843.log.gz 2024-09-12T17:16:52.823 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66773.log 2024-09-12T17:16:52.824 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.28868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82083.log 2024-09-12T17:16:52.824 INFO:teuthology.orchestra.run.smithi193.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28868.log.gz/var/log/ceph/ceph-client.0.66773.log: 2024-09-12T17:16:52.824 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57923.log 2024-09-12T17:16:52.825 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.82083.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82083.log.gz 2024-09-12T17:16:52.825 INFO:teuthology.orchestra.run.smithi193.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66773.log.gz 2024-09-12T17:16:52.825 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48483.log 2024-09-12T17:16:52.825 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.57923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42583.log 2024-09-12T17:16:52.826 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.48483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79139.log 2024-09-12T17:16:52.827 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.42583.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57923.log.gz 2024-09-12T17:16:52.827 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48483.log.gz 2024-09-12T17:16:52.828 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42583.log.gz 2024-09-12T17:16:52.828 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59693.log 2024-09-12T17:16:52.828 INFO:teuthology.orchestra.run.smithi193.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T17:16:52.828 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.79139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59103.log 2024-09-12T17:16:52.829 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.59693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63233.log 2024-09-12T17:16:52.829 INFO:teuthology.orchestra.run.smithi193.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.79139.log.gz 2024-09-12T17:16:52.829 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.59103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86803.log 2024-09-12T17:16:52.830 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.63233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53793.log 2024-09-12T17:16:52.830 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.86803.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59693.log.gz 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr: 92.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69133.log 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.59103.log.gz 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.53793.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63233.log.gz 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51433.log 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86803.log.gz/var/log/ceph/ceph-client.0.69133.log: 2024-09-12T17:16:52.832 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36093.log 2024-09-12T17:16:52.833 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.51433.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53793.log.gz 2024-09-12T17:16:52.833 INFO:teuthology.orchestra.run.smithi193.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69133.log.gz 2024-09-12T17:16:52.833 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51433.log.gz 2024-09-12T17:16:52.834 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65003.log 2024-09-12T17:16:52.834 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.36093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47303.log 2024-09-12T17:16:52.834 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.65003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84443.log 2024-09-12T17:16:52.835 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87393.log 2024-09-12T17:16:52.835 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36093.log.gz/var/log/ceph/ceph-client.0.84443.log: 2024-09-12T17:16:52.835 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65003.log.gz 2024-09-12T17:16:52.836 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84443.log.gz 2024-09-12T17:16:52.836 INFO:teuthology.orchestra.run.smithi193.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.47303.log.gz 2024-09-12T17:16:52.837 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74443.log 2024-09-12T17:16:52.837 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.87393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44943.log 2024-09-12T17:16:52.837 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.74443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60283.log 2024-09-12T17:16:52.838 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.44943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25130.log 2024-09-12T17:16:52.838 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87393.log.gz 2024-09-12T17:16:52.838 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.60283.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74443.log.gz 2024-09-12T17:16:52.839 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44943.log.gz 2024-09-12T17:16:52.839 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60283.log.gz 2024-09-12T17:16:52.840 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78555.log 2024-09-12T17:16:52.840 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.25130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82673.log 2024-09-12T17:16:52.840 INFO:teuthology.orchestra.run.smithi193.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.25130.log.gz 2024-09-12T17:16:52.840 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.78555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39633.log 2024-09-12T17:16:52.841 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54383.log 2024-09-12T17:16:52.841 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.82673.log: 90.4%/var/log/ceph/ceph-client.0.39633.log: -- replaced with /var/log/ceph/ceph-client.0.78555.log.gzgzip 2024-09-12T17:16:52.842 INFO:teuthology.orchestra.run.smithi193.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.34913.log 2024-09-12T17:16:52.842 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75033.log 2024-09-12T17:16:52.842 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.54383.log: /var/log/ceph/ceph-client.0.34913.log: 91.5% 91.3% -- replaced with /var/log/ceph/ceph-client.0.39633.log.gz 2024-09-12T17:16:52.843 INFO:teuthology.orchestra.run.smithi193.stderr: -- replaced with /var/log/ceph/ceph-client.0.82673.log.gz 2024-09-12T17:16:52.843 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34913.log.gz 2024-09-12T17:16:52.843 INFO:teuthology.orchestra.run.smithi193.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54383.log.gz 2024-09-12T17:16:52.844 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52023.log 2024-09-12T17:16:52.844 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.0.75033.log: /var/log/ceph/ceph-client.0.52023.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75033.log.gz 2024-09-12T17:16:52.845 INFO:teuthology.orchestra.run.smithi193.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.52023.log.gz 2024-09-12T17:16:52.873 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T17:16:52.953 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T17:16:53.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T17:16:53.666 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T17:16:53.735 INFO:teuthology.orchestra.run.smithi062.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T17:16:53.736 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T17:16:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m1.011s 2024-09-12T17:16:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m1.216s 2024-09-12T17:16:53.736 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.064s 2024-09-12T17:16:53.838 INFO:teuthology.orchestra.run.smithi193.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T17:16:53.851 INFO:teuthology.orchestra.run.smithi193.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T17:16:53.852 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-12T17:16:53.852 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m1.111s 2024-09-12T17:16:53.852 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m3.228s 2024-09-12T17:16:53.853 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.161s 2024-09-12T17:16:53.853 INFO:tasks.ceph:Archiving logs... 2024-09-12T17:16:53.853 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi062/log 2024-09-12T17:16:53.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:16:54.057 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi193/log 2024-09-12T17:16:54.058 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:16:54.534 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T17:16:54.547 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T17:16:54.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:16:54.550 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:16:54.613 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T17:16:54.625 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T17:16:54.625 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:16:54.627 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:16:54.638 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:16:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-09-12T17:16:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:*hv01.front.sepi 67.205.162.81 3 u 50 64 377 0.067 -1.040 0.745 2024-09-12T17:16:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:+hv02.front.sepi 63.231.80.2 3 u 43 64 377 0.066 -0.165 0.749 2024-09-12T17:16:54.638 INFO:teuthology.orchestra.run.smithi062.stdout:+hv03.front.sepi 74.6.168.72 3 u 49 64 377 0.075 -1.489 1.350 2024-09-12T17:16:54.639 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout:============================================================================== 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.077 -1.303 0.505 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout:*hv02.front.sepi 63.231.80.2 3 u 40 64 377 0.079 -1.419 1.047 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 377 0.064 +0.185 0.682 2024-09-12T17:16:54.640 INFO:teuthology.orchestra.run.smithi193.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:16:54.641 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T17:16:54.660 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T17:16:54.661 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T17:16:54.713 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T17:16:54.763 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T17:16:54.811 INFO:teuthology.task.internal:Duration was 971.662967 seconds 2024-09-12T17:16:54.811 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T17:16:54.864 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T17:16:54.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:16:54.866 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:16:54.905 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T17:16:54.905 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T17:16:54.906 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:16:54.959 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-12T17:16:54.960 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:16:54.970 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T17:16:54.971 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:16:55.003 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:16:55.040 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T17:16:55.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:16:55.072 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:16:55.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T17:16:55.151 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T17:16:55.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:16:55.165 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:16:55.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T17:16:55.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:16:55.212 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:16:55.221 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-12T17:16:55.232 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-12T17:16:55.257 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:16:55.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:55.290 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:16:55.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:16:55.306 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T17:16:55.317 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T17:16:55.317 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi062 2024-09-12T17:16:55.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:16:55.355 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902709/remote/smithi193 2024-09-12T17:16:55.355 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:16:55.374 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T17:16:55.374 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:16:55.395 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:16:55.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T17:16:55.428 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T17:16:55.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T17:16:55.462 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T17:16:55.463 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:16:55.465 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:16:55.469 INFO:teuthology.orchestra.run.smithi062.stdout: 658623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:16 /home/ubuntu/cephtest 2024-09-12T17:16:55.470 INFO:teuthology.orchestra.run.smithi193.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:16 /home/ubuntu/cephtest 2024-09-12T17:16:55.471 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T17:16:55.512 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T17:16:55.615 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} duration: 971.662966966629 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T17:16:55.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:16:55.738 INFO:teuthology.run:pass